If you are super ambitious/extreme I found my microwave is a (small) phantom, its the LED display. Gaming consoles, stuff that has standby modes, is also a common one, standby means power is being used waiting for signals.
The solution is a cheap digital timer turning it off overnight or a power bar for stuff that's rarely used. The alternative was a kill switch (off/on) but that requires more effort on a regular basis and I like automated stuff.
Most of the stuff I found was $2-5/year, its not getting rich money. Its purely curiosity that made me do it, but if you think a cappucino maker is bad then maybe your inclined to be inquisitive.
I asume the heat pump is fairly cheap to operate compared to the heat output, although it runs on electricity its not getting its Heat energy that way. There's probably some BTU/Therms/Heat output rating on it; you can compare costs/unit of heat which is what really matters, the trouble is getting everything into comparable units. For example 1 kwh is roughly 3400 Btu and a therm is 100,000 btu (now we have electricity and gas in the same units of BTU!). A therm (I think thats what americans use) costs approx. $0.60 while a kwh costs $0.15, so you see its better to heat with gas than electricity. Thats more math than you probably wanted.
But how many BTUs is your heat pump yielding per dollar of electricity it uses? That one eludes me but I bet you have some sort of rating on it and its cheaper than pure electric heat (or you would heat with pure electric...)