Against a gas boiler
It moves heat rather than makes it, so on running cost it sits close to gas per unit of warmth delivered, not below it. See the full maths in the cost guide. What gas cannot do is July. An air-to-air heat pump runs in reverse and cools the house; a boiler has nothing to offer.