Maybe if you can get to the office via public transport or cycling it might make sense. But, if you drive then it's consuming more energy than heating the room you're in at home.