I struggle with the same issue and attribute it to my external metal chimney. When it gets cold I have to use a blow dryer to move the cold air out of the chimney, if i don't it will pour back into the room but I've never had this problem with my insert which uses a 30' lined masonry chimney. A friend suggested using a candle beforehand to get the heat moving up but I haven't tried it.