Other possible purposes for the cap on the end of a gas heater exhaust:
Porch for mice.  Whistle to scare deer.  Used to be a whole muffler there but
it rusted off before Jack found it.
B.