I too was tired of the same problem.
I took mine out, peeled the rubber off the stem, cut it halfway and put in a metal tube extension, 2 1/2 inches long. I filed the parts and assembled it with JB Weld.
I tidied it up and painted it to match and replaced it.

It works great and now I can see if the Crown Vic following me has blue lights on top.
Only down side is that the sun visors leave a gap above the mirror now which sometimes lets sun through when I need it least.

Good luck,   Steve Cotsford