'86 Westy

Occasionally, especially when is cold outside, I turn the key on the van
and have to wait for it to start turning over. From 1 to 10
seconds....very scary.  I went to my local shop and they said it was the
lower ignition switch, very common, 9 dollar part, 1 hour labour!   NExt
day....same thing.  Does anybody have any ideas? Is the starter going?
The battery is new.

Thanks
Gregor