I have not had a chance to attack this problem yet but got some more input.
With the engine cold, there is no problem.  The engine idles fast (where it
is set) and doesn't stumble or have any problems.  Once it gets to
temperature, I assume that it goes closed loop and that is when it starts
dropping in speed.  A lot of you on the list talk about the engine
increasing in speed and then dropping.  My engine actually goes the other
direction.  It drops in RPM and then comes back up to idle speed.  If you
touch the acclerator (basically allow the idle switch to trigger), there is
no problem so the problem only relates to the idle of the engine.  Any new
ideas before I start just digging in one piece at a time?

William