I don't think you mentioned whether it was a front or rear wheel that
was suspect, but I had similar symptoms that were due to a broken
spring loose and grinding down inside a rear drum.  After pounding and
prying the drum off, it was an easy fix with a replacement spring kit.

Alex