Joy,
There are diverse possibilities in Mississippi, e.g.-

Civil War-related (like Vicksburg battlefield and Jeff Davis home)
Natchez Trace
Petrified forest
The Delta
The river
Various blues venues
MS Gulf Coast (I prefer Alabama's coast, but if you like to gamble...)
Natural Science Museum in Jackson (and other such attractions)
Numerous nice state parks
Kayaking opportunities abound

Gary Anderson (in Hattiesburg with MS WESTY)