One of my vans with an A/T is slipping but only in reverse, typically
when there is a load on the vehicle (i.e. backing up a hill it slips
big time, almost not driveable).

All forward gears work normally.

Is it just a dirty valve body that I can clean with some tranny clean
snake oil or is it something more serious?

Any ideas?