Anybody ever have a problem where they weighed so little that the horse didn't know they were there?

I don't think you weight or lack of has anything to do with making the horse mind, that is a discipline problem not a weight problem.