[Yugi is a cute kid, but he's not being looked down upon. That might be the difference.]

Of course. It's a little complicated to explain, but essentially... you've done all the hard work, so all he has to do is remember the words or thoughts that led to it. Your body's already developing its capabilities through you, and that work won't be lost if he's in control.