Seriously, be afraid. Consider your own well-being. If you must, take up a self-defence class, like judo or taekwondo, so if he gets nasty, you get nasty. You don't want to end up whimpering and sobbing in the corner, curled up like a ball - that's just sad.
