Because he knows that he can beat you in a fight and you have fame. Talking from experience, I would go through the fame pages and attack anyone in my level range that I could beat. I would do that from page one, all the way back to people who had less that a million in fame. Though admittedly that was in a much simpler time when fame wasn't breaking characters and stuff like that.