I would completely ignore him at every turn. I would also keep a written diary of every interaction he tries with you after you stop communications with him. If he continues the passive-aggressive intimidation tact I would have a cease and desist letter drafted.