It's something you will probably need to always do when dealing with him. He should get to the point that he won't try to approach when he sees the broom but he will still attack if you don't have the broom.
Carry a broom with you. Use the sweeping end to keep him at a distance from you. Just use it to push him away. Do not swing it at him or hit him with it.
Never turn your back on him. Never try to hit or kick him.