Get even, make some noise, real noise, and make them as scared as you were.
It always works.
Download gunshots, or other scary sounds and see what your neighbours do then?
Turn up the volume really high!
I had never told anyone living in our apartment complex that I am a cop. Then my department insituted a mandatory carry a firearm even off duty policy. One of my neighbors saw I had a gun and asked me about it.
I told him I was a cop and explained about our new policy. He told everyone. Now when there is a domestic disturbance, they come and knock on my door. They do not even think about dialing 911. What the fuck!
You should have told him you were an enforcer for the mob. Quick thinking is essential if you're going to be successful in law enforcement. So now you're outed and you get asked for help when you're off-duty. Bummer.
I mean, you make a good point--but are still a DICK