That's what the drug dealers across the street from us (i'm not kidding, they sold drugs across the street) did all the time. Then eventually a good number of them were arrested, and it got quieter.
I don't have much advice for you, but...for as tempting as it is, if you retaliate with noise and swear words, it'll probably only get worse. That happened to me, too.