Ask to have a word and ask what you are doing wrong more than others as another way of saying why you picking on me! It might help him apologise and make him make more of an effort to not target you more.
Reply To: My boss has misophonia, how do I deal with the angry outbursts?