This happens to me often; my reaction changes greatly depending on my knowledge of the source of the sound. I’m extremely affected by the sound of bass (not if I can hear the music, but just that, like, “feeling” bass through the walls), but if it turns out the sound is something else (construction equipment, for example) the emotional response vanishes.
There’s an inherent rage-inducing quality to a repetitive sound that I know is being caused by another person. It makes the sound really intense, stemming from an impression of how inconsiderate the person is being.