I've only been yelled at once (the cops were called and showed up in my driveway)... When they left the guy who called them yelled at me for waking his kid up...
To be fair it was 2 in the afternoon on a weekday, but I did start my blown 408 with 2 inch headers that fed a 3.5 inch collector, open headered and revved it a few times. I'm pretty sure it was shaking most of my neighbors couches for a few minutes.
