Hat tip to Amanda Peyton for instigating this.

A couple weeks ago I turned off basically all of the notifications on my phone. Only the most time-sensitive apps get sounds - and if it's in the lock screen/notification center, it should have a sound, and vice versa. This is all that's left:

Not having sounds & vibrate for email is the biggest change. It's really nice - it really emphasizes that email is characteristically different from SMS, and allows me to turn off much more easily.

I recommend trying this out, especially for emails. It's really nice.