If someone is still receiving alerts for something that is no longer necessary for them, you'll want to remove them from the Distribution List within that Alert.
Removing Someone From a Distribution List
- Go to System > Settings > Alerts. Edit the Alert the person is being removed from.
(click to enlarge)
- Now, edit the Distribution List.
- You can now Remove anyone you'd like from the Distribution List.