Group Avatar not deleted from users

I've seen that group avatars are being copied over to user accounts that haven't set an own avatar yet.
Problem here is, if I delete the group avatar from group, the avatar will remain on the user accounts.