Enable avatar upload -> upload an avatar -> disable avatar upload -> change the avatar to an off-site link
=> the old (uploaded) avatar doesn't get deleted if you don't delete it explicitly using "[ ] Delete image"
At least it seems so...