For the user to be able to delete the PM when viewing it they have to have the "can send private messages" permission. For whatever reason deleting PM's doesn't work the same when viewing them compared to viewing the list of them.

This is counter intuitive. Either change the behavior (the link mode=compose) or don't display the delete icon which doesn't seem to be the best idea as one can still delete the PM via the list view.