The core.modify_notification_message hook is executed prior to template execution, so it is impossible to actually modify the notification message since the message gets replaced by the template immediately after the hook. The subject is also impossible to modify if a template contains a subject header which is extracted by regular expression for the same reason.