ACP Option "allow php in templates" does not work until cache is purged

When option "allow php in templates" is changed in admin control panel, templates cache isn't purged, resulting in old setting being active for templates that are already compiled until cache is purged. Changing that option should automatically purge cache.