We are currently creating a new compiled container on every page load when having DEBUG enabled. However, one might only have that enabled to be presented with errors or for getting the page load stats.
This does cause a major overhead which is especially noticeable in the functional tests. A small test showed that this might speed up functional tests by as much as 40 %.