Uninstalling an extension that adds a module causes an error upon purge

When an extension adds a new module and you try to uninstall the extension, you get an error like the following:

Module 224 was unable to be removed: Array

Of course, the number (module id) is going to vary.