Remove unused imports

The flake8 test currently ignores F401 errors. As pointed out in !705 (merged), this is an easy way of not noticing deprecation/removing imports.