В pypi, где лежит библиотека есть ответ на ваш вопрос:
You must also install pycrypto. Note that pycrypto has parts written in C so requires a full python install. On some unix systems that may mean adding a package like python-dev from your package manager