If you think so, then you have to redo your software without pycrypto.
if you are using Yocto, then, it is a linux distribution. Probably using the Intel Edison. You can cross-compile the library or compile it directly on the Edison.
If you do not understand what I am telling, then change your board and take a more flexible board like an Odroid or a RPi.