Is it an actual problem to compile extension modules with -flto?  (I realize as an extension module there isn't a huge benefit to the concept unless it happens to have multiple source files or link against a non-shared library)