GLIBC 2.33 has new exciting feature called HWCAPS.
This will allow dynamic linker to load optimized versions of libraries that are optimized for given CPU families (and their related features).

GLIBC 2.33 will definetelly be part of most future Linux distributions, so it may be a good way to improve CPU performance of this project.
some info from Phoronix: https://www.phoronix.com/scan.php?page=news_item&px=Glibc-2.33-Coming-HWCAPS