We've been adopting kernels in transformers to handle the device-specific optims, quants, or easyinstalls for popular kernels. We're opening this gradually with a focus on impactful kernels; if you're building kernels the ML field could benefit from, please send us a request!