Instructions to use kernels-community/flash-attn2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/flash-attn2 with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/flash-attn2") - Notebooks
- Google Colab
- Kaggle
metadata
library_name: kernels
license: bsd-3-clause
This is the repository card of kernels-community/flash-attn2 that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.
How to use
Usage example not available.
Available functions
Function list not available.
Benchmarks
Benchmarking script is available for this kernel. Run kernels benchmark kernels-community/flash-attn2.