SemanticFinder now supports WebGPU thanks to 
text
SemanticFinder now supports WebGPU thanks to 
@Xenova
mention
Xenova
's efforts with transformers.js v3!
text
's efforts with transformers.js v3!
new_line
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
text
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
new_line
- WebGPU: 
text
- WebGPU: 
https://do-me.github.io/SemanticFinder/webgpu/
https://do-me.github.io/SemanticFinder/webgpu/
link
new_line
- Wasm: 
text
- Wasm: 
https://do-me.github.io/SemanticFinder/
https://do-me.github.io/SemanticFinder/
link
new_line
new_line
WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: 
text
WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: 
https://huggingface.co/spaces/Xenova/webgpu-embedding-benchmark
Xenova/webgpu-embedding-benchmark
space
resource
https://huggingface.co/spaces/Xenova/webgpu-embedding-benchmark
new_line
Chrome currently works out of the box, Firefox requires some tweaking.
text
Chrome currently works out of the box, Firefox requires some tweaking.
new_line
new_line
WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: 
text
WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: 
https://huggingface.co/datasets/do-me/SemanticFinder
do-me/SemanticFinder
dataset
resource
https://huggingface.co/datasets/do-me/SemanticFinder
new_line
Happy to hear your ideas!
text
Happy to hear your ideas!
SemanticFinder now supports WebGPU thanks to @Xenova's efforts with transformers.js v3!
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
- WebGPU: https://do-me.github.io/SemanticFinder/webgpu/
- Wasm: https://do-me.github.io/SemanticFinder/

WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: https://huggingface.co/spaces/Xenova/webgpu-embedding-benchmark
Chrome currently works out of the box, Firefox requires some tweaking.

WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: https://huggingface.co/datasets/do-me/SemanticFinder
Happy to hear your ideas!
🚀
osanseviero Felladrin maywell Xenova ngxson ai-everyday louisbrulenaudet adorkin
👀
John6666 Presidentlin Xenova ngxson
63ca214abedad7e2bf1d1517
https://cdn-avatars.huggingface.co/v1/production/uploads/1674191139776-noauth.png
Xuan-Son Nguyen
ngxson
user