Login
From:
Habana Developers
(Uncensored)
subscribe
BLOOM 176B Inference on Habana Gaudi2 - Habana Developer Blog - Habana Developers
https://developer.habana.ai/blog/bloom-176b-inference-on-habana-gaudi2/
links
backlinks
Tagged with:
inference
bloom
deepspeed
habana developer blog
With Habana’s SynapseAI 1.8.0 release support of DeepSpeed Inference, users can run inference on large language models, including BLOOM 176B.
Roast topics
Find topics
Find it!