Login
Roast topics
Find topics
Find it!
From:
PyTorch
(Uncensored)
subscribe
TorchAO Quantized Models and Quantization Recipes Now Available on HuggingFace Hub
https://pytorch.org/blog/torchao-quantized-models-and-quantization-recipes-now-available-on-huggingface-hub/
links
backlinks
Tagged with:
blog
Roast topics
Find topics
Roast it!
PyTorch now offers native quantized variants of Phi4-mini-instruct, Qwen3, SmolLM3-3B and gemma-3-270m-it through a collaboration between the TorchAO team, ExecuTorch team, and Unsloth! These models leverage int4 and float8 quantization...