Large Language ModelsQwen 3.8 Flash Next 125B Model can now Work at 100T/s Speed on Consumer GPU
Thanks to the Strata project, the 125 billion parameter Qwen model has been able to run at 100 tokens/second speed in consumer hardware such as RTX 40
1 articles · Posts with this tag