Qwen 3.6 27B Dense模型在RTX 3090上达40 tok/s

robot
Abstract generation in progress

AIMPACT message, April 24th (UTC+8), 2026, user @sudoingX released preliminary test results: Qwen 3.6 27B Dense model on a single RTX 3090 24GB graphics card, passing 10/10 tests at a speed of 40 tokens/sec. The result was achieved without using quantization techniques or fused kernels, only employing llama.cpp’s Q4_K_M direct quantization. The user also wrote a particle swarm benchmark to evaluate the model. (Source: InFoQ)

This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pin