LMDeploy AWQ #2776
Unanswered
sitabulaixizawaluduo
asked this question in
Q&A
LMDeploy AWQ
#2776
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
AWQ反量化后的数据精度是自动用float16, 还是会根据config.json自适应为bfloat16或者float16
Beta Was this translation helpful? Give feedback.
All reactions