-
Hello, |
Beta Was this translation helpful? Give feedback.
Answered by
simon-mo
Jul 5, 2024
Replies: 1 comment 3 replies
-
See perf result here #2192. In certain cases, the custom topology drastically boosts performance compared to nccl's implementation. vLLM still uses nccl in majority of cases. |
Beta Was this translation helpful? Give feedback.
3 replies
Answer selected by
SamKG
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
See perf result here #2192. In certain cases, the custom topology drastically boosts performance compared to nccl's implementation. vLLM still uses nccl in majority of cases.