Compose Softmax Mainloop with Collective #1763
Unanswered
osayamenja
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hello team!
I want to perform a fused gemm + softmax. I noticed CUTLASS provides an implementation here. So, how would I compose
DefaultMmaSoftmaxMainloopFusionwith a collective?My understanding from reading the code is that the fusion is a collective itself that I can construct with its type arguments, is this correct?
I checked thoroughly and did not find any examples but please, refer me if there are any!
All reactions