Please create a ComfyUI node to use SageAttention

[wardensc2]

Hi @jt-zhang

Thank you so much for your work however for normal people like us it's very difficult to understand your code and implement it on normal you. Can you write a Comfy Node for us to use Sage Attention easier

Thank in advance

[jason-huang03]

Sorry we are not familiar with Comfy. However, I have read blogs that claim to use SageAttention with Comfy like this. Perhaps you can refer to them. The Comfy community is quite active and I believe there are ready solutions to the problem.

[jason-huang03]

Also the mochi node supports using SageAttention.

[blepping]

I added an enhanced SageAttention node to my ComfyUI-bleh node pack. The BlehSageAttentionSampler will enable SageAttention just while a specific sampler is running which has less chance of causing issues than monkeypatching ComfyUI's attention globally. You can also choose to have it enabled for part of sampling.

Note: This image is just an example of how you could pass parameters if you need to, not a recommendation.

You can select the kernel or pass parameters to the attention function directly via a YAML text input. Note: Doing stuff like messing with sm_scale is not recommended/supported so if you enter weird parameters and stuff breaks don't bug the SageAttention authors about it.

[jt-zhang]

Thank you for the valuable suggestion and contribution. We are also continuously improving and updating more features. You can Star and Watch our repository to stay updated.