Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

diffusers also has example usage for TensorRT in the Stable Diffusion context: https://github.com/huggingface/diffusers/blob/85dccab7fd280c...

Seems those particular examples were submitted by NVIDIA employee too: https://github.com/huggingface/diffusers/commit/9d44e2fb6600...

Shouldn't be too hard to adopt to other similar pipelines if you've used diffusers before.



That's a good example of a "hit and run" demo.

None of the community Diffusers pipelines I know of have successfully integrated this. VoltaML made a valiant effort and gave up in favor of Facebooks AITemplate (for now).


Worked for me and was easy to integrate, but I use diffusers directly. Not sure what the others are doing, but if you can manage to implement your own pipeline with diffusers, you should be able to integrate the TensorRT pipeline with relative ease.

https://github.com/VoltaML/voltaML seems to have successfully integrated it as far as can tell, it says TensorRT is one of the compatible backends.


VoltaML abandoned it (but may revisit it) and replaced it with AIT.

The problem with a vanilla diffusers pipe is that you miss out on all the cool community augmentations that really make sd shine. Crazy img2img stuff aside, some random examples include:

- Fooocus's implementation preserves 'momentum' when switching from the sdxl base model to the refiner.

- freeu augmentation

- tomesd

- fooocus image style presets, with known styles from the dataset strait from SAI and others.

- auto prompt expansion

- performance hacks not in vanilla diffusers




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: