-
Notifications
You must be signed in to change notification settings - Fork 372
Run Flux LoRAs on Replicate #1395
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Run Flux LoRAs on Replicate #1395
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice and simple!
For information, mapping lora models requires to create a different kind of "inference provider mapping" (tag-based).
See the (wip) documentation PR here for more info: huggingface/hub-docs#1717
Co-authored-by: Simon Brandeis <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice!
Thanks for all the helpful reviews! Made another pass of updates. I think this is ready to go. 🚀 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
I will let @hanouticelina do a final pass on this then let's merge!
Co-authored-by: Simon Brandeis <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
|
This PR updates the
ReplicateTextToImageTask
method to support running arbitrary LoRAs on Replicate.How it works:
weights_url
input to the flux-dev-lora modelCompanion PR
Testing
Remove the
skip
fromdescribe.skip("InferenceClient" ...
in InferenceClient.spec.tsThen: