AutoModel.from_pretrained without accelerate raises a NameError because init_empty_weights is not available
#37311
Comments
LoicGrobol
changed the title
init_empty_weights is not available
|
same, this problem is introduced in 4.50.3->4.51.0 |
|
downgrade to transformers=4.49.0 solved my problem |
LoicGrobol
changed the title
init_empty_weights is not availableinit_empty_weights is not available
|
@samuelan installing accelerate is a better solution imo but still, that's a bug. |
4 tasks
|
Yep accelerate should be installed, we will fix that ASAP sorry all ! |
|
This hurts especially in inference-only cases. I'm using sentence-transformers (pinned version) to compute embeddings, and this morning my builds started failing for no good reason. We have no need to install accelerate, and I'm not referencing transformers directly. But, simply instantiating a SentenceTransformer calls the magic line, and everything fails. |
Velascat
added a commit
to Velascat/Zonos-API
that referenced
this issue
Apr 7, 2025
PeterD1524
added a commit
to PeterD1524/WasmEdge
that referenced
this issue
Apr 7, 2025
…nsorType change in WasmEdge#4069 install transformers==4.50.3 for chattts as a workaround for huggingface/transformers#37311 Signed-off-by: PeterD1524 <[email protected]>
|
same here @vladiliescu |
PeterD1524
added a commit
to PeterD1524/WasmEdge
that referenced
this issue
Apr 7, 2025
…or TensorType change in WasmEdge#4069 install transformers==4.50.3 for chattts as a workaround for huggingface/transformers#37311 Signed-off-by: PeterD1524 <[email protected]>
PeterD1524
added a commit
to PeterD1524/WasmEdge
that referenced
this issue
Apr 7, 2025
…r TensorType change in WasmEdge#4069 install transformers==4.50.3 for chattts as a workaround for huggingface/transformers#37311 Signed-off-by: PeterD1524 <[email protected]>
|
Closing as this was fixed on main #37337 |
|
Sorry everyone this was not planned |
15 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
d1b92369ca193 introduced a call to
init_empty_weightsthat leads to an error if accelerate is not installed. This should be guarded by a condition that accelerate is available (one already guards the import, but not the actual call).The text was updated successfully, but these errors were encountered: