@DarkLight1337 I can try to process several models

Can you indicate which models you are working on to avoid others duplicating your work?

I haven't started yet, do you have any recommendations for simpler models?

Most language models should work in pretty much the same way (except SSMs like Mamba I guess). You can go in alphabetical order.

Thanks ~
/assign

Tips, these are unimplemented models, i use shell script to count, this is the approximate result：

• arctic.py
• baichuan.py
• bamba.py
• bart.py
• bert.py
• blip.py
• bloom.py
• clip.py
• chameleon.py
• commandr.py
• dbrx.py
• decilm.py
• deepseek.py
• deepseek_v2.py
• eagle.py
• exaone.py
• falcon.py
• gemma.py
• glm.py
• glm4v.py
• gpt2.py
• gpt_bigcode.py
• gpt_j.py
• gpt_neox.py
• granite.py
• granitemoe.py
• granitemoeshared.py
• gritlm.py
• grok1.py
• h2ovl.py
• idefics2_vision_model.py
• interfaces.py
• interfaces_base.py
• internlm2.py
• jais.py
• jamba.py
• mamba.py
• mamba2.py
• mamba_cache.py
• medusa.py
• minicpm3.py
• mixtral.py
• mixtral_quant.py
• mllama.py
• mlp_speculator.py
• module_mapping.py
• mpt.py
• nemotron.py
• nvlm_d.py
• olmo.py
• olmo2.py
• olmoe.py
• opt.py
• orion.py
• persimmon.py
• phi.py
• phi3.py
• phi3_small.py
• phi4mm_audio.py
• phi4mm_utils.py
• phimoe.py
• pixtral.py
• qwen.py
• qwen2_moe.py
• qwen3_moe.py
• qwen_vl.py
• registry.py
• roberta.py
• siglip.py
• solar.py
• stablelm.py
• starcoder2.py
• teleflm.py
• vision.py
• zamba2.py

The multi-modal models don't need this change, can you remove them from the list?

Hi, I could take on a few models, e.g. baichuan, gpt_neox, and mpt.

I’ll take on a few more models next week.

@DarkLight1337 I can add two new skip field, eg. skip_substr: Optional[List[str]] = None, skip_suffix: Optional[List[str]] = None,, because prefix not applicable in all situations.

Unless you also need ignore_unexpected_*, I suggest to instead map the weight to None inside the WeightsMapper

Issue record: #16548 (comment)