Adding Support for Qwen3.5 by bozheng-hit · Pull Request #43830 · huggingface/transformers

1 min read Original article ↗

and others added 17 commits

February 7, 2026 12:08

@vasqu

@vasqu

jiosephlee pushed a commit to jiosephlee/transformers_latest that referenced this pull request

Feb 11, 2026
* rebase main

* remove redundant init

* fix

* remove qwen3vlmoe mapping since resolved

* add auto image processor

* fix

* fix

* update qwen3_next_style rmsnorm

* update text config check

* simplify vision model

* simplify vision config

* inherit pretrainedmodel and qwen3next decoder layer forward

* simplify config

* fix apply_rotary_pos_emb import

* move to latest main, update vision output and fix rope validation

* fix text-only model loading

* fix config

* quick fixes

* fix rope ignore keys

* oops

* add test suite

* style

* docs

* ok

* last consistency fix

---------

Co-authored-by: bozheng-hit <dsoul0621@gmail.com>
Co-authored-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: vasqu <antonprogamer@gmail.com>