Skip to content

Conversation

@CISC
Copy link
Collaborator

@CISC CISC commented Dec 15, 2025

Follow up to #18013

Fixes multimodal model configs.

Copy link
Collaborator

@ngxson ngxson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm, that's strange, the "text_config" should already moved to root-level config inside TextModel.__init__()

Maybe a better fix it to only populate this rope_parameters inside TextModel? Vision models doesn't seem to use it

@CISC
Copy link
Collaborator Author

CISC commented Dec 15, 2025

hmm, that's strange, the "text_config" should already moved to root-level config inside TextModel.__init__()

This is in BaseModel, so that hasn't happened yet.

Maybe a better fix it to only populate this rope_parameters inside TextModel? Vision models doesn't seem to use it

Hmmm, could be...

@CISC
Copy link
Collaborator Author

CISC commented Dec 15, 2025

Maybe a better fix it to only populate this rope_parameters inside TextModel? Vision models doesn't seem to use it

Hmmm, could be...

Yep, much better.

@CISC CISC changed the title convert : make sure to search text_config for rope parameters convert : move rope_parameters to TextModel class Dec 15, 2025
@CISC CISC requested a review from ngxson December 15, 2025 17:25
Copy link
Contributor

@tdakhran tdakhran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @CISC !

@ngxson ngxson merged commit d6a1e18 into master Dec 15, 2025
9 checks passed
@CISC CISC deleted the cisc/convert-find-subparams branch December 15, 2025 21:06
@github-actions github-actions bot added the python python script changes label Dec 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python python script changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants