You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit bdcf642
Browse filesBrowse the repository at this point in the historyBrowse files
LittleMouse
committed
Add llm-llm2 documentation and model configurations
- Introduced new documentation for the llm-llm2 framework, detailing setup, inference, linking, unlinking, pausing, exiting, and task information retrieval.
- Added model configuration files for Qwen3 series models, including Qwen3-0.6B, Qwen3-1.7B, Qwen3.5-0.8B-Int4, Qwen3.5-2B-Int4, and Qwen3.5-4B-Int4.
- Updated main.cpp to support dynamic sampling parameter overrides during inference.
- Enhanced LLMPostprocess class to handle new sampling configurations and reset to defaults.
- Updated llm_pack.py to include new model entries for packaging.
0 commit comments