🌟 OpenCompass v0.3.3 Release Log
The OpenCompass team is thrilled to announce the release of OpenCompass v0.3.3!
🚀 New Features
- 🔧 Added support for the SciCode summarizer configuration.
- 🛠 Introduced support for internal Followbench.
- 🔧 Updated models and configurations for MathBench & WikiBench under FullBench.
- 🛠 Enhanced support for OpenAI O1 models and Qwen2.5 Instruct.
- 🔧 Included a postprocess function for custom models.
- 🛠 Added InternTrain feature for broader model training scenarios.
📖 Documentation
- 📚 Updated the README with the latest information on how to use OpenCompass effectively.
🐛 Bug Fixes
- 🔧 Fixed issues with the link-check workflow and wildbench.
- 🛠 Resolved errors in partitioning and corrected typos throughout the codebase.
- 🔧 Addressed compatibility issues with lmdeploy interface type changes.
- 🛠 Fixed the followbench dataset configuration and token settings.
⚙ Enhancements and Refactors
- 🛠 Enhanced support for verbose output in OpenAI API interactions.
- 🔧 Updated maximum output length configurations for multiple models.
- 🛠 Improved handling of the "begin section" in meta_template for better parsing.
- 🔧 Added a common summarizer for qabench and expanded test coverage for various models.
🎉 Welcome New Contributors
👋 We'd like to extend a warm welcome to our new contributors who have made their first contributions to OpenCompass:
- @x54-729 introduced InternTrain.
- @chuanyangjin helped correct typos.
- @cuauty added support for reasoning from BaiLing LLM.
Thank you to all our contributors for making this release possible!
Full Changelog: 0.3.2.post1...0.3.3
Contributors
cuauty, x54-729, and chuanyangjin