What's New
Improvements
- Multi-language tokenizer support with Unicode & Regex (#284)
- Significantly improves support for CJK (Chinese, Japanese, Korean) languages
- Better handling of non-Latin scripts
Bug Fixes
- Fix Gemini Batch API project parameter passing (#286)
- Resolves "Required parameter: project" error when using Vertex AI
Full Changelog: v1.1.0...v1.1.1