Merged
Conversation
- Added `vision_analyze` tool for image analysis using vision-capable LLMs, supporting URLs, file paths, and base64 data. - Introduced `OpenRouterPreferences` dataclass for managing upstream provider routing preferences. - Implemented model capabilities caching with `is_vision_capable()` and `get_cached_capabilities()` functions. - Refactored code to reduce duplication in OpenAI and OpenRouter providers. - Improved security for vision tools, including path traversal and SSRF protections. - Fixed issues with image handling in various providers and improved error handling for OpenRouter preferences. - Bumped version to 0.1.14.
- Added support for warning messages when images are dropped due to provider limitations in the ProductionAgent. - Implemented a method to retrieve and clear the last image warning. - Updated the ZAI provider to strip images and log warnings when images are detected, as it does not support inline images. - Enhanced the image extraction utility to handle macOS drag-and-drop paths with backslash-escaped spaces. - Improved the TUI to redirect pasted images and display warnings for stripped images. - Refactored message building to ensure user-provided images are not restricted by working directory. - Added unit tests for new image handling features and provider behavior.
- Added vision support with the `vision_analyze` tool for image analysis using LLMs. - Introduced inline image support in TUI, allowing drag-and-drop or paste functionality. - Enhanced image path extraction utility for better handling of various input formats. - Updated ZAI provider to handle image blocks more effectively, including stripping and placeholder management. - Improved security measures for vision tools and refined caching mechanisms for model capabilities. - Added extensive tests for vision features and other functionalities to ensure robustness.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.