Merged
Conversation
* add sparse vector embedding * hybrid search add sparse vector search * add checking version logic * add qwen sparse vector * adjust weight * update sparse vector function * update sparse vector function * fix bug * fix bug * optimise function * optimise function * optimise function * optimise function * optimise function * optimise function * optimise function * fix bug * add migrate function * update alembic function * update alembic function * update alembic function * adjust file struct * update alembic * update version * optimise * fix bug * update * update schema update method * update schema update method * update schema update method * update schema update method * update schema update method * update migrate method * update migrate method * update env.example * update env.example * update migrate sparse vector * update migrate sparse vector * adjust threshold score logic * update remark * add guides and examples * add benchmark param * fix bug * fulltext parsers support * adjust enable sparse vector setting * adjust env.example * adjust docs * update version * fix bug * optimise check * adjust file construct * adjust file construct * add native search * add file * remove log * remove log * fix bug * update pyobvector * add rerank * adjust * add limit * adjust config
* support native language * support native language * add docs
* feat(llm): enhance configuration management with pydantic-settings - Introduced a unified configuration system for LLM providers using pydantic-settings. - Added provider-specific settings for Anthropic, Azure, DeepSeek, Ollama, OpenAI, Qwen, Vllm, and Zai. - Improved environment variable handling and validation through Field and AliasChoices. - Removed legacy initialization methods in favor of a cleaner, more maintainable structure. - Updated LLMFactory to utilize the new provider registration mechanism. * chore: Update LLM configuration management and improve environment variable handling - Refactor LLM configuration imports to use BaseLLMConfig. - Replace direct attribute access with getattr for safer environment variable retrieval. - Remove deprecated LLMConfig and streamline related code for better maintainability.
* feat(llm): enhance configuration management with pydantic-settings - Introduced a unified configuration system for LLM providers using pydantic-settings. - Added provider-specific settings for Anthropic, Azure, DeepSeek, Ollama, OpenAI, Qwen, Vllm, and Zai. - Improved environment variable handling and validation through Field and AliasChoices. - Removed legacy initialization methods in favor of a cleaner, more maintainable structure. - Updated LLMFactory to utilize the new provider registration mechanism. * chore: Update LLM configuration management and improve environment variable handling - Refactor LLM configuration imports to use BaseLLMConfig. - Replace direct attribute access with getattr for safer environment variable retrieval. - Remove deprecated LLMConfig and streamline related code for better maintainability. * feat: Enhance rerank configuration and integration - Introduced BaseRerankConfig for improved configuration management across rerank providers. - Updated rerank integration files to utilize the new base configuration structure. - Added support for additional configuration fields such as api_base_url and top_n. - Refactored rerank factory to accommodate new configuration handling and provider registration. - Removed deprecated RerankConfig and streamlined related code for better maintainability. - Updated API request handling in rerank classes to support custom HTTP clients. * * refactor(powermem): remove unused storage configuration management module - Removed `VectorStoreConfig` and `GraphStoreConfig` classes - Deleted associated validation logic and import statements - Streamlined codebase by eliminating unused components * feat(powermem): enhance sparse embedder configuration management - Introduced BaseSparseEmbedderConfig for unified sparse embedding configuration. - Updated MemoryConfig to utilize BaseSparseEmbedderConfig. - Refactored SparseEmbedderFactory to support new configuration handling. - Improved handling of sparse embedder settings across various components. * feat(powermem): enhance user profile storage with provider registration - Added a registry mechanism to UserProfileStoreBase for automatic provider registration. - Implemented class paths for OceanBase and SQLite user profile storage implementations. - Updated UserProfileStoreFactory to utilize the new registry for provider class retrieval. - Refactored imports to trigger auto-registration of user profile storage classes. - Improved handling of provider names in the factory for better compatibility. * feat(powermem): synchronize embedding model dimensions across configurations - Added logic to sync `embedding_model_dims` from the embedder to both `vector_store` and `graph_store` if not already set. - Updated `config_loader.py` and `configs.py` to ensure consistent embedding dimensions across components. * feat(powermem): enhance OceanBase configuration and query handling - Added `enable_native_hybrid` field to `OceanBaseConfig` for native hybrid search support. - Updated query handling in `OceanBaseVectorStore` to use a safe query format, preventing SQL injection risks.
* oceanbase native language case * Oceanbase Native Hybrid Search Cases
…RL bug (oceanbase#224) * Enhance memory operations with background threading support - Added a global background thread pool for asynchronous memory updates and deletions in the Memory class. - Updated the handling of memory updates and deletions to submit tasks to the background executor, improving performance and responsiveness. * format * Enhance SiliconFlowConfig API key handling - Updated `SiliconFlowConfig` to improve API key and base URL handling by adding new validation aliases for better compatibility.
# Conflicts: # benchmark/server/main.py # pyproject.toml # src/powermem/storage/configs.py # src/powermem/storage/factory.py # src/powermem/user_memory/user_memory.py
- Added backward compatibility for OceanBase by constructing connection arguments from vector store configuration. - Updated unit tests to verify the inclusion of internal settings in the configuration.
* Enhance configuration management for OceanBase in config_loader.py - Added backward compatibility for OceanBase by constructing connection arguments from vector store configuration. - Updated unit tests to verify the inclusion of internal settings in the configuration. * disable env file
# Conflicts: # tests/unit/test_config_loader.py
* Enhance configuration management for OceanBase in config_loader.py - Added backward compatibility for OceanBase by constructing connection arguments from vector store configuration. - Updated unit tests to verify the inclusion of internal settings in the configuration. * disable env file * Fixed run failure caused by incorrect folder name
…uality metrics(phase1 & phase2 Done) - Added new API endpoints for retrieving system status and memory quality metrics. - Implemented real-time data fetching in the dashboard for system health and memory quality. - Introduced new UI components for displaying system health and memory quality analysis.
- Refactored health check logic by removing the unused check_vector_store function, streamlining the dependency status checks.
- Updated API methods to include optional time range filtering for memory statistics and quality metrics. - Modified dashboard to support time range selection, allowing users to filter data by last 7, 30, or 90 days, or all time. - Added new UI components for time range selection and improved loading states with skeletons. - Updated dependencies in package.json for new UI components.
- Introduced new RERANKER_* environment variables for improved configuration management across rerank providers. - Updated .env.example to include new rerank settings and reorganized sections for clarity. - Refactored rerank integration files to utilize the new base configuration structure, ensuring consistency in API key and base URL handling. - Updated error messages in rerank classes to reflect the new environment variable naming convention.
…dashboard. - Updated various components to utilize translation functions for navigation, memory quality metrics, system health, and user management. - Added new entries to the package.json and pnpm-lock.yaml for i18next and related libraries.
- Introduced a LanguageSwitcher component for selecting between English and Simplified Chinese. - Configured i18next for internationalization, including language detection and fallback settings. - Added English and Chinese translation files for various dashboard components and features.
- Removed the Users route and associated components from the dashboard. - Updated the sidebar navigation to exclude the Users section. - Cleaned up related translation entries in English and Chinese JSON files. - Adjusted API calls to eliminate user-related functionality.
- Added a new `count_all` method in the Memory class to count memories with optional filters. - Implemented `count_all_memories` in the StorageAdapter to support counting memories based on user, agent, and run IDs. - Updated the OceanBase, PGVector, and SQLite vector stores to include a `count` method for counting memories with filters. - Modified the MemoryService to include a `count_memories` method for retrieving the total count of memories. - Enhanced the `list_memories` API endpoint to return the actual total count of memories instead of the length of the response. - Improved the MemoriesPage component in the dashboard to support search functionality with a new input field and filter button.
- Implemented a new UserProfilePage component for displaying user profiles. - Added functionality to filter profiles by user ID and paginate results. - Integrated internationalization support for user interface text. - Included error handling and loading states for improved user experience.
- Refactored Memory interface to use string types for IDs. - Enhanced delete and bulk delete methods to accept string IDs. - Updated API endpoints to handle string memory IDs and ensure proper type conversion. - Added computed fields in response models to prevent JavaScript precision loss for large IDs.
# Conflicts: # src/powermem/storage/adapter.py
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
add Dashboard