3 Commits

Author	SHA1	Message	Date
geoffsee	9e8b427826	Add scripts and documentation for local inference configuration with Ollama and mlx-omni-server ... - Introduced `configure_local_inference.sh` to automatically set `.dev.vars` based on active local inference services. - Updated `start_inference_server.sh` to handle both Ollama and mlx-omni-server server types. - Enhanced `package.json` to include new commands for starting and configuring inference servers. - Refined README to include updated instructions for running and adding models for local inference. - Minor cleanup in `MessageBubble.tsx`.	2025-06-02 12:50:22 -04:00
geoffsee	9e6ef975a9	saves a message	2025-05-31 18:48:55 -04:00
geoffsee	cc0da17b5f	- Add killport.js script for terminating processes on specific ports ... - Introduce `supportedModels` in `ClientChatStore` and update model validation logic - Enhance OpenAI inferencing with local setup adaptations and improved streaming options - Modify ChatService to handle local and remote model fetching - Update input menu to dynamically fetch and display supported models - Add start_inference_server.sh for initiating local inference server - Upgrade OpenAI SDK to v5.0.1 and adjust dependencies accordingly	2025-05-29 20:17:34 -04:00