Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Support for Multiple Model Integrations #4

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

AdonaiVera
Copy link

This PR introduces the integration of multiple LLMs to enhance flexibility and adaptability:

  • Anthropic: Fully integrated and works seamlessly for generation. However, it currently lacks an embedding algorithm. To address this, OpenAI embeddings are being used as a workaround.
  • GPT4All: Integrated and running successfully locally. While it's slower compared to cloud-based models, it offers great flexibility for devices with varying computational power.

Future Improvements:

  • Plan to add support for Hugging Face embeddings to improve versatility and reduce reliance on specific APIs.

Key Features:

  • Multi-model support for generation and embeddings.
  • Adaptable to different computational capacities.
  • Clear structure for integrating new model options in the future.

Let me know your feedback, suggestions, or any potential improvements! 🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant