Updated API Support #525
Open
Updated API Support #525
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Edited 3 rows in aiserver.py, the first to add the menu item, second in order to not request gpu/cpu and third for the ModelSelectionSchema class. * The openrouter_handler takes care of generations, with features such as: - Messy code - Some remaining TODOs - Core story generation, including support for story & simple chat - Some simple stoppers - Parallelized api calls for getting batched generations - and some comments The code *should not* affect anything outside its scope, but should *definitely* be glanced at by someone more experienced than me.
This was a WIP file that never should have been added in the first place.
Slightly reworked get_requested_parameters in order to let key from parameters overwrite saved key.
…ed almost all OpenRouter specific bits into the proper class.py After doing that, added support for Mancer as well, which went shockingly fast and very smoothly. TODO: Some settings that are still in api_handler should probably be moved to their respective class.py files. Note: Mancer does not appreciate batch calls and sends a 400-method not allowed reply. May be allowed as a paying customer. * Further testing is required. Something of a proof-of-concept that this can work as a general, modernised API backend.
…fied. * Slight changes in mancer/class.py & openrouter/class.py to accomodate this. * Moved the gooseAI API over to the new handler.
* Removed references to API-specific settings such as frequency & presence penalties. * Moved handling of settings file read/write to newly added read/write functions * Reworked get_requested_parameters (henceforth grp) to only open the settings file once & make it more easily readable * Removed unused packages. In openrouter/class.py * Removed unused packages * Added handling of frequency and presence penalties in grp In mancer/class.py * Removed unused packages * Added handling of frequency and presence penalties in grp In gooseai/class.py * Removed unused packages * Added handling of presence penalties in grp
…ies. Removed loading of specific settings in models.
self.key=timeout -> self.timeout=timeout
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Previous PR was closed due to restructuring of the fork, essentially just separating my dev branch from the united branch as the current version is "stable".
Main features:
Currently supported providers:
Will continue sporadic work on additional features in my /dev branch, but the PR should be considered complete.