Lookup LLM generations in cache by prompt and associated LLM key.
The prompt to lookup.
The LLM key to lookup.
The generations associated with the prompt and LLM key, or null if not found.
Update the cache with the given generations.
Note this overwrites any existing generations for the given prompt and LLM key.
The prompt to update.
The LLM key to update.
The generations to store.
Static
fromCreate a new standard cache backed by Momento.
The settings to instantiate the cache.
The Momento-backed cache.
InvalidArgumentError if props.ttlSeconds is not strictly positive.
Generated using TypeDoc
A cache that uses Momento as the backing store. See https://gomomento.com.
Example