EntitySimilarityChecker
API
Generated with
EntitySimilarityChecker/esc/esc.ai/LocalLMRunner

LocalLMRunner

esc.ai.LocalLMRunner
object LocalLMRunner extends LMRunner

Default local LMRunner. Need a llama.cpp compatible LLM model like GGUF.

Attributes

Graph
Supertypes
trait LMRunner
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

override def aiConfig: AiConfig

Attributes

Definition Classes
override def changeAiConfig(newAiConfig: AiConfig): Unit

Set a new AiConfig to the object. Automatically reload the model if the model is already loaded and the model path ist still set.

Set a new AiConfig to the object. Automatically reload the model if the model is already loaded and the model path ist still set.

Attributes

Definition Classes
override def loadModel(path: String): Unit

Load the model by the given path. Remarks: Only llama-cpp formats are supported. Most likely models in the GGUF format.

Load the model by the given path. Remarks: Only llama-cpp formats are supported. Most likely models in the GGUF format.

Attributes

Definition Classes
override def prompt(prompt: String, maxTokens: Option[Int] = ...): String

Execute the given text prompt with the LLM model.

Execute the given text prompt with the LLM model.

Value parameters

maxTokens

Default is None and the value from the AiConfig is used.

Attributes

Definition Classes
Generated with