LMRunnerService

esc.ai.LMRunnerService
object LMRunnerService extends LMRunner

Management service for the LLM runner instances. Use this service to change the LLM runner if needed. The AiAgent object uses this service for LLM inference calls.

Attributes

Graph
Supertypes
trait LMRunner
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

override def aiConfig: AiConfig

Attributes

Definition Classes
override def changeAiConfig(newAiConfig: AiConfig): Unit

Attributes

Definition Classes
override def loadModel(path: String): Unit

Attributes

Definition Classes
override def prompt(prompt: String, maxTokens: Option[Int] = ...): String

Attributes

Definition Classes
def setLMRunner(newLMRunner: LMRunner): Unit