Documentation
  • Installation
  • Support
  • AnyAssistant Builder
    • Basics
    • Node Inspector
    • Functions & Skills
    • Working with Skills
    • Memory
    • Planning
    • Nodes
      • Control
        • User Input
        • Show User
        • Get Variable
        • Set Variable
        • Start
      • Invoke
        • Invoke Chat LLM
        • Invoke LLM With Planner
        • Invoke Planner
        • Invoke Native Function
        • Invoke Semantic Function
      • Model
        • ChatGPT
        • OpenAI Text
        • OpenAI Embedding
        • Hugging Face Embedding
        • Hugging Face Text
        • Load GGML Model
      • Memory
        • Simple Chat Memory
        • Contextual Chat Memory
      • Planner
        • Action Planner
        • Sequential Planner
      • Skills
        • Load Assistant Skills
        • Load Native Skills (C#)
        • Load Native Skills (Python)
        • Load Semantic Skills
      • OCR
        • Tesseract OCR
      • Data Source
        • Load CSV
        • Load PDF Files
        • Read Text File
        • Map Data Source
      • Vector Store
        • Postgres
        • Qdrant
        • Get Similar Vectors
        • Update Vector Store
Powered by GitBook
On this page
  • Inputs
  • Outputs

Was this helpful?

  1. AnyAssistant Builder
  2. Nodes
  3. Model

Load GGML Model

Loads a text completion model in GGML format.

PreviousHugging Face TextNextMemory

Last updated 1 year ago

Was this helpful?

This node loads a model in GGML format, mostyl loading the LLaMA model variants. It uses and supports all models supported by llama.cpp. Some of the supported models are listed here.

Inputs

Model Path

The path to the model.

Outputs

Language Model

The configured text completion model.

llama.cpp