Load GGML Model

Loads a text completion model in GGML format.

This node loads a model in GGML format, mostyl loading the LLaMA model variants. It uses llama.cpp and supports all models supported by llama.cpp. Some of the supported models are listed here.

Inputs

Model Path

The path to the model.

Outputs

Language Model

The configured text completion model.