Compare model versions

Diff

Before

Not present in the earlier snapshot.

After

> [!NOTE]
> Native `spark2_5` support requires [llama.cpp](https://github.com/ggml-org/llama.cpp/) `b10828` or later.

Run the model in the CLI:
```bash
llama cli -m /path/to/Spark-X2.5-1.7B-GGUF
```

Launch the OpenAI-compatible API server:
```bash
llama serve -m /path/to/Spark-X2.5-1.7B-GGUF
```

Diff

Before

Heading only; no text in this section.

After

[Download Ollama](https://ollama.com/download)

> [!NOTE]
> Native `spark2_5` support requires Ollama [`v0.34.1`](https://github.com/ollama/ollama/releases) or later.

```bash
ollama run SparkLLM/Spark-X2.5-1.7B
```

Diff

Before

Heading only; no text in this section.

After

[Download LM Studio](https://lmstudio.ai/download)

> [!NOTE]
> Native `spark2_5` support requires runtime version `2.34.0` or later.

Diff

Before

Not present in the earlier snapshot.

After

[Download Unsloth Studio](https://unsloth.ai/)

> [!NOTE]
> The latest Unsloth Studio supports native Spark-X2.5 GGUF inference.

Diff

Before

```bash
git clone https://github.com/XHToken/llama.cpp.git llama.cpp-spark
git clone https://github.com/ollama/ollama.git ollama-spark
cd ollama-spark
export OLLAMA_LLAMA_CPP_SOURCE="$(cd ../llama.cpp-spark && pwd)"
cmake -S . -B build
cmake --build build --parallel 8
```

After

Not present in the later snapshot.

Diff

Before

Create the model definition, then start the Ollama server in one terminal:

```bash
printf 'FROM /absolute/path/to/your.gguf\n' > ./Modelfile.spark
./ollama serve
```

Create and run the model from another terminal:

```bash
./ollama create Spark-X2.5-1.7B -f ./Modelfile.spark
./ollama run Spark-X2.5-1.7B
```

After

Not present in the later snapshot.

Diff

Before

```bash
git clone https://github.com/XHToken/llama.cpp.git llama.cpp-spark
cd llama.cpp-spark
cmake -S . -B build
cmake --build build --parallel 8
```

After

Not present in the later snapshot.

Diff

Before

1. Close LM Studio.

2. Back up the selected runtime directory:

   ```text
   <LM_STUDIO_HOME>/extensions/backends/<selected-runtime>/
   ```

3. Copy the `llama.cpp-spark` build output into the selected runtime directory, overwriting the existing files.

4. Place the GGUF model in the following directory:

   ```text
   <LM_STUDIO_HOME>/models/<org>/<name>/
   ```

Example runtime directory on macOS:

```text
./build/bin/* -> ~/.lmstudio/extensions/backends/llama.cpp-mac-arm64-apple-metal-advsimd-<version>/
```

After

Not present in the later snapshot.

Diff

Before

Open My Models, select the Spark-X2.5 model, click Load, then start a new Chat.

After

Not present in the later snapshot.

Diff

Before

```bash
# Replace <model> with a model listed by lms ls.
lms load <model>
lms chat <model>
```

After

Not present in the later snapshot.