---
license: apache-2.0
datasets:
- Sweaterdog/Andy-3.5
language:
- en
base_model:
- deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
tags:
- Minecraft
---

# Welcome to a new generation of Minecraft
## Andy 3.5 is a collection of LOCAL LLM's designed for playing Minecraft
Andy 3.5 is designed to be used with MindCraft

### How to Install

1. Select the model you would like to use *(Larger is better)*
2. Download a Modelfile *(One is directly for the tuned model, while the other is for the base model)
3. Once downloaded, open Modelfile in a text editor, and change the path to the download location of the gguf file
4. When changed, save the file, and open command terminal
5. *(Optional if CMD is opened via file explorer)* Navigate to the correct directory using "cd"
6. Run the command ollama create Andy-3.5 -f Modelfile
7. Go to a profile in MindCraft
8. Change the model to be Andy-3.5
9. Enjoy playing with an AI


## How was model trained?

The model was trained on a dataset of ~10,000 messages coming directly from MindCraft, ensuring quality data

## What are capabilities and Limitations?

The smaller model *(The preview ones at least)* had 1/3 of the parameters tuned, the larger preview model has not been released yet.
Andy-3.5 was trained on EVERYTHING regarding Minecraft and MindCraft, it knows how to use commands natively without a system prompt.
Andy-3.5 also knows how to build / use !newAction to perform commands, it was trained on lots of building, as well as, using !newAction to do tasks like manually making something or strip mining.

****Know this is a PREVIEW model, it is NOT finished!****

## Why a preview model?

Andy-3.5-preview was made to test the intelligence of a Minecraft Ai with the current dataset, it was meant to see the progress of the training and what area's are needed for the future
DO NOT expect this model to be able to do everything perfectly, it only knows as much as the dataset told it, as well as the other 2/3 of the untouched parameters allow.
The model *may* experience bugs, such as not saying your name, getting previous messages confused, or other small things.

## Important notes and considerations

The preview model of Andy-3.5-mini *(Andy-3.5-mini-preview)* was trained on a context length of 4096, this was meant to speed up training and VRAM usage.

The Base model of Andy-3.5-mini-preview was a distilled version of Deepseek-R1, which was a tuned model of Qwen-2.5-1.5b

Since a context window of 4096 is not nearly enough for MindCraft, you can go higher, Qwen-2.5-1.5b was trained on a context length of 64,000, the distilled version of Deepseek-R1 was trained on a length of 128,000, the usable length may be closer to 32,000 tokens for Andy-3.5-mini-preview


When the full versions of Andy-3.5 and Andy-3.5-preview release, they will both be trained on a context length of 128,000 to ensure proper usage during playing.