---
base_model: unsloth/qwen2.5-coder-32b-instruct-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- gguf
license: apache-2.0
language:
- en
datasets:
- xingyaoww/opendevin-code-act
---
### Summary

The model `userxxx/openhands-qwen-coder-32b` is a fine-tuned version of `qwen2.5-coder-32b`, specifically tailored for the Swe Agent OpenHands. It delivers impressive performance, sometimes nearly rivaling that of Sonnet 3.5. However, certain limitations persist, particularly with function calling for IPython/Jupyter commands like `INSERT` and `STR_REPLACE`, which currently do not work. Aside from these issues, the model performs effectively in most other tasks.

### Recommended Usage

To achieve optimal results, it is recommended to use this model via **LM Studio**.

#### Steps to Set Up LM Studio:
1. Open LM Studio.  
2. Go to the **Local Server** tab.  
3. Click the **"Start Server"** button.  
4. Copy qwencoder32openhands-beta-q4-k-m.gguf inside the LmStudio Model Folder and than select it.
5. **Ensure the context window exceeds 4000 tokens**

### OpenHands Settings

For WSL, run the following commands to set up the networking mode to mirrored:  

```bash
python -c  "print('[wsl2]\nnetworkingMode=mirrored',file=open(r'%UserProfile%\.wslconfig','w'))"
wsl --shutdown
```

Setting inside Openhands

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6418814c4939d72681833490/uu-uKG57rhWqbEZsZ97ha.png)

openai/lmstudio
http://host.docker.internal:1234/v1