Upload README.md
Browse files
README.md
CHANGED
@@ -20,17 +20,17 @@ License
|
|
20 |
|
21 |
ANEMLL is licensed under the MIT License.
|
22 |
https://opensource.org/license/mit
|
23 |
-
The model is based on Meta’s LLaMA 3.
|
24 |
|
25 |
|
26 |
|
27 |
-
This test model is exclusively for the
|
28 |
released before the official launch of the ANEMLL repository and minimal documentation.
|
29 |
It is intended for early adopters only who requested an early release.
|
30 |
|
31 |
|
32 |
Requirements
|
33 |
-
|
34 |
• CoreML Tools and HuggingFace Transformers libraries
|
35 |
• Python 3.9
|
36 |
|
@@ -47,7 +47,7 @@ python chat.py
|
|
47 |
Ctr-D to exit, Ctr-C to interrupt inference.
|
48 |
|
49 |
alternative way to run:
|
50 |
-
python chat.py
|
51 |
|
52 |
The first time the model loads, macOS will take some time to place it on the device.
|
53 |
Subsequent loads will be instantaneous.
|
|
|
20 |
|
21 |
ANEMLL is licensed under the MIT License.
|
22 |
https://opensource.org/license/mit
|
23 |
+
The model is based on Meta’s LLaMA 3.1 8B architecture and may require a separate license.
|
24 |
|
25 |
|
26 |
|
27 |
+
This test model is exclusively for the DeepSeek R1 8B model converted for CoreML,
|
28 |
released before the official launch of the ANEMLL repository and minimal documentation.
|
29 |
It is intended for early adopters only who requested an early release.
|
30 |
|
31 |
|
32 |
Requirements
|
33 |
+
• macOS Sequoia with Apple Neural Engine and 16GB RAM
|
34 |
• CoreML Tools and HuggingFace Transformers libraries
|
35 |
• Python 3.9
|
36 |
|
|
|
47 |
Ctr-D to exit, Ctr-C to interrupt inference.
|
48 |
|
49 |
alternative way to run:
|
50 |
+
python chat.py Q123 -d /path/to/anemll-DeepSeek-8B-ctx1024 ctx=1024
|
51 |
|
52 |
The first time the model loads, macOS will take some time to place it on the device.
|
53 |
Subsequent loads will be instantaneous.
|