ibm-granite
/

granite-3.0-8b-base

Text Generation

Model card Files Files and versions Community

amezasor commited on Oct 22, 2024

Commit

23357b6

·

verified ·

1 Parent(s): 2b8d90a

typo fix

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -271,7 +271,7 @@ Granite-3.0-8B-Base is based on a decoder-only dense transformer architecture. C
 | Initialization std        | 0.1      | **0.1**      | 0.1    | 0.1    |
 | Sequence Length           | 4096     | **4096**     | 4096   | 4096   |
 | Position Embedding        | RoPE     | **RoPE**     | RoPE   | RoPE   |
-| # Paremeters              | 2.5B     | **8.1B**     | 1.3B   | 3.3B   |
 | # Active Parameters       | 2.5B     | **8.1B**     | 400M   | 800M   |
 | # Training tokens         | 12T      | **12T**      | 10T    | 10T    |

 | Initialization std        | 0.1      | **0.1**      | 0.1    | 0.1    |
 | Sequence Length           | 4096     | **4096**     | 4096   | 4096   |
 | Position Embedding        | RoPE     | **RoPE**     | RoPE   | RoPE   |
+| # Parameters              | 2.5B     | **8.1B**     | 1.3B   | 3.3B   |
 | # Active Parameters       | 2.5B     | **8.1B**     | 400M   | 800M   |
 | # Training tokens         | 12T      | **12T**      | 10T    | 10T    |