Update README.md

README.md

@@ -141,6 +141,7 @@ Llama-3-Tokenizer를 한국어 특화하기 위해 한국어 토큰 17,536개를
 </table>
 
 #### Tokenizer Result
++ Ko
 <table>
 	<tr>
 		<td><strong>입력</strong>
@@ -192,6 +193,34 @@ Llama-3-Tokenizer를 한국어 특화하기 위해 한국어 토큰 17,536개를
 	</tr>
 </table>
 
++ En
+<table>
+	<tr>
+		<td><strong>입력</strong>
+		</td>
+		<td><strong>Llama-3</strong>
+		</td>
+		<td><strong>Llama-3-Luxia-Ko</strong>
+		</td>
+	</tr>
+	<tr>
+		 <td>Korean cuisine, hanguk yori, or hansik, has evolved through centuries of social and political change.
+		 </td>
+		 <td>['K', 'orean', ' cuisine', ',', ' h', 'angu', 'k', ' y', 'ori', ',', ' or', ' hans', 'ik', ',', ' has', ' evolved', ' through', ' centuries', ' of', ' social', ' and', ' political', ' change', '.']
+		 </td>
+		 <td>['K', 'orean', ' cuisine', ',', ' h', 'angu', 'k', ' y', 'ori', ',', ' or', ' hans', 'ik', ',', ' has', ' evolved', ' through', ' centuries', ' of', ' social', ' and', ' political', ' change', '.']
+		 </td>
+	</tr>
+		<tr>
+		 <td>Son Heung-min is a South Korean professional footballer who plays as a forward for and captains both Premier League club Tottenham Hotspur and the South Korea national team.
+		 </td>
+		 <td>['Son', ' He', 'ung', '-min', ' is', ' a', ' South', ' Korean', ' professional', ' football', 'er', ' who', ' plays', ' as', ' a', ' forward', ' for', ' and', ' captains', ' both', ' Premier', ' League', ' club', ' Tottenham', ' Hot', 'sp', 'ur', ' and', ' the', ' South', ' Korea', ' national', ' team', '.']
+		 </td>
+		 <td>['Son', ' He', 'ung', '-min', ' is', ' a', ' South', ' Korean', ' professional', ' football', 'er', ' who', ' plays', ' as', ' a', ' forward', ' for', ' and', ' captains', ' both', ' Premier', ' League', ' club', ' Tottenham', ' Hot', 'sp', 'ur', ' and', ' the', ' South', ' Korea', ' national', ' team', '.']
+		 </td>
+	</tr>
+</table>
+
 ### Citation instructions
 **Llama-3-Luxia-Ko**
 ```