Update README.md
Browse files
README.md
CHANGED
@@ -8,11 +8,15 @@ language:
|
|
8 |
library_name: fasttext
|
9 |
pipeline_tag: text-classification
|
10 |
---
|
11 |
-
#
|
12 |
|
13 |
<!-- Provide a quick summary of what the model is/does. -->
|
14 |
|
15 |
-
This
|
|
|
|
|
|
|
|
|
16 |
|
17 |
## Model Details
|
18 |
|
@@ -22,47 +26,57 @@ This model card aims to be a base template for new models. It has been generated
|
|
22 |
|
23 |
|
24 |
|
25 |
-
- **Developed by:** [
|
26 |
- **Shared by [optional]:** [More Information Needed]
|
27 |
-
- **Model type:** [
|
28 |
-
- **Language(s) (NLP):** [
|
29 |
- **License:** [More Information Needed]
|
30 |
-
- **Finetuned from model [optional]:** [
|
31 |
|
32 |
-
### Model
|
33 |
|
34 |
<!-- Provide the basic links for the model. -->
|
35 |
|
36 |
-
- **Repository:** [
|
37 |
-
- **Paper [optional]:** [
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
- **Demo [optional]:** [More Information Needed]
|
39 |
|
40 |
## Uses
|
41 |
|
42 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
|
|
43 |
|
44 |
### Direct Use
|
45 |
|
46 |
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
|
|
47 |
|
48 |
[More Information Needed]
|
49 |
|
50 |
### Downstream Use [optional]
|
51 |
|
52 |
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
53 |
-
|
54 |
[More Information Needed]
|
55 |
|
56 |
### Out-of-Scope Use
|
57 |
|
58 |
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
59 |
-
|
60 |
[More Information Needed]
|
61 |
|
62 |
## Bias, Risks, and Limitations
|
63 |
|
64 |
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
65 |
-
|
66 |
[More Information Needed]
|
67 |
|
68 |
### Recommendations
|
|
|
8 |
library_name: fasttext
|
9 |
pipeline_tag: text-classification
|
10 |
---
|
11 |
+
# Open fasttext LangID models
|
12 |
|
13 |
<!-- Provide a quick summary of what the model is/does. -->
|
14 |
|
15 |
+
This repo makes readily available several fasttext based open langID models.
|
16 |
+
While the use and distribution of this collection itself is available according to Apache 2.0,
|
17 |
+
but individual models maybe under different more stringent licenses and end users MUST ensure the licenses before distribution or usage.
|
18 |
+
|
19 |
+
Quantized versions have been derived by the author [Chris Ha]([email protected])
|
20 |
|
21 |
## Model Details
|
22 |
|
|
|
26 |
|
27 |
|
28 |
|
29 |
+
- **Developed by:** [Individual Developers]
|
30 |
- **Shared by [optional]:** [More Information Needed]
|
31 |
+
- **Model type:** [Fasttext Classifier]
|
32 |
+
- **Language(s) (NLP):** [Multilingual]
|
33 |
- **License:** [More Information Needed]
|
34 |
+
- **Finetuned from model [optional]:** [Individual models]
|
35 |
|
36 |
+
### Model Source for OpenLID
|
37 |
|
38 |
<!-- Provide the basic links for the model. -->
|
39 |
|
40 |
+
- **Repository:** [An Open Dataset and Model for Language Identification](https://github.com/laurieburchell/open-lid-dataset)
|
41 |
+
- **Paper [optional]:** [An Open Dataset and Model for Language Identification](https://arxiv.org/abs/2305.13820)
|
42 |
+
- **Demo [optional]:** [More Information Needed]
|
43 |
+
|
44 |
+
### Model Source for NLLB langID(lid218e)
|
45 |
+
|
46 |
+
<!-- Provide the basic links for the model. -->
|
47 |
+
|
48 |
+
- **Repository:** [fastText (Language Identification)](https://huggingface.co/facebook/fasttext-language-identification)
|
49 |
+
- **Paper [optional]:** [No Language Left Behind: Scaling Human-Centered Machine Translation](https://arxiv.org/abs/2207.04672)
|
50 |
- **Demo [optional]:** [More Information Needed]
|
51 |
|
52 |
## Uses
|
53 |
|
54 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
55 |
+
Language Classification
|
56 |
|
57 |
### Direct Use
|
58 |
|
59 |
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
60 |
+
Language Classification
|
61 |
|
62 |
[More Information Needed]
|
63 |
|
64 |
### Downstream Use [optional]
|
65 |
|
66 |
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
67 |
+
Refer to details of each model
|
68 |
[More Information Needed]
|
69 |
|
70 |
### Out-of-Scope Use
|
71 |
|
72 |
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
73 |
+
Refer to details of each model
|
74 |
[More Information Needed]
|
75 |
|
76 |
## Bias, Risks, and Limitations
|
77 |
|
78 |
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
79 |
+
Refer to details of each model
|
80 |
[More Information Needed]
|
81 |
|
82 |
### Recommendations
|