JamesHujy commited on
Commit
93beeec
·
1 Parent(s): 4d553c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -63
README.md CHANGED
@@ -27,69 +27,6 @@ language:
27
 
28
  Similar to `VisCPM-Chat`, we found that due to the bilingual capability of `CPM-Bee`, `VisCPM-Paint` can achieve good Chinese text-to-image generation by training only on English text-image pairs, surpassing the performance of Chinese open-source models. By incorporating an additional 20M cleaned native Chinese text-image pairs and 120M translated text-image pairs in Chinese, the model's Chinese text-to-image generation ability can be further improved. We sample 30,000 images from the standard image generation test set MSCOCO and calculated commonly used evaluation metrics FID (Fréchet Inception Distance) to assess the quality of generated images. Similarly, we provide two versions of the model, namely `VisCPM-Paint-balance` and `VisCPM-Paint-zhplus`. The former has a balanced ability in both English and Chinese, while the latter emphasizes Chinese proficiency. `VisCPM-Paint-balance` is trained only using English text-image pairs, while `VisCPM-Paint-zhplus` incorporates an additional 20M native Chinese text-image pairs and 120M translated text-image pairs in Chinese based on `VisCPM-Paint-balance`.
29
 
30
- <table align="center">
31
- <tr>
32
- <td align="center" rowspan="2">模型</td>
33
- <td align="center" colspan="2">Zero-shot FID↓</td>
34
- </tr>
35
- <tr>
36
- <td align="center">英文</td>
37
- <td align="center">中文</td>
38
- </tr>
39
- <tr>
40
- <td align="center">GLIDE</td>
41
- <td align="center">12.2</td>
42
- <td align="center">-</td>
43
- </tr>
44
- <tr>
45
- <td align="center">Make-A-Scene</td>
46
- <td align="center">11.8</td>
47
- <td align="center">-</td>
48
- </tr>
49
- <tr>
50
- <td align="center">DALL·E-2</td>
51
- <td align="center">10.4</td>
52
- <td align="center">-</td>
53
- </tr>
54
- <tr>
55
- <td align="center">Unidiffuser</td>
56
- <td align="center">9.7</td>
57
- <td align="center">-</td>
58
- </tr>
59
- <tr>
60
- <td align="center">Cogview2</td>
61
- <td align="center">-</td>
62
- <td align="center">24.0</td>
63
- </tr>
64
- <tr>
65
- <td align="center">Stable Diffusion</td>
66
- <td align="center"><b><span style="color:#c00000;">8.6</span></b></td>
67
- <td align="center">-</td>
68
- </tr>
69
- <tr>
70
- <td align="center">AltDiffusion</td>
71
- <td align="center">17.2</td>
72
- <td align="center">16.1</td>
73
- </tr>
74
- <tr>
75
- <td align="center">TaiyiDiffusion</td>
76
- <td align="center">-</td>
77
- <td align="center">15.6</td>
78
- </tr>
79
- <tr>
80
- <td align="center">VisCPM-Paint-balance</td>
81
- <td align="center">9.5</td>
82
- <td align="center">10.9</td>
83
- </tr>
84
- <tr>
85
- <td align="center">VisCPM-Paint-zhplus</td>
86
- <td align="center">9.9</td>
87
- <td align="center"><b><span style="color:#c00000;">9.6</span></b></td>
88
- </tr>
89
- </table>
90
-
91
-
92
-
93
  ## 📝 License
94
 
95
  VisCPM is governed by the [GML License](https://github.com/OpenBMB/General-Model-License/blob/main/%E9%80%9A%E7%94%A8%E6%A8%A1%E5%9E%8B%E8%AE%B8%E5%8F%AF%E5%8D%8F%E8%AE%AE-%E6%9D%A5%E6%BA%90%E8%AF%B4%E6%98%8E-%E5%AE%A3%E4%BC%A0%E9%99%90%E5%88%B6-%E9%9D%9E%E5%95%86%E4%B8%9A%E5%8C%96.md), and permits individual and research usages. If you intend to utilize the model for commercial purposes, please reach out to [email protected] to negotiate commercial licensing.
 
27
 
28
  Similar to `VisCPM-Chat`, we found that due to the bilingual capability of `CPM-Bee`, `VisCPM-Paint` can achieve good Chinese text-to-image generation by training only on English text-image pairs, surpassing the performance of Chinese open-source models. By incorporating an additional 20M cleaned native Chinese text-image pairs and 120M translated text-image pairs in Chinese, the model's Chinese text-to-image generation ability can be further improved. We sample 30,000 images from the standard image generation test set MSCOCO and calculated commonly used evaluation metrics FID (Fréchet Inception Distance) to assess the quality of generated images. Similarly, we provide two versions of the model, namely `VisCPM-Paint-balance` and `VisCPM-Paint-zhplus`. The former has a balanced ability in both English and Chinese, while the latter emphasizes Chinese proficiency. `VisCPM-Paint-balance` is trained only using English text-image pairs, while `VisCPM-Paint-zhplus` incorporates an additional 20M native Chinese text-image pairs and 120M translated text-image pairs in Chinese based on `VisCPM-Paint-balance`.
29
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ## 📝 License
31
 
32
  VisCPM is governed by the [GML License](https://github.com/OpenBMB/General-Model-License/blob/main/%E9%80%9A%E7%94%A8%E6%A8%A1%E5%9E%8B%E8%AE%B8%E5%8F%AF%E5%8D%8F%E8%AE%AE-%E6%9D%A5%E6%BA%90%E8%AF%B4%E6%98%8E-%E5%AE%A3%E4%BC%A0%E9%99%90%E5%88%B6-%E9%9D%9E%E5%95%86%E4%B8%9A%E5%8C%96.md), and permits individual and research usages. If you intend to utilize the model for commercial purposes, please reach out to [email protected] to negotiate commercial licensing.