Post
2818
She arrived 😍
[Expect more models soon...]
[Expect more models soon...]
- 1 reply
Universal NER
community
AI & ML interests
Building a Gold Standard Multilingual NER dataset.
Recent Activity
View all activity
universalner's activity
ljvmiranda921
authored
2
papers
about 2 months ago
Post
1539
My latest project is the outcome of the last 2+ years working with TPUs from the amazing TPU Research Cloud (TRC) program and training Encoder-only LMs with the TensorFlow Model Garden library.
👉 Link: https://github.com/stefan-it/model-garden-lms
An overview of some features:
- Cheatsheet for setting-up a TPU VM Pod (with all necessary dependencies) to pretrain LMs with TF Model Garden
- Conversion scripts that convert TF Model Garden weights to Hugging Face Transformers-compatible models
- Supported architectures include BERT, BERT with Token Dropping and TEAMS
I also released BERT-based models pretrained on the great Hugging Face FineWeb and FineWeb-Edu datasets (10BT subset). With more to come!
👉 Model Hub Link: https://huggingface.co/model-garden-lms
If you find these resources useful, please give them a like!
Made from Bavarian Oberland with ❤️ and 🥨.
👉 Link: https://github.com/stefan-it/model-garden-lms
An overview of some features:
- Cheatsheet for setting-up a TPU VM Pod (with all necessary dependencies) to pretrain LMs with TF Model Garden
- Conversion scripts that convert TF Model Garden weights to Hugging Face Transformers-compatible models
- Supported architectures include BERT, BERT with Token Dropping and TEAMS
I also released BERT-based models pretrained on the great Hugging Face FineWeb and FineWeb-Edu datasets (10BT subset). With more to come!
👉 Model Hub Link: https://huggingface.co/model-garden-lms
If you find these resources useful, please give them a like!
Made from Bavarian Oberland with ❤️ and 🥨.
ljvmiranda921
authored
a
paper
3 months ago
mrshu
updated
a
dataset
4 months ago
ljvmiranda921
authored
2
papers
4 months ago
tellarin
authored
a
paper
5 months ago
mayhewsw
updated
a
dataset
6 months ago
ljvmiranda921
authored
a
paper
7 months ago
sliu775
updated
a
model
8 months ago
ljvmiranda921
authored
a
paper
8 months ago
tellarin
authored
3
papers
8 months ago
GenDec: A robust generative Question-decomposition method for Multi-hop reasoning
Paper
•
2402.11166
•
Published
Towards General Computer Control: A Multimodal Agent for Red Dead Redemption II as a Case Study
Paper
•
2403.03186
•
Published
•
5
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages
Paper
•
2406.10118
•
Published
•
31
ljvmiranda921
authored
a
paper
11 months ago
tellarin
authored
a
paper
about 1 year ago
tellarin
updated
a
dataset
about 1 year ago