prometheus-eval/outcome_meta_evaluation
Viewer
•
Updated
•
18.1k
•
48
•
2
Junyeong Song
junyeong-nero
AI & ML interests
None yet
Recent Activity
liked
a dataset
about 12 hours ago
prometheus-eval/outcome_meta_evaluation
upvoted
a
paper
about 23 hours ago
Do generative video models learn physical principles from watching
videos?
liked
a model
about 23 hours ago
aaditya/Llama3-OpenBioLLM-8B
Organizations
None yet
junyeong-nero's activity
liked
a
dataset
about 12 hours ago
upvoted
a
paper
about 23 hours ago
liked
a
model
about 23 hours ago
liked
a
model
2 days ago
liked
2
datasets
2 days ago
liked
a
model
3 days ago
liked
2
datasets
4 days ago
upvoted
a
paper
5 days ago
liked
a
model
5 days ago
liked
a
dataset
6 days ago
liked
a
dataset
7 days ago
reacted to
MoritzLaurer's
post with ❤️
7 days ago
Post
2933
FACTS is a great paper from
@GoogleDeepMind
on measuring the factuality of LLM outputs. You can now download their prompt templates from
@huggingface
to improve LLM-based fact-checking yourself!
📏 The paper introduces the FACTS Grounding benchmark for evaluating the factuality of LLM outputs.
🤖 Fact-checking is automated by an ensemble of LLM judges that verify if a response is fully grounded in a factual reference document.
🧪 The authors tested different prompt templates on held-out data to ensure their generalization.
📚 It's highly educational to read these templates to learn how frontier labs design prompts and understand their limitations.
💾 You can now download and reuse these prompt templates via the prompt-templates library!
🔄 The library simplifies sharing prompt templates on the HF hub or locally via standardized YAML files. Let’s make LLM work more transparent and reproducible by sharing more templates like this!
Links 👇
- prompt-templates docs: https://moritzlaurer.github.io/prompt_templates/
- all templates on the HF Hub: MoritzLaurer/facts-grounding-prompts
- FACTS paper: https://storage.googleapis.com/deepmind-media/FACTS/FACTS_grounding_paper.pdf
📏 The paper introduces the FACTS Grounding benchmark for evaluating the factuality of LLM outputs.
🤖 Fact-checking is automated by an ensemble of LLM judges that verify if a response is fully grounded in a factual reference document.
🧪 The authors tested different prompt templates on held-out data to ensure their generalization.
📚 It's highly educational to read these templates to learn how frontier labs design prompts and understand their limitations.
💾 You can now download and reuse these prompt templates via the prompt-templates library!
🔄 The library simplifies sharing prompt templates on the HF hub or locally via standardized YAML files. Let’s make LLM work more transparent and reproducible by sharing more templates like this!
Links 👇
- prompt-templates docs: https://moritzlaurer.github.io/prompt_templates/
- all templates on the HF Hub: MoritzLaurer/facts-grounding-prompts
- FACTS paper: https://storage.googleapis.com/deepmind-media/FACTS/FACTS_grounding_paper.pdf
liked
4
datasets
7 days ago
liked
a
model
8 days ago
liked
a
model
9 days ago
