open-thoughts/OpenThoughts-114k
Viewer
•
Updated
•
114k
•
14.2k
•
229
Choi Jaehun
Ash-Hun
AI & ML interests
LLM, RAG, Agent, GenAI, Modeling for RAG
Recent Activity
liked
a dataset
5 days ago
open-thoughts/OpenThoughts-114k
liked
a Space
23 days ago
maum-ai/KOFFVQA-Leaderboard
reacted
to
singhsidhukuldeep's
post
with 🔥
3 months ago
Exciting breakthrough in LLM reasoning: Introducing "Thread of Thought" (ThoT) - a novel prompting strategy that revolutionizes how language models handle chaotic contexts!
Unlike traditional approaches that struggle with complex, interleaved information, ThoT enables LLMs to methodically segment and analyze extended contexts with remarkable precision. Here's how it works:
Technical Deep Dive:
- ThoT employs a two-step prompting mechanism:
1. Initial Analysis: Uses a template combining chaotic context (X) and query (Q) with a trigger sentence that initiates systematic reasoning.
2. Conclusion Refinement: Leverages the organized thought sequence to extract definitive answers.
Implementation Details:
- Seamlessly integrates as a "plug-and-play" module with existing LLMs.
- Requires no model retraining or fine-tuning.
- Works with various prompting techniques and model architectures.
Performance Highlights:
- Outperformed traditional methods on PopQA and EntityQ datasets.
- Achieved 57.4% accuracy with GPT-3.5-turbo (vs. 48.2% for Chain-of-Thought).
- Demonstrated superior performance across model scales, from 7B to 70B parameters.
Key Applications:
- Retrieval-augmented generation.
- Multi-turn conversation responses.
- Complex reasoning tasks requiring information synthesis.
What makes it special: ThoT mirrors human cognitive processes by breaking down complex information into manageable segments while maintaining logical continuity – a game-changer for handling information-dense contexts.
Organizations
Ash-Hun's activity
liked
a
dataset
5 days ago
liked
a
Space
23 days ago
liked
2
datasets
4 months ago
liked
a
dataset
10 months ago
liked
2
models
11 months ago
liked
3
models
12 months ago
liked
a
model
about 1 year ago
