Nick Brooks
nickandbro
AI & ML interests
None yet
Recent Activity
reacted
to
singhsidhukuldeep's
post
with ๐
9 days ago
Breaking News: LinkedIn's Content Search Engine Gets a Powerful Semantic Upgrade!
Excited to share insights about LinkedIn's innovative approach to content search, recently detailed in a groundbreaking paper by their Mountain View team. This advancement represents a significant shift from traditional keyword-based search to semantic understanding.
>> Technical Architecture
The new search engine employs a sophisticated two-layer architecture:
Retrieval Layer
- Token Based Retriever (TBR) for exact keyword matching
- Embedding Based Retriever (EBR) using a two-tower model with multilingual-e5 embeddings
- Pre-computed post embeddings stored in a dedicated embedding store for efficient retrieval
Multi-Stage Ranking
- L1 Stage: Initial filtering using a lightweight model
- L2 Stage: Advanced ranking with complex features including:
- Query-post semantic matching
- Author reputation analysis
- User engagement metrics
- Content freshness evaluation
>> Performance Improvements
The system has achieved remarkable results:
- 10%+ improvement in both on-topic rate and long-dwell metrics
- Enhanced ability to handle complex natural language queries
- Significant boost in sitewide engagement
This advancement enables LinkedIn to better serve complex queries like "how to ask for a raise?" while maintaining high performance at scale. The system intelligently balances between exact keyword matching and semantic understanding, ensuring optimal results for both navigational and conceptual searches.
What impresses me most is how the team solved the scale challenge - processing billions of posts efficiently using pre-computed embeddings and approximate nearest neighbor search. This is enterprise-scale AI at its finest.
liked
a model
18 days ago
ds4sd/docling-models
Organizations
nickandbro's activity
What is an actorder group and what are the advantages of running this in vLLM?
4
#1 opened 23 days ago
by
nickandbro
Compatible with vLLM?
#4 opened about 1 month ago
by
nickandbro
Will this work with vLLM?
4
#10 opened 2 months ago
by
nickandbro
Can you please add Nemotron 70B static?
3
#1 opened 3 months ago
by
nickandbro
Congrats to the Nvidia team!
#10 opened 3 months ago
by
nickandbro
vLLM compatible?
3
#10 opened 4 months ago
by
nickandbro
Does this work with vLLM?
#9 opened 4 months ago
by
nickandbro
Is this compatible with the KV_Cache_dtype being FP8?
2
#1 opened 6 months ago
by
nickandbro
Where can I find the code?
3
#832 opened 7 months ago
by
nickandbro
Where can I find the code?
3
#832 opened 7 months ago
by
nickandbro