Ladder-residual: parallelism-aware architecture for accelerating large model inference with communication overlapping
Paper
âą
2501.06589
âą
Published
AI & ML interests
Mixture of Experts, Branch Merge Train, International Cooperation, Reuse, https://github.com/ontocord/MDEL
Recent Activity
View all activity
Multi-Domain-Expert-Learning's activity
mayank-mishraÂ
authored
a
paper
1 day ago
sted97Â
authored
a
paper
1 day ago
huu-ontocordÂ
published
a
dataset
12 days ago
vumichienÂ
authored
a
paper
13 days ago
marzenaÂ
authored
a
paper
25 days ago
liangyuchÂ
authored
a
paper
about 1 month ago
Post
1537
Mini-QwQ an edge device friendly reasoning model distilled from QwQ-32B
đ€: kz919/QwQ-0.5B-Distilled-SFT
đŹ đŹ đș đ«: kz919/QwQ-0.5B-Distilled-SFT-gguf
đ€: kz919/Mini-QwQ
đ€: kz919/QwQ-0.5B-Distilled-SFT
đŹ đŹ đș đ«: kz919/QwQ-0.5B-Distilled-SFT-gguf
đ€: kz919/Mini-QwQ
sted97Â
authored
3
papers
2 months ago
What's the Meaning of Superhuman Performance in Today's NLU?
Paper
âą
2305.08414
âą
Published
âą
1
Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-OASIS
Paper
âą
2411.19655
âą
Published
âą
20
LLMs Lost in Translation: M-ALERT uncovers Cross-Linguistic Safety Gaps
Paper
âą
2412.15035
âą
Published
âą
4
mayank-mishraÂ
authored
a
paper
2 months ago
xu3kevÂ
authored
a
paper
3 months ago
Post
1778
Post
615
đ The Stanford Institute for Human-Centered AI (https://aiindex.stanford.edu/vibrancy/) has released its 2024 Global AI Vibrancy Tool, a way to explore and compare AI progress across 36 countries.
đ It measures progress across the 8 broad pillars of R&D, Responsible AI, Economy, Education, Diversity, Policy and Governance, Public Opinion and Infrastructure. (Each of these pillars have a number of Sub Indices)
đ As a whole it is not surprising that the USA was at the top in terms of overall score as of 2023 (AI investment activity is a large part of the economic pillar for example and that is a large part of the overall USA ranking) but drilling in to more STRATEGIC Macro pillars like Education, Infrastructure or R&D reveal interesting growth patterns in Asia (particularly China) and Western Europe that I suspect the 2024 metrics will bear out.
đ€ Hopefully the 2024 Global Vibrancy ranking will break out AI and ML verticals like Computer Vision or NLP and or the AI Agent space as that may also from a global macro level give indications of what is to come globally for AI in 2025.
đ It measures progress across the 8 broad pillars of R&D, Responsible AI, Economy, Education, Diversity, Policy and Governance, Public Opinion and Infrastructure. (Each of these pillars have a number of Sub Indices)
đ As a whole it is not surprising that the USA was at the top in terms of overall score as of 2023 (AI investment activity is a large part of the economic pillar for example and that is a large part of the overall USA ranking) but drilling in to more STRATEGIC Macro pillars like Education, Infrastructure or R&D reveal interesting growth patterns in Asia (particularly China) and Western Europe that I suspect the 2024 metrics will bear out.
đ€ Hopefully the 2024 Global Vibrancy ranking will break out AI and ML verticals like Computer Vision or NLP and or the AI Agent space as that may also from a global macro level give indications of what is to come globally for AI in 2025.
kz919Â
authored
a
paper
3 months ago
Post
868
đ€đ» Function Calling is a key component of Agent workflows. To call functions, an LLM needs a way to interact with other systems and run code. This usually means connecting it to a runtime environment that can handle function calls, data, and security.
Per the Berkeley Function-Calling Leaderboard there are only 2 fully open source models (The other 2 in the top 20 that are not closed source have cc-by-nc-4.0 licenses) out of the top 20 models that currently have function calling built in as of 17 Nov 2024.
https://gorilla.cs.berkeley.edu/leaderboard.html
The 2 Open Source Models out of the top 20 that currently support function calling are:
meetkai/functionary-medium-v3.1
Team-ACE/ToolACE-8B
This is a both a huge disadvantage AND an opportunity for the Open Source community as Enterprises, Small Business, Government Agencies etc. quickly adopt Agents and Agent workflows over the next few months. Open Source will have a lot of catching up to do as Enterprises will be hesitant to switch from the closed source models that they may initially build their Agent workflows on in the next few months to an open source alternative later.
Hopefully more open source models will support function calling in the near future.
Per the Berkeley Function-Calling Leaderboard there are only 2 fully open source models (The other 2 in the top 20 that are not closed source have cc-by-nc-4.0 licenses) out of the top 20 models that currently have function calling built in as of 17 Nov 2024.
https://gorilla.cs.berkeley.edu/leaderboard.html
The 2 Open Source Models out of the top 20 that currently support function calling are:
meetkai/functionary-medium-v3.1
Team-ACE/ToolACE-8B
This is a both a huge disadvantage AND an opportunity for the Open Source community as Enterprises, Small Business, Government Agencies etc. quickly adopt Agents and Agent workflows over the next few months. Open Source will have a lot of catching up to do as Enterprises will be hesitant to switch from the closed source models that they may initially build their Agent workflows on in the next few months to an open source alternative later.
Hopefully more open source models will support function calling in the near future.
ZiyangÂ
authored
a
paper
3 months ago
xzyaoÂ
authored
a
paper
3 months ago
Alignment-Lab-AIÂ
posted
an
update
4 months ago
Post
1265
remember boys and girls, always keep all your data, its never a waste of time!
ajibawa-2023Â
posted
an
update
4 months ago
Post
3157
New Dataset: Software-Architecture
Link: ajibawa-2023/Software-Architecture
I am releasing a Large Dataset covering topics related to Software-Architecture. This dataset consists of around 450,000 lines of data in jsonl.
I have included following topics:
Architectural Frameworks
Architectural Patterns for Reliability
Architectural Patterns for Scalability
Architectural Patterns
Architectural Quality Attributes
Architectural Testing
Architectural Views
Architectural Decision-Making
Advanced Research
Cloud-Based Architectures
Component-Based Architecture
Data Architecture
Emerging Trends
Event-Driven Architecture
Evolvability and Maintainability
Microservices and Monolithic
Microservices Architecture
Security Architecture
Service-Oriented Architecture
Software Design Principles
and Many More!
This dataset is useful in LLM development. Also those who are working on developing Software development related LLMs then this dataset can be useful.
This dataset is very useful to Researchers as well.
Link: ajibawa-2023/Software-Architecture
I am releasing a Large Dataset covering topics related to Software-Architecture. This dataset consists of around 450,000 lines of data in jsonl.
I have included following topics:
Architectural Frameworks
Architectural Patterns for Reliability
Architectural Patterns for Scalability
Architectural Patterns
Architectural Quality Attributes
Architectural Testing
Architectural Views
Architectural Decision-Making
Advanced Research
Cloud-Based Architectures
Component-Based Architecture
Data Architecture
Emerging Trends
Event-Driven Architecture
Evolvability and Maintainability
Microservices and Monolithic
Microservices Architecture
Security Architecture
Service-Oriented Architecture
Software Design Principles
and Many More!
This dataset is useful in LLM development. Also those who are working on developing Software development related LLMs then this dataset can be useful.
This dataset is very useful to Researchers as well.
-
- 4 replies