Company profile
llm-d
Open source project providing distributed inferencing for Generative AI runtimes on any Kubernetes cluster.
- Industry
- Software Development
- Employees
- 6
- Founded
- 2025
llm-d company summary
llm-d is a company in the Software Development industry, founded in 2025. On LinkedIn the company has around 6 employees.
What technology does llm-d use?
No technologies detected yet. Warmrank rechecks company websites on a rolling basis.
About llm-d
llm-d is a new open source project focused on providing distributed inferencing for Generative AI runtimes on any Kubernetes cluster. Its architecture is designed for high performance and scalability, aiming to reduce costs through a spectrum of hardware and software efficiency improvements. llm-d prioritizes ease of deployment and use, as well as the operational needs of running large GPU clusters, including SRE concerns and day 2 operations. At launch, its key features include prefill/decode disaggregation, KV cache distribution and management, an AI-aware router with customizable scoring, operational telemetry, Kubernetes-based deployment, and the NIXL inference optimized transfer library.
Compare companies similar to llm-d
More companies in Software Development.
| Company | Industry | Employees | Founded | Headquarters |
|---|---|---|---|---|
llm-d llm-d.ai | Software Development | 6 | 2025 | - |
 Vagas.com vagas.com.br | Software Development | 3,304 | 1999 | São Paulo, SP |
 Salesforce Work.com salesforce.com | Software Development | 87,907 | - | San Francisco, California |
 Microsoft github.com | Software Development | 6,587 | 2008 | San Francisco, CA |
 SAP Concur sap.com | Software Development | 147,691 | 1972 | Walldorf, BW |
 Upwork upwork.com | Software Development | 176,790 | 2015 | San Francisco, California, US |
 TechCrunch techcrunch.com | Software Development | 582 | - | San Francisco, California |
 Zoho zoho.com | Software Development | 30,854 | - | Chennai, Tamil Nadu |
 Canva canva.com | Software Development | 17,794 | 2012 | Surry Hills, New South Wales, AU |
 Atlassian atlassian.com | Software Development | 21,061 | 2002 | Sydney, NSW, AU |
 Shopee shopee.com | Software Development | 76,519 | - | Singapore, Singapore, SG |
Frequently asked questions about llm-d
What does llm-d do?
llm-d is a new open source project focused on providing distributed inferencing for Generative AI runtimes on any Kubernetes cluster. Its architecture is designed for high performance and scalability, aiming to reduce costs through a spectrum of hardware and software efficiency improvements. llm-d prioritizes ease of deployment and use, as well as the operational needs of running large GPU clusters, including SRE concerns and day 2 operations. At launch, its key features include prefill/decode disaggregation, KV cache distribution and management, an AI-aware router with customizable scoring, operational telemetry, Kubernetes-based deployment, and the NIXL inference optimized transfer library.
How many employees does llm-d have?
llm-d has around 6 employees on LinkedIn.
When was llm-d founded?
llm-d was founded in 2025.
Build a lead list from companies like llm-d
Describe your ICP or import a CSV. Warmrank finds matching companies, enriches contacts with verified emails, and tracks every lead.