We started the company two and a half years ago, and raised $7.3m in 2024 (announced only almost a year later). We've spent less than half of this amount.
Earlier this week we came to the difficult decision to wind down the project. The open-source repository remains available on GitHub (Apache 2.0) but won't be actively maintained by the team moving forward.
show comments
LeonM
The title makes it sound like they just did a seed round, but the seed round was announced in August of last year [0].
Their website landing page is now also showing the software is no longer maintained. No mention of why they made this decision, my best guess is they burned through their seed money and were unable to attract further investments.
About one year ago, I created an LLM gateway with metrics, provider fallback and switching, tools support, injecting, etc. etc., and unique features like acting as an MCP tools client and server, all streamed, with low latency.
It was a simple project in terms of technical complexity. I didn't publish it as I counted several similar projects in the field.
Putting $7.3M into such a project would make sense only in the case of a precise growth plan with already declared customers and an promising sales funnel. There is no technical moat.
show comments
jdw64
VCs think, 'Apps are risky, infrastructure is safe,'
so they invested in AI infra.
"infra is safe"
Hmm, but that wasn't a good idea.
because if an open source infrastructure project like TensorZero gets shut down this quickly, won't they start to realize that those investment theories are also risky?
The difficult thing about AI infrastructure is that, unlike other industries, it will not become fragmented. It will likely remain tied to specific big tech models. What does this mean? It means that because AI models are not yet standardized, the infrastructure itself is actually riskier. In other words, the privatization of standards is happening.
The challenge with AI infrastructure is that an independent, stable standard layer has not formed, unlike in other software infrastructure markets such as databases, web servers, cloud, and containers. Over time, those ecosystems developed relatively standardized interfaces and operational layers. But the LLM ecosystem is still evolving rapidly. Models themselves change fast, APIs differ, pricing differs, context windows, tool calling, structured output, evaluation, fine tuning, caching, routing, everything keeps changing.
So even if an infrastructure startup tries to build a common abstraction layer across multiple models, before that common layer can stabilize, big model or cloud providers like OpenAI, Anthropic, Google, AWS, or Azure can just absorb the same functionality directly. In the end, AI infrastructure is at high risk of becoming an attached feature of model providers rather than solidifying as an independent layer.
But if a startup that raised 7.3 million dollars fails this quickly, who would trust and invest in such things? That aside, it seems AI startups are all the rage these days. I also want to learn AI and get funded like that. Does anyone here trust me enough to invest? About one hundredth of that would probably be enough
show comments
indigodaddy
Just use Plexus [1]. The maintainer is not trying to be a hero or raise seed dollars or even really trying to promote it. He's just making an excellent, useful product. (Unaffiliated, just a happy user). It's not a full-on "LLMOps" platform (whatever that is), it's just a proxy that works very well and has some nice features.
For people like myself, who didn't understand the timing of events - raised in august 2025, archived yesterday without any notice.
andruby
What are good OSS alternatives? Or do most users not bother with such infra tool?
hek2sch
Most VCs avoided application layer believing it is too risky with few player would emerge as winner over application layers calling them GPT wrapper (now called Harness) and pouring money into infra layer. Would love to see your opinion about how this thesis would turn out going forward.
Open source powers the business of many large corporations and they give essentially nothing back - why would maintainers refuse an offer for money in this environment?
xyst
Among the first domino to fall leading up the AI bust. Hope my 401K won’t get decimated by this one.
feverzsj
At least it's not a pig butchering scam.
krembo
I don’t understand the commenters here who are attacking the entrepreneur. If it's not your money, then he is accountable only to his investors.
show comments
villgax
Just switch to Bifrost already
rvz
But it is written in Rust™.
shevy-java
Guys - skynet is winning the war. We oldschool humans are left behind here.
Wasn't GitHub once a place for humans? Now we could rename it SkyHub.
I'm the co-founder and CEO of TensorZero.
We started the company two and a half years ago, and raised $7.3m in 2024 (announced only almost a year later). We've spent less than half of this amount.
Earlier this week we came to the difficult decision to wind down the project. The open-source repository remains available on GitHub (Apache 2.0) but won't be actively maintained by the team moving forward.
The title makes it sound like they just did a seed round, but the seed round was announced in August of last year [0].
Their website landing page is now also showing the software is no longer maintained. No mention of why they made this decision, my best guess is they burned through their seed money and were unable to attract further investments.
[0]: https://www.tensorzero.com/blog/tensorzero-raises-7-3m-seed-...
About one year ago, I created an LLM gateway with metrics, provider fallback and switching, tools support, injecting, etc. etc., and unique features like acting as an MCP tools client and server, all streamed, with low latency.
It was a simple project in terms of technical complexity. I didn't publish it as I counted several similar projects in the field.
Putting $7.3M into such a project would make sense only in the case of a precise growth plan with already declared customers and an promising sales funnel. There is no technical moat.
VCs think, 'Apps are risky, infrastructure is safe,' so they invested in AI infra.
"infra is safe" Hmm, but that wasn't a good idea. because if an open source infrastructure project like TensorZero gets shut down this quickly, won't they start to realize that those investment theories are also risky?
The difficult thing about AI infrastructure is that, unlike other industries, it will not become fragmented. It will likely remain tied to specific big tech models. What does this mean? It means that because AI models are not yet standardized, the infrastructure itself is actually riskier. In other words, the privatization of standards is happening.
The challenge with AI infrastructure is that an independent, stable standard layer has not formed, unlike in other software infrastructure markets such as databases, web servers, cloud, and containers. Over time, those ecosystems developed relatively standardized interfaces and operational layers. But the LLM ecosystem is still evolving rapidly. Models themselves change fast, APIs differ, pricing differs, context windows, tool calling, structured output, evaluation, fine tuning, caching, routing, everything keeps changing.
So even if an infrastructure startup tries to build a common abstraction layer across multiple models, before that common layer can stabilize, big model or cloud providers like OpenAI, Anthropic, Google, AWS, or Azure can just absorb the same functionality directly. In the end, AI infrastructure is at high risk of becoming an attached feature of model providers rather than solidifying as an independent layer.
But if a startup that raised 7.3 million dollars fails this quickly, who would trust and invest in such things? That aside, it seems AI startups are all the rage these days. I also want to learn AI and get funded like that. Does anyone here trust me enough to invest? About one hundredth of that would probably be enough
Just use Plexus [1]. The maintainer is not trying to be a hero or raise seed dollars or even really trying to promote it. He's just making an excellent, useful product. (Unaffiliated, just a happy user). It's not a full-on "LLMOps" platform (whatever that is), it's just a proxy that works very well and has some nice features.
[1] https://github.com/mcowger/plexus
This is the claim in the repo readme that presumably unlocked the VC investment:
“TensorZero is used by companies ranging from frontier AI startups to the Fortune 10 and fuels ~1% of global LLM API spend today.”
One percent seems like a lot. Anyone on HN use this?
Seed was in Aug ‘25 and website simply says the project will no longer be maintained: https://www.tensorzero.com/
There was a high severity advisory last week https://github.com/tensorzero/tensorzero/security/advisories... though these days can't even tell if this is related or just routine
For people like myself, who didn't understand the timing of events - raised in august 2025, archived yesterday without any notice.
What are good OSS alternatives? Or do most users not bother with such infra tool?
Most VCs avoided application layer believing it is too risky with few player would emerge as winner over application layers calling them GPT wrapper (now called Harness) and pouring money into infra layer. Would love to see your opinion about how this thesis would turn out going forward.
I'm glad I used litellm in my last project
https://github.com/BerriAI/litellm/
Open source powers the business of many large corporations and they give essentially nothing back - why would maintainers refuse an offer for money in this environment?
Among the first domino to fall leading up the AI bust. Hope my 401K won’t get decimated by this one.
At least it's not a pig butchering scam.
I don’t understand the commenters here who are attacking the entrepreneur. If it's not your money, then he is accountable only to his investors.
Just switch to Bifrost already
But it is written in Rust™.
Guys - skynet is winning the war. We oldschool humans are left behind here.
Wasn't GitHub once a place for humans? Now we could rename it SkyHub.
Holy burn rate.
LOL, there's a sucker born every minute!