TensorZero is an open-source platform that creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.
Integrate our model gateway
Send metrics or feedback
Optimize prompts, models, and inference strategies
Watch your LLMs improve over time
It enables a data & learning flywheel for LLMs by unifying:
Inference: one API for all LLMs, with <1ms P99 overhead
Observability: inference & feedback → your database
Optimization: from prompts to fine-tuning and RL
Evaluations: compare prompts, models, inference strategies
Experimentation: built-in A/B testing, routing, fallbacks
We’ve raised from FirstMark (backed ClickHouse), Bessemer (backed Anthropic), Bedrock (backed OpenAI), and many angels. We’re lucky to have years of runway, giving us the flexibility to fully focus on open source for now with an ambitious long-term vision.
We're looking for a Founding Member of Technical Staff with a background in developer relations. This is the perfect role for a community-minded engineer. You'll work on technical content to drive adoption: demos, integrations & partnerships, documentation, videos, social media, and more. You're a "wartime growth hacker" who can think outside the box, with the technical background to build best-in-class software.
We’re a small technical team based in NYC (in person). As an early contributor, you’ll work closely with us and have a significant impact on the project’s future and vision.
Viraj Mehta (CTO) recently completed his PhD from Carnegie Mellon, with an emphasis on reinforcement learning for LLMs and nuclear fusion, and previously worked in machine learning at KKR and a fintech startup; he holds a BS in math and an MS in computer science from Stanford.
Gabriel Bianconi (CEO) was the chief product officer at Ondo Finance ($10B+ valuation) and previously spent years consulting on machine learning for companies ranging from early-stage tech startups to some of the largest financial firms; he holds BS and MS degrees in computer science from Stanford.
Andrew Jesson (MTS) is an ML researcher with deep expertise in Bayesian ML, causal inference, RL, and LLMs. He’s finishing his post-doc at Columbia and previously received a PhD from Oxford, during which he interned at Meta. He has 3.3k+ citations and several first-author papers at NeurIPS and other top ML venues.
Aaron Hill (MTS) is a back-end engineer with deep expertise in Rust. He became one of the maintainers of the Rust compiler team… while still in college. Later, he worked on back-end infrastructure at AWS and Svix. He’s also an active contributor to many notable open-source Rust projects (e.g. Ruffle).
Kincaid O’Neil (incoming MTS) is a full-stack engineer who previously founded Gathers, a consumer social startup that curated intimate in-person experiences. Before that, he built open-source payments infrastructure for the Interledger Protocol and worked at blockchain startups Coil, Ripple, and Kava.
█████ (incoming MTS) is an ML researcher with a background in causal inference, sequential decision making, uncertainty quantification, and algorithmic fairness (1.2k+ citations). Previously, he was an AI Research Lead at █████ and received a PhD in Statistics from CMU, during which he interned at █████ and █████.
_____ You?
Competitive compensation — We believe that great talent deserves great compensation (salary, equity, benefits), even at an early-stage startup.
Open-source contributions — The vast majority of your work will be open-source and public.
Learning and growth opportunities — You’ll join with a background in design engineering but will have the opportunity (& be encouraged) to expand your skill set way beyond that (curious about ML?).
Small, technical, in-person team — You’ll work alongside a 100% technical team and help shape our vision, culture, and engineering practices.
Best-in-class investors — We’re lucky to be backed by leading funds like FirstMark (backed ClickHouse), Bessemer (backed Anthropic), Bedrock (backed OpenAI), and many angels. We have years of runway and a long-term mindset.
Strong technical background — You’ve tackled hard technical problems. You’re comfortable driving large projects from inception to deployment.
Community leader — You're excited to build a community of developers, teach them about TensorZero, and more.
Technical writing & speaking — You're comfortable writing technical content, public speaking, organizing events, and more.
Hungry for personal growth — There are no speed limits at TensorZero. You’re excited about learning and contributing across the stack.
In-person in NYC — We work in-person five days a week in NYC. We work hard and obsess about the craft – but maintain and encourage a healthy lifestyle with a long-term mindset.
You can find us on Github: https://github.com/tensorzero/tensorzero
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Become a pivotal part of TensorZero as a Founding Member of Technical Staff focused on design engineering within an innovative open-source environment.
Join BE Power Equipment as a Drafter where you'll bring your CAD expertise to life in a dynamic manufacturing environment.
Be a key player in shaping the future of AI technology as an AI Platform Architect at MetroStar's Innovation Lab.
Join NVIDIA as a CAD Flow Development Engineer to innovate and automate VLSI ASIC design in a diverse team environment.
Be part of Veolia Group's mission in ecological transformation as a Process Engineer specializing in wastewater treatment systems.
As an Environmental Engineer at AECOM, you will leverage your expertise to deliver innovative solutions for complex environmental challenges.
Boeing is seeking an Associate Mechanical Design Engineer to enhance mechanical ground support equipment for military applications in Hazelwood, MO.
Become a key player at MKS Instruments as a Manufacturing Engineer, focusing on advancements in optical lens fabrication.
Join RSC2, Inc. as a Senior Test and Evaluation Engineer and lead vital testing efforts for innovative defense technologies.
Join Bath Iron Works as a Hull Outfit Engineer to support groundbreaking naval engineering projects with a focus on quality and innovation.
Contribute to cutting-edge space technology as a Senior RF Design Engineer at Rocket Lab, developing RF communications for next-generation rockets and satellites.
Join CloudLinux as a Packaging Engineer and contribute to innovative Linux security and infrastructure solutions while enjoying the flexibility of remote work.
Lead IDT’s design engineering team in Coralville as Director, driving strategy and innovation in biotech manufacturing technology.
Lead the AI team at Peregrine Technologies, driving innovation in public safety technology through generative AI solutions.
Subscribe to Rise newsletter