Back-end Engineer - Founding Engineer
A fast-growing open-source platform is building a cutting-edge feedback loop for optimizing large language model (LLM) applications — turning production data into smarter, faster, and more cost-effective models.
Must have Rust experience…
What we’re building
A unified model gateway
Real-time feedback and metric collection
Tools to optimize prompts, models, and inference strategies
Built-in A/B testing and experimentation frameworks
Seamless observability and optimization pipelines
Our platform creates a continuous learning flywheel for LLMs, combining:
Inference: One API for all LLMs with near-zero overhead
Observability: Feed inference data and feedback directly into your database
Optimization: Improve from prompt engineering all the way to fine-tuning and reinforcement learning
Experimentation: Native support for routing, fallbacks, and advanced testing setups
The Role
We’re hiring a Founding Member of Technical Staff with deep systems engineering experience (especially in Rust).
Why not just “engineer”? Because we want cross-functional builders — people who can bridge research and production, infrastructure and experimentation. Our core systems are written in Rust, and the scope of work includes features like inference-time optimizations and advanced experimentation frameworks.
What We Offer
Competitive compensation (salary, equity, benefits)
The chance to have most of your work be open-source and highly visible
Rapid personal growth across both systems and machine learning domains
A collaborative, technical, in-person environment where craftsmanship and ambition meet
Backing from leading venture funds with experience in AI, infrastructure, and developer tools
What We’re Looking For
Strong technical foundation and the ability to drive large projects from start to finish
Background in back-end systems and infrastructure (especially with Rust)
Hunger for personal and professional growth — there are no limits here
Willingness to work on-site in NYC with a small, highly focused team
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Join us as we seek a strategic CFO to shape the financial future of our transformative AI platform.
Seeking a strategic Chief Regulatory & Compliance Officer to shape regulatory strategy for FDA-cleared medical devices and ensure compliance across multiple international standards.
Join Metalenz as a DevOps Engineer and help propel our cutting-edge software team with robust infrastructure and development support.
Step into the future of AI development with NVIDIA as a Senior Software Engineer, crafting advanced tools and integrations for enterprise-level applications.
Join Evertech as a Frontend React Developer and help shape high-quality user interfaces while collaborating with a talented global team.
Experienced Senior Software Engineers with expertise in SAP TM are needed at Maersk to drive solution delivery and support for transportation management in a hybrid work setting.
Join TRM Labs as a Software Engineer on the Data Product team and help shape the future of blockchain intelligence.
Contribute as a Backend Engineer at Rain, building cutting-edge financial infrastructure integrating stablecoins with global payments.
As a Staff AI/ML Software Engineer at ServiceNow, you will lead the development of advanced ML models to enhance customer experiences and operational efficiency.
Join Beauty Pie as a Senior Engineer and help shape the future of luxury beauty technology in a hybrid work environment.
Join Airwallex as a Senior Frontend Engineer to craft high-performance, user-friendly interfaces that drive innovation in financial technology.
Join Microsoft's Word team as a Senior Software Engineer to create empowering user experiences in Word Web.
Lead the development of Kotlin Multiplatform libraries at Ditto, a fast-growing startup transforming edge device applications.
Muon Space is looking for a Software Test Infrastructure Engineer to develop and maintain testing frameworks for their satellite technologies in Mountain View, CA.
Join Oscillas as a PHP/Laravel Developer and help transform business operations for our diverse clients through innovative software solutions.
Subscribe to Rise newsletter
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
