Lead Product Manager, Inference

There is a Lead Product Manager, Inference vacancy at Mistral AI, and the role is based in New York. The position is full-time and hybrid, with some days on site and some from home. No pay range is included in the posting.

Here is the role as Mistral AI describes it.

About Mistral

Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.

We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.

The role

Mistral is building a sovereign AI cloud. Our inference platform already serves production traffic at scale. We are hiring a Lead Product Manager to own the inference portfolio within our Cloud & Inference organization.

You'll set strategy, write specs, sit with customers running production traffic, and work across our inference, infrastructure, and go-to-market teams to deliver real customer impact. Example problems you may work on include figuring out the next inference product we should launch to help our customers scale their AI workloads or how we cut fraudulent free-tier usage without adding friction for legitimate users.

You will work on state of the art infrastructure, in close collaboration with our science and research engineering teams. Your job is to turn that infrastructure into products that AI-native startups and enterprises pay for, integrated with our developer platform Studio.

You will operate as an individual contributor first - taking end-to-end ownership of complex and significant product lines - while building the foundation for the inference PM team as the portfolio grows. The size and shape of the team reporting into the role will be defined together with the VP Product once you're in place; from day one the expectation is hands-on product leadership, not people management.

You will be the first PM fully dedicated to inference and the most senior product hire in the space. You will report to the VP Product - Cloud & Inference, and work day-to-day with our inference engineering teams in the US and Europe.

What you'll do

Strategy and vision: define the vision, strategy, and annual goals for the inference portfolio, aligned with customer needs and company objectives. Benchmark the managed-inference field and pick where we win.

Roadmap and execution: own the full lifecycle for serverless inference, dedicated endpoints, and adjacent services. Prioritize, ship, measure, iterate. Economics: own adoption, revenue contribution, and gross margin for your products. Treat cost-per-token, unit economics, and capacity tradeoffs as product decisions, and partner with GTM, Finance and Marketing on pricing, packaging, and launches.

Customers: spend real time with AI-native startups and enterprises running advanced production workloads. Turn their constraints, like latency, throughput, compliance, and cost, into roadmap choices.

Engineering partnership: work daily with inference engineering and the cloud infrastructure teams behind our data centers on capacity planning, scheduling, routing, and reliability.

Research and open source: track open-source inference advances and emerging model architectures, and turn them into performance and efficiency gains for the product.

Team building: as the portfolio scales, help shape and grow the inference PM team - hiring, mentoring, and setting the product bar.

What we're looking for

Deep product experience in tech and infrastructure with a track record of bringing inference, cloud infrastructure, or large-scale distributed systems to market. You have built robust, at-scale AI infrastructure first-hand.

An engineering background before moving into product management.

You have taken an infra or inference product from early stage to material revenue and adoption, owning complex and significant product lines end to end.

Player-coach disposition: you lead from the front - hands-on product work now, with the range and appetite to build and coach a team as we scale.

Fluency in the economics of the business: gross margin, unit economics, and the tradeoffs behind token pricing and GPU capacity.

High ownership and a strong bias for action. You prototype with AI coding tools, write your own specs, and unblock yourself without waiting for engineers or designers.

Low ego, comfort in ambiguity, and credibility with executives, engineers, and customers alike.

What We Offer

We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.

For the most up-to-date details on benefits available in your location, please refer to our Benefits page.

Privacy Policy

Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy .

Quick answers

Is pay published for the Lead Product Manager, Inference role?

Mistral AI has not included pay in the posting.

Is this a remote, hybrid or office job?

It is hybrid. You would work partly from home and partly from the office in New York.

How do I apply?

Use the apply button on this page. It takes you to Mistral AI's own application form, so your CV goes directly to their hiring team.

When was this job posted?

Mistral AI published the role on September 29, 2026. We check the employer's job board every day and take this page down when the role closes, so if you can read it, the job was still listed at our last check.

Source: Mistral AI careers page (jobs.ashbyhq.com). Applications go straight to the employer. We check the listing daily and remove it once it closes.