Meridian Labs/The agent worked in the demo and not on Monday

Hosted dinner · By invitation · New York

The agent worked in the demo and not on Monday

Heads of AI and applied research compare what actually broke when they moved an agent from a controlled evaluation into production, and what they now catch before ship.

Date
Sep 24, 2026
Time
18:30 to 22:00
Location
New York
Table size
14 seats, 4 open
Request a seat4 seats left

Who is at the table

The room

12 to 14 heads of AI and applied research leads from labs and applied teams building on frontier models.

Head of AI or machine learningResearch leadEngineering leadership

What gets discussed

Four questions, no slides

  1. 01What did your evals miss that a customer found in week one?
  2. 02Where did retrieval or tool use fail in a way you did not see coming?
  3. 03Which incident cost you the most trust internally, and what did you change the day after?
  4. 04What is the next class of failure you are already writing an eval for?

Confirmed so far

Guests already seated

Named on arrival. Listed by role and company type until then.

  • Series C developer tools companyHead of AI
  • Public consumer internet companyResearch lead, agents
  • Series B fintechDirector of applied ML
  • Enterprise SaaS platformPrincipal engineer, ML platform
  • Series D vertical SaaSVP engineering
  • AI research labStaff research engineer

How it runs

Format and conduct

Chaired by Meridian's head of research. Peer-led, no vendor presentation. No demo, no roadmap slide, no follow-up sequence.

Restaurant in Tribeca, confirmed on the day. Doors 18:30, seated dinner 19:00, close 22:00.

Dinner, wine and travel within Manhattan are covered by the host.

Chatham House rule.

Anything said here can be used afterwards. Who said it cannot. Nothing is recorded, and no attendee list is circulated or sold.

Your host

About Meridian Labs

Meridian Labs builds evaluation and observability tooling for teams shipping agents into production. We host these rooms because the questions that matter are the ones nobody wants to put on a slide.

Request a seat

Seats are confirmed by the host, not first come first served. We will come back to you within two working days either way.