Toloka

Panel and reception | BY INVITATION | SF BAY AREA | SEP 24, 2026

Closing the Gap: Can Open Models Match Frontier Performance and How Would You Even Know?

The distance between open and closed models continues to shrink on paper, but matching the frontier means something different depending on who is asking. For some, it is a research question about how far the right data and fine-tuning can push a model; for others, it is a practical question about whether a model they can own and run is finally good enough to trust. Either way, the challenge is not just making the claim, it is proving it. Static benchmarks increasingly favor models that are fluent, confident, and wrong, and the gaps that matter most rarely show up on a leaderboard. This panel will explore what it actually takes to close that gap and the rigorous, head-to-head evaluation needed to determine whether you have truly closed it, or only think you have.
Date
Sep 24, 2026
Time
6:00 PM PDT
Location
SF Bay Area
By invitation only
40 spots, 16 open
VenueFairmont San Francisco950 Mason Street, San Francisco, CA 94108Get directions

Request an invitation

Agenda

  • 6:00 PM

    Arrival and welcome reception. Registration and networking.

  • 6:30 PM

    Welcome and introduction.

  • 6:40 PM

    Panel discussion, 45 minutes. Closing the Gap: Can Open Models Match the Frontier, and How Would You Know?

    Mikhail Parakhin, Chief Technology Officer at ShopifyMikhail ParakhinChief Technology Officer, Shopify
    Olga Megorskaya, Chief Executive Officer at TolokaOlga MegorskayaChief Executive Officer, Toloka
    Sharad Aggarwal, Global Head, Strategic Partnerships - AI & Engineering Solutions at Google CloudSharad AggarwalGlobal Head, Strategic Partnerships - AI & Engineering Solutions, Google Cloud
    Benny Yufei Chen, Co-Founder at Fireworks AIBenny Yufei ChenCo-Founder, Fireworks AI
    Sunzay Passari, Global Head of AI Transformation at UPSSunzay PassariGlobal Head of AI Transformation, UPS
  • 7:25 PM

    Q&A, 15 minutes.

  • 7:40 PM

    Dinner and Networking.

Who will be there

30 to 40 heads of AI, research leads and engineering leaders from labs, applied teams and enterprise buyers evaluating open versus frontier models.

Head of AI or machine learning
Head of Applied AI
Head of Data
Head of Product
Research lead
Engineering leadership

Further details

Moderated panel hosted by Toloka. No slides, no product demo, no roadmap. Just conversation.

Fairmont San Francisco. 950 Mason Street, San Francisco, CA 94108.

Reception, dinner and wine are covered by the host.

About Toloka

Toloka builds the data, evaluation and fine-tuning pipelines behind frontier and open model teams. We host these events because the honest questions about model quality do not fit into a keynote. toloka.ai