Question 1

How did Varo use AI to reduce operational costs while improving customer service?

Accepted Answer

_An AI chatbot cut costs 60% while handling most inquiries._

We started by providing voice support for everybody, but it got very expensive. We moved to live person chat, then built an AI chatbot. That chatbot now contains over 55% of our inbound inquiries and allowed us to reduce operational costs by about 60%. This is part of solving the high-cost problem that made serving underserved populations uneconomical for traditional banks. The AI handles routine questions efficiently while maintaining service quality for customers who value access and responsiveness.

— [Disrupting Traditional Banking, with Colin Walsh](https://www.lutzfinger.com/transcript/2025-05-22-disrupting-traditional-banking-with-colin-walsh/) · _The Keynote on AI_

Question 2

How do you measure quality in healthcare data?

Accepted Answer

_Quality metrics for healthcare ML._

> Knowing quality is therefore of utmost importance. Three broad measurement areas in today's healthcare: (1) Metrics about quality of care — related to treatment effectiveness and patient satisfaction. (2) Metrics about need and utilization of care — gauging health requirements of a population and how often one uses what type of service. (3) Metrics about value-based healthcare — they measure disease prevention rather than disease…

— [Healthcare And Data - How To Measure Quality](https://www.forbes.com/sites/lutzfinger/2023/06/27/healthcare-and-datahow-to-measure-quality/) · _Forbes_

Question 3

How does Think Labs AI use physics informed AI differently than general purpose models like ChatGPT?

Accepted Answer

_Grid AI must be grounded in physics, not just patterns in data._

We cannot just put SCADA measurements and smart metering information into ChatGPT or Microsoft Copilot or Gemini and ask how the grid works. It does not work like that. We lean into something called Physics Informed AI. We train our AI models using physics. It is physics driven, physics based, and physics accurate. We teach AI how the grid works and reproduce engineering analysis faithfully. The AI can turn traditional studies that take weeks to months into minutes, and go from analyzing one feeder at a time into full system analysis.

— [AI Needs Power, the Grid Needs AI, with Josh Wong](https://www.lutzfinger.com/transcript/2026-04-02-ai-needs-power-the-grid-needs-ai-with-josh-wong/) · _The Keynote on AI_

Question 4

How does your company Gooder AI address the gap between technical metrics and business value?

Accepted Answer

_*Translating predictive model performance into profit and savings estimates*_

Gooder addresses one particular place where there's a need for a new category of software: the metrics. It's a business user console for understanding potential value and making decisions about deployment. Typically, data scientists present technical metrics like area under the curve, precision, or recall, but very rarely go to stakeholders and say if you deploy this model, it has potential value of this much profit or savings. We provide visualization where both dimensions are business relevant, like the decision threshold and business metrics like savings or profit, so stakeholders can see exactly what their options are.

— [The Value Translation Gap: AI's Deployment Problem](https://www.lutzfinger.com/transcript/2024-11-28-the-value-translation-gap-ais-deployment-problem/) · _The Edge_

Question 5

How has the shift from SEO to GEO changed what websites need to do for brands?

Accepted Answer

_Websites now feed AI rather than convert human visitors directly._

Websites used to be designed to convert human visitors, but now their main purpose needs to be feeding data into AI. The three-party model of searcher, Google, and end content is disintegrating into a two-party model. Decisions are getting made before consumers hit the website, so the website is no longer the main conversion point. Instead, websites should be clean data delivery mechanisms to computers, very explicit about who you sell to, your target use case, pain points, and the entire buyer journey. If it's not explicit, the AI has no way to know and might recommend somebody else.

— [Marketing to Humans Changed, with Alex Dees](https://www.lutzfinger.com/transcript/2026-03-24-marketing-to-humans-changed-with-alex-dees/) · _The Keynote on AI_

Question 6

How should product builders think about data bias in AI systems?

Accepted Answer

_Bias in data is inevitable; product decisions determine how much to accept._

There is never a way to have non-biased data, because data is biased. As a product person, you need to decide by how much you want to de-bias the data. Sometimes bias is actually good because you don't want averages, you want the best outcome. For example, if identifying certain patients or optimal machinery output, you don't want what the machine did in the past all the time, but just the best parts of it. You're injecting very good data versus just average data.

— [Building AI products: 5 lessons from our founders' workshop](https://www.lutzfinger.com/transcript/2024-08-01-building-ai-products-5-lessons-from-our-founders-workshop/) · _The Edge_

Question 7

What is the 'Ask, Measure, Learn' framework?

Accepted Answer

_The framework from Lutz's book._

> "Ask Measure Learn" is a non-technical guide shows you how to extract significant business value from big data. It is a system that helps you ask the right questions, measure the right data, and then learn from the results. The framework was originally devised to help governments and NGOs sift through volumes of data.

— [Ask Measure Learn](https://www.lutzfinger.com/book/) · _Book — Ask, Measure, Learn_

Question 8

What is the book Ask, Measure, Learn about?

Accepted Answer

_Topics covered in the O'Reilly book._

> **Publisher:** O'Reilly Media **Published:** Feb 1, 2014

— [Ask Measure Learn](https://www.lutzfinger.com/book/) · _Book — Ask, Measure, Learn_

Question 9

What is the difference between virality and contagiousness?

Accepted Answer

_Stories gain weight as they travel, not uniform infection rates._

Virality is something which is equally infectious at each stage. If I have a story which one out of 10 people like, that story doesn't change. One out of 10 people like it in the future as well. Contagiousness is different. As long as it travels, it gains weight. The more people believe in it, the more trustworthy the story becomes. Even a wrong information becomes more believed the longer it travels. At some point everyone believes it's truth no matter what because so many people believed in it. Forget about virality. The right word is contagiousness.

— [Measuring Social Media What Marketers Need To Know](https://www.lutzfinger.com/transcript/2014-08-22-measuring-social-media-what-marketers-need-to-know/) · _Social Media Examiner_

Question 10

What is value-based care and how does AI enable it?

Accepted Answer

_VBC framing and AI's role._

> Healthcare is on the brink of a seismic shift, and AI is its catalyst. Three converging trends are creating a perfect opportunity for change: (1) Foundational Models' growing ability to predict risks further into the future compared to traditional machine learning, (2) the rise of the self-insured healthcare industry motivated to address these risks, and (3) a surge in Value-Based Care (VBC) providers focused on risk reduction. These…

— [Three Trends Of Transformation: How AI & Value-Based Care (VBC) Will Drive Transformation Of Self-Insured Healthcare](https://www.forbes.com/sites/lutzfinger/2023/05/01/three-trends-of-transformation-how-ai--value-based-care-vbc-will-drive-transformation-of-self-insured-healthcare/) · _Forbes_

Question 11

Why do AI models still need human involvement even with unsupervised learning?

Accepted Answer

_Even advanced models can't escape the need for human judgment._

We need humans because there isn't always a true north for what's correct. Supervised learning works when there's a clear label, like Obama was president. That's a fact. But when you get into perception, like whether a joke is funny or which word to use about Obama's policies, it depends on context and perspective. The same happens with generated images. Art often creates things society didn't expect, so at what point is something random versus amazing? Since there's not a true label for certain things, we constantly need people to give feedback on the model and provide guardrails.

— [AI and the human factor](https://www.lutzfinger.com/transcript/2023-07-07-ai-and-the-human-factor/) · _The Edge_

Question 12

Why do LLMs convert better than search?

Accepted Answer

_Trust, personalization, and conversion lift from AI traffic._

> Some predict that by 2028, more people will discover products and information through large language models (LLMs) like ChatGPT and Gemini than through traditional search engines. But based on research I conducted with Cornell Master's students, that shift is happening much faster. LLM-driven traffic is already starting to outperform traditional search — not in volume, but in value.

— [Study Shows LLM Conversion Rate Is 9x Better — AEO Is Coming](https://www.forbes.com/sites/lutzfinger/2025/06/19/study-shows-llm-conversion-rate-is-9x-better---aeo-is-coming/) · _Forbes_

Question 13

Why is eval data a moat?

Accepted Answer

_Evaluation data as the strategic differentiator._

> All of them matter, and all of them are being fought over. But the real value may sit in the one thing OpenAI, Anthropic, and Gemini have not yet made central: your own eval data. Sure, there is the occasional thumbs-up button. But who is really using that signal?

— [The Missing Moat In AI: Your Eval Data](https://www.forbes.com/sites/lutzfinger/2026/05/26/the-missing-moat-in-ai-your-eval-data/) · _Forbes_

Question 14

Why is measuring social media so difficult despite all the tools available today?

Accepted Answer

_Tools are everywhere, but strategy comes first, not scores._

The problem is that measurement used to require specialists with big databases and tooling. Now with social media, you suddenly have all these tools that give you cloud scores and metrics instantly. People see a score and decide something based on it without planning what they actually want to achieve. If you haven't formulated your business goal first, any measurement won't work. People start with the measurement and then think about what to do with it, while the correct way is the opposite: start with a question, then come up with a measure.