<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Rosenblatt]]></title><description><![CDATA[Helping professional services accelerate their journey to AI transformation]]></description><link>https://substack.rosenblatt.ai</link><image><url>https://substackcdn.com/image/fetch/$s_!Y5N7!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F852b36d4-1a06-423a-aab9-a3560c4c99c4_300x300.png</url><title>Rosenblatt</title><link>https://substack.rosenblatt.ai</link></image><generator>Substack</generator><lastBuildDate>Thu, 30 Apr 2026 11:06:38 GMT</lastBuildDate><atom:link href="https://substack.rosenblatt.ai/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Ryan Walden]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[ryanwalden@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[ryanwalden@substack.com]]></itunes:email><itunes:name><![CDATA[Ryan Walden]]></itunes:name></itunes:owner><itunes:author><![CDATA[Ryan Walden]]></itunes:author><googleplay:owner><![CDATA[ryanwalden@substack.com]]></googleplay:owner><googleplay:email><![CDATA[ryanwalden@substack.com]]></googleplay:email><googleplay:author><![CDATA[Ryan Walden]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[The $1.2 Trillion Professional Services Iceberg]]></title><description><![CDATA[General Catalyst's Playbook for Transforming Professional Services with AI]]></description><link>https://substack.rosenblatt.ai/p/the-12-trillion-professional-services</link><guid isPermaLink="false">https://substack.rosenblatt.ai/p/the-12-trillion-professional-services</guid><dc:creator><![CDATA[Ryan Walden]]></dc:creator><pubDate>Mon, 22 Dec 2025 14:29:17 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!HHh3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h3><strong>What are Professional Services?</strong></h3><p>Professional services are specialized services provided by skilled professionals to help businesses solve complex problems. These services typically involve expertise in areas like consulting, legal counsel, and accounting to name a few. Their core value comes from skilled human capital performing <strong>language-intensive, knowledge work</strong>.</p><h3><strong>Who is General Catalyst?</strong></h3><p>For those of you unfamiliar, General Catalyst (GC) is an &#8220;investment and transformation company&#8221;. This label is purposefully broad as they&#8217;ve borrowed strategies from both private equity and venture capital, while pioneering some of their own. They command over $30B in assets under management, and their portfolio included some of the most successful tech companies (e.g. Airbnb, Stripe, Snap). </p><h3><strong>What are AI-Enabled Roll Ups?</strong></h3><p>In August of this year, General Catalyst published an article titled &#8220;<a href="https://www.generalcatalyst.com/stories/the-future-of-services">The Future of Services</a>&#8221; which explained their AI-enabled roll up strategy. Here&#8217;s the TLDR of their strategy in 6 steps:</p><ol><li><p><strong>Identify a Legacy Service Sector:</strong> Target fragmented, traditional service industries (like property management, insurance, or accounting) that haven&#8217;t been meaningfully transformed by AI.</p></li><li><p><strong>Assemble the Founding Team:</strong> Build a team combining three critical capabilities:</p><ul><li><p>AI technologists with deep applied AI experience in that vertical</p></li><li><p>Industry experts who understand legacy service business pain points</p></li><li><p>Operators with proven M&amp;A and integration experience</p></li></ul></li><li><p><strong>Build the AI Foundation:</strong> Develop applied AI tools that dramatically improve service delivery, delivering measurable change to profit (EBITDA margin).</p></li><li><p><strong>Acquire Service Businesses:</strong>  Acquire existing service companies in the target sector through M&amp;A.</p></li><li><p><strong>Integrate and Transform:</strong> Apply the AI tools to acquired businesses, transforming replicating the dramatic improvements to service delivery.</p></li><li><p><strong>Scale Through Additional Acquisitions:</strong> Use the now proven playbook to acquire more companies, creating compounding growth while maintaining operational excellence.</p></li></ol><p>They also revealed they have already put this strategy to work across at least 9 portfolio companies over the past 3 years and have achieved amazing results:</p><blockquote><p>&#8220;The companies we back aim to take businesses growing in single digits to 10-20% growth through a combination of organic capability-led growth and acquisitions. They simultaneously aim to double profit margins, often targeting 30-40% margins. They are setting their sights on a new <strong>Rule of 60 standard</strong>.&#8221; - GC</p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!4gd4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!4gd4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 424w, https://substackcdn.com/image/fetch/$s_!4gd4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 848w, https://substackcdn.com/image/fetch/$s_!4gd4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!4gd4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!4gd4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg" width="1456" height="799" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:799,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!4gd4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 424w, https://substackcdn.com/image/fetch/$s_!4gd4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 848w, https://substackcdn.com/image/fetch/$s_!4gd4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!4gd4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a5007ae-f6af-475e-87a0-8f1f33a41515_2770x1520.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Portfolio companies highlighted in GC&#8217;s &#8220;The Future of Services&#8221; article</figcaption></figure></div><h3><strong>What&#8217;s the &#8220;Rule of 60&#8221;?</strong></h3><p>The Rule of 40 is a key benchmark for SaaS businesses, stating that a company&#8217;s year-over-year revenue growth rate plus its EBITDA margin should equal or exceed 40%.</p><div class="latex-rendered" data-attrs="{&quot;persistentExpression&quot;:&quot;\\text{Revenue Growth} + \\text{EBITDA Margin} \\geq \\text{40%}&quot;,&quot;id&quot;:&quot;IZBONQBBZG&quot;}" data-component-name="LatexBlockToDOM"></div><p>The idea is that a financially strong SaaS business should balance rapid expansion with profitability, and achieve net 40% growth across both for any given year. GC&#8217;s proposed Rule of 60 is a complete game changer, setting a significantly higher bar for their portfolio companies and investors&#8217; expectations.</p><blockquote><p>&#8220;Double-digit growth and operational efficiency are no longer a tradeoff; they reinforce each other. By expanding service capabilities and capacity, unlocking markets that once looked unreachable, and setting new standards of customer experience, these businesses are creating a new baseline for what services can achieve.&#8221; - GC</p></blockquote><h3><strong>Why Professional Services?</strong></h3><p>The professional services sector represents one of the largest and most compelling opportunities for AI-enabled transformation. This broad sector encompasses legal, finance, insurance, accounting and many other industries, commanding a combined <a href="https://www.census.gov/services/qss/qss-current.pdf">$3.1 trillion in annual revenue</a>. Although a diverse category, what all members share is a breadth of <strong>language-intensive, knowledge work</strong> that AI is uniquely positioned to transform. The <a href="https://arxiv.org/pdf/2303.01157">2023 study from Felten et al.</a> systematically ranked which industries face the highest exposure to AI language modeling capabilities. Reflecting on GC&#8217;s article, the top 10 results are striking:</p><ul><li><p>Legal services #1</p></li><li><p>Financial services #2</p></li><li><p>Insurance agencies, funds, and carries ranked #3, #4, and #7 respectively</p></li><li><p>Private credit #5</p></li><li><p>Talent agents #6</p></li><li><p>Alternative investments #8</p></li><li><p>Accounting #9</p></li><li><p>HR #10</p></li></ul><p>Further validating the potential for professional services, the recent <a href="https://arxiv.org/pdf/2510.25137">2025 MIT Iceberg Index</a> highlighted these same industries as the opportunity 5x larger than today&#8217;s visible AI adoption.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!HHh3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!HHh3!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 424w, https://substackcdn.com/image/fetch/$s_!HHh3!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 848w, https://substackcdn.com/image/fetch/$s_!HHh3!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 1272w, https://substackcdn.com/image/fetch/$s_!HHh3!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!HHh3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png" width="1456" height="758" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/edd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:758,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:705493,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://substack.rosenblatt.ai/i/180479446?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!HHh3!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 424w, https://substackcdn.com/image/fetch/$s_!HHh3!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 848w, https://substackcdn.com/image/fetch/$s_!HHh3!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 1272w, https://substackcdn.com/image/fetch/$s_!HHh3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fedd0739f-c3e8-4e10-846f-861a7118996f_1752x912.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">This Iceberg Index represents where workforce preparation strategies based solely on visible tech-sector signals fall short.</figcaption></figure></div><h3><strong>Sizing The Opportunity </strong></h3><ul><li><p>The Iceberg Index&#8217;s estimates the professional service occupations value at $1.2T</p></li><li><p><a href="https://www.withorb.com/blog/value-based-pricing-formula#:~:text=Value%20capture%20rate%20is%20the%20percentage%20of%20differentiation%20value%20you%20choose%20to%20price%20in.%20Typical%20ranges%3A%2010%25%20to%2020%25%20(penetration/competitive)%2C%2020%25%20to%2040%25%20(standard)%2C%2040%25%20to%2050%25%20(strong%20differentiation).">Orb&#8217;s SaaS value-based pricing formula</a><strong> </strong>reports 10-20% conservative value capture</p></li><li><p><strong>The Professional Services&#8217; AI Opportunity Conservative TAM =</strong> <strong>$120B - $240B</strong> </p></li></ul><p>The professional services opportunity isn&#8217;t speculative, it&#8217;s validated by academic research, quantified by MIT, and already being executed by sophisticated investors like General Catalyst. The $1.2 trillion in occupational exposure identified by the Iceberg Index represents real labor value sitting in fragmented, legacy industries that have remained largely untouched by technology for decades.</p><p>What makes this moment different is the convergence of three forces: AI capabilities that can finally perform <strong>language-intensive knowledge work</strong>, a proven transformation playbook pioneered by GC&#8217;s portfolio, and fragmented markets ripe for consolidation. The Rule of 60 isn&#8217;t aspirational&#8212;it&#8217;s already being achieved by companies that combine AI-first operations with disciplined M&amp;A.</p><p>For investors and operators watching from the sidelines, the window is narrowing. General Catalyst has a three-year head start and $30B in capital to deploy. The firms that move now to partner with the right AI teams will define the next generation of professional services. Those that wait will find themselves either acquired or outcompeted by AI-native players delivering superior service at a fraction of the cost.</p><h3><strong>About Rosenblatt</strong></h3><p><a href="https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf">MIT also reports</a> that partnering externally on AI-first products brings them live 6 months sooner and twice as successfully as internal builds. Rosenblatt specializes in AI transformation for mid-market, tech-enabled, professional services. We bring together AI leaders from big 4 consulting firms and founders from exited AI startups to lead companies from AI pilots to complete transformations. Click below to schedule a 30-minute meeting with our CEO and founder.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://calendly.com/rosenblatt-ai/30min&quot;,&quot;text&quot;:&quot;Book a Meeting&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://calendly.com/rosenblatt-ai/30min"><span>Book a Meeting</span></a></p><p></p><p></p><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://substack.rosenblatt.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Rosenblatt AI! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Case Study: ProService Hawaii]]></title><description><![CDATA[Kickstarting an the first AI transformation in PEO]]></description><link>https://substack.rosenblatt.ai/p/case-study-proservice-hawaii</link><guid isPermaLink="false">https://substack.rosenblatt.ai/p/case-study-proservice-hawaii</guid><dc:creator><![CDATA[Ryan Walden]]></dc:creator><pubDate>Mon, 15 Dec 2025 13:57:38 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/e4db3d8f-d667-4607-8357-839f91572736_450x450.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h3>Initial Consultation</h3><p>In late March of 2025, Rosenblatt founder and CEO, Ryan Walden, lead a one day, in-person consultation with Jordan Conley, ProService Head of Strategy and Technology, and Mikaela Ferguson, Director of AI Product.</p><div class="pullquote"><p><em>&#8220;One of the best consultations I have experienced in my career&#8221; </em>- Jordan Conley</p></div><p>48 hours after the meeting, the Rosenblatt team returned a 3-month pilot plan with comprehensive JIRA tickets and a clear path to AI-enabling ProService&#8217;s new client onboarding process, named &#8220;Fridai&#8221;.</p><h3>Fridai</h3><p>3 months later, the Rosenblatt team delivered an AI-assisted, self-service onboarding experience for new clients, eliminating several onboarding calls from ProService&#8217;s existing process. This solution includes both an onboarding web application, and an internal dashboard for adding new clients and tracking their self-onboarding process. By using information collected during client sales calls, <strong>our AI agents could pre-fill 80% of all new client onboarding details before they even start their onboarding</strong>. By December, all 75 new ProService clients had successfully self-serviced their onboarding <strong>without any human intervention</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!KJ1v!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!KJ1v!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 424w, https://substackcdn.com/image/fetch/$s_!KJ1v!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 848w, https://substackcdn.com/image/fetch/$s_!KJ1v!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 1272w, https://substackcdn.com/image/fetch/$s_!KJ1v!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!KJ1v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png" width="2840" height="1484" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1484,&quot;width&quot;:2840,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:563145,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://substack.rosenblatt.ai/i/181440864?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F32e51e46-ba26-4d12-9a70-6d7e11fdfca9_2840x1484.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!KJ1v!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 424w, https://substackcdn.com/image/fetch/$s_!KJ1v!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 848w, https://substackcdn.com/image/fetch/$s_!KJ1v!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 1272w, https://substackcdn.com/image/fetch/$s_!KJ1v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d1b0d75-f2bd-408c-964f-6c48f8bbd407_2840x1484.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Fridai using tool calling to generate a unique PTO policies based on client data</figcaption></figure></div><h3>ProPilot</h3><p>After success with Fridai, the Rosenblatt team expanded into new projects outside of onboarding. Tasked with improving the ProService call center&#8217;s first call resolution (FCR) rates, Rosenblatt launched a new AI agent called ProPilot <strong>in only 3 weeks</strong>. By week 4, call center employees are already providing incredibly positive feedback, and <strong>observed FCR increases by +20%</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PB5X!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PB5X!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 424w, https://substackcdn.com/image/fetch/$s_!PB5X!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 848w, https://substackcdn.com/image/fetch/$s_!PB5X!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 1272w, https://substackcdn.com/image/fetch/$s_!PB5X!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!PB5X!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png" width="535" height="421" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:421,&quot;width&quot;:535,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:80504,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://substack.rosenblatt.ai/i/181440864?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9cf0f8bb-9a37-44d3-b47f-c843a9e4c373_535x574.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PB5X!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 424w, https://substackcdn.com/image/fetch/$s_!PB5X!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 848w, https://substackcdn.com/image/fetch/$s_!PB5X!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 1272w, https://substackcdn.com/image/fetch/$s_!PB5X!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5be2187-4ae5-4da1-9aeb-57f7f59b4ce3_535x421.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Real feedback from call center employees in our Slack #propilot-support channel</figcaption></figure></div><h3>About Rosenblatt</h3><p><a href="https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf">MIT reports</a> that partnering externally on AI-first products brings them live 6 months sooner and twice as successfully as internal builds. Rosenblatt specializes in AI transformation for mid-market, tech-enabled, professional services. We bring together <a href="https://www.linkedin.com/in/hromalik/">AI leaders from big 4 consulting firms</a> and <a href="https://www.linkedin.com/in/owenbwhite/">founders from exited AI startups</a> to lead companies from fast pilots to complete AI transformations. Click below to schedule a 30-minute meeting with our CEO and founder.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://calendly.com/rosenblatt-ai/30min&quot;,&quot;text&quot;:&quot;Book a Meeting&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://calendly.com/rosenblatt-ai/30min"><span>Book a Meeting</span></a></p><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://substack.rosenblatt.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Rosenblatt AI! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Private Equity's AI Transformation Dilemma]]></title><description><![CDATA[The Need to Prioritize Transformations for your Professional Services Portcos]]></description><link>https://substack.rosenblatt.ai/p/private-equitys-professional-services</link><guid isPermaLink="false">https://substack.rosenblatt.ai/p/private-equitys-professional-services</guid><dc:creator><![CDATA[Ryan Walden]]></dc:creator><pubDate>Tue, 02 Dec 2025 13:37:33 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Y5N7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F852b36d4-1a06-423a-aab9-a3560c4c99c4_300x300.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>In 2021, private equity&#8217;s average deal size pierced through the $1 billion mark <a href="https://www.bain.com/insights/private-equity-market-in-2021-global-private-equity-report-2022/#:~:text=Average%20deal%20size%20pierced%20through%20the%20%241%20billion%20mark%20in%202021%20for%20the%20first%20time%20ever.">for the first time ever</a> in what appeared to be the beginning of yet another golden age. Prices were soaring, markets were hungry, and the cost of debt was near zero. But as time progressed, PE slid into one of the worst downturns in the industry&#8217;s history. PE bankruptcies have soared since 2022 and <a href="https://airtable.com/appEaeJ5qdA3nihOS/shr6rQzTxENrRVnH6/tblFVx0tG5VNExF7E">continue at record levels</a> (e.g <a href="https://www.nytimes.com/2025/08/29/business/spirit-airlines-bankruptcy.html">Spirit Airlines</a> and <a href="https://www.wsj.com/business/first-brands-collapse-patrick-james-306d7869?reflink=desktopwebshare_permalink">First Brands</a> in Q3 2025). Although tariffs have clear responsibility in many of this year&#8217;s downfalls, the recent adjustments of investments into tariff-insensitive essential services threatens the future of many of their existing portfolio companies. The real oversight is PE&#8217;s lack of a thoughtful playbook to lead existing professional services portcos in AI agent transformation. Without successful transformations, PE risks its longstanding reputation in leading digital innovation and positions AI-first competitors to capture that value, only accelerating the bankruptcy trend.</p><p>A recent <a href="https://www.hbs.edu/ris/Publication%20Files/24-070_72f6bfef-d542-437d-9747-bbf708fc11a5.pdf">Harvard Business School working paper</a> provides data-backed evidence that &#8220;private equity investors function as strategic capital allocators, adjusting their investment approaches in response to technological shifts&#8221;. Yet, in <a href="https://www.ey.com/en_us/insights/private-equity/pulse">EY&#8217;s Q3 PE Pulse report</a>, allocations to healthcare, a sector with <a href="https://www.thelancet.com/journals/landig/article/PIIS2589-7500(24)00124-9/fulltext">notoriously strict AI safety standards and regulations</a>, more than doubled year to date. This trend is not unique to Q3, but is instead a thematic pivot of 2025 overall. In reaction to tariff uncertainty, PE has focused latest investments into essential services (e.g. healthcare, utilities, infrastructure), many of which are human labor intensive, physical asset driven, and highly regulated. Because of this, the occupations that underlie these services rank at the <a href="https://arxiv.org/pdf/2303.01157">very bottom</a> of exposure to agentic AI. Despite strategic reorientation towards traditionally safer industries, PE is also rapidly gaining a track record of failures within these sectors as <a href="https://www.spglobal.com/market-intelligence/en/news-insights/articles/2025/8/july-us-corporate-bankruptcy-filings-hit-highest-monthly-total-in-5-years-91873904">research by S&amp;P Global</a> found these sectors responsible for 56% percent of H1 2025 bankruptcies.</p><p>As essential services have become the primary focus, technical leaders within PE have felt side-lined as a result. Many of PE&#8217;s digital leaders neither see the opportunity to usher in agentic transformation to these new investments nor have been issued a clear mandate to guide AI transformation within the existing portfolio. As a result, many leaders are departing to <a href="https://www.linkedin.com/in/valliappalakshmanan/">start their own AI-first companies</a>. Moreover, these positions frequently go unfilled, with Bespoke Partners <a href="https://www.bespokepartners.com/private-equity-talent-report/">recently reporting</a> that demand for C-suite and VP-level digital leadership in the second half of 2025 significantly exceeds available supply. Without playbooks, and losing leaders, the options are quickly waning.</p><p>Meanwhile in big tech, the race towards deploying AI agents continues to gain momentum. Current solutions are already fulfilling the promise of human-like intelligence with major players like IBM <a href="https://www.entrepreneur.com/business-news/ibm-ceo-ai-replaced-hundreds-of-human-resources-staff/491341?utm_source=chatgpt.com">automating 94% of their routine HR tasks</a> and confirming mass layoffs as a direct result. This leaves tech-enabled portfolio companies increasingly anxious of the growing AI-first innovation in both startups and big tech. Portcos in professional services such as insurance, legal services, and HR are most exposed. These sectors spend ~50% of revenue on knowledge workers, the exact roles agents are well positioned to automate. Under this immense pressure of exposure and lacking AI leadership, these companies attempt their own internal AI agent transformation initiatives. Unfortunately, most lack specialized AI engineering talent and their internal teams are already lean, stretched thin on managing existing systems. Pair these shortcoming with the now <a href="https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf">infamous report from MIT</a>, and the odds for success average well below 5%.</p><p>This is creating a strategic inflection point, with the wrong choice ending in the demise of PE&#8217;s reputation as leaders of digital transformation and accelerating bankruptcies in their most exposed portcos. By continuing to lack transformation playbooks, failing to retain top AI leadership, and filling their latest funds with less exposed sectors, they risk undermining the digital leadership LPs expect from them. The choice is clear: adapt now to harness agentic AI, or risk further losses and conceding reputation to a new wave of agile, AI-first competitors. </p><h3>About Rosenblatt</h3><p><a href="https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf">MIT reports</a> that partnering externally on AI-first products brings them live six months sooner and twice as successfully as internal builds. Rosenblatt specializes in AI agent transformation for mid-market, tech-enabled, professional services. We bring together AI leaders from <a href="https://www.linkedin.com/in/hromalik/">big 4 consulting firms</a> and <a href="https://www.linkedin.com/in/owenbwhite/">exited AI startups</a> to lead teams from agent pilots to full production-deployed agents. Click below to schedule a 30-minute portfolio AI exposure assessment with our founder.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://calendly.com/rosenblatt-ai/ai-exposure-assessment&quot;,&quot;text&quot;:&quot;AI Exposure Assessment&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://calendly.com/rosenblatt-ai/ai-exposure-assessment"><span>AI Exposure Assessment</span></a></p>]]></content:encoded></item><item><title><![CDATA[SLMs, The Nesting Dolls of Intelligence]]></title><description><![CDATA[How downsizing intelligence is the clear path forward to successful AI applications]]></description><link>https://substack.rosenblatt.ai/p/slms-the-nesting-dolls-of-intelligence</link><guid isPermaLink="false">https://substack.rosenblatt.ai/p/slms-the-nesting-dolls-of-intelligence</guid><dc:creator><![CDATA[Ryan Walden]]></dc:creator><pubDate>Tue, 11 Nov 2025 14:04:30 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!-P2u!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F07d6d378-4c77-4579-a002-61f01a8e825b_1220x694.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>LLMs are incredibly adept at generalized question answering. But for businesses to extract value, they need to bring their context into the LLM with both high accuracy and specificity. Maintaining the existing quality of service when deploying a new AI app is a top concern for businesses. Great strides have been made towards improving context (e.g. automated evaluations, MCP, RAG, etc.), but one fact remains: LLMs are very slow. Once quality is reached, the next differentiator becomes speed. Today&#8217;s AI engineers are very lucky to be servicing users who expect several seconds of response time for any given question, but as is the hedonic treadmill, that expectation will not last long. Just as context engineering has prevailed in lieu of waiting for better foundation models, heavily prompt optimized SLMs will prevail in lieu of waiting for foundation models.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/3CxK7/1/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/07d6d378-4c77-4579-a002-61f01a8e825b_1220x694.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a1760c95-3b60-4713-8fff-be7795e432ab_1220x764.png&quot;,&quot;height&quot;:377,&quot;title&quot;:&quot;Characteristics of SLMs vs LLMs&quot;,&quot;description&quot;:&quot;&quot;}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/3CxK7/1/" width="730" height="377" frameborder="0" scrolling="no"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><h1>A Brief Recap of AI Engineering</h1><p>For those who were working in AI prior to the release of ChatGPT, deploying a uniquely useful pretrained model without fine-tuning on curated data was extremely unlikely. A handful of embedding models, some CNNs, BERT, YOLO, and CLIP were the only regularly used, pretrained options that come to mind, pre-November-2022. In March 2023, software engineers quickly capitalized on the accessible APIs of ChatGPT to begin building their own GPTs, kicking off a wave of LLM-first software engineering. Now those same engineers are learning data science basics rebranded as &#8220;context engineering&#8221;. Simultaneously, data scientists who have spent years grappling with these complexities have had to revisit the way they approach new projects altogether, now no longer needing anything but a simple prompt to achieve intelligent predictions. The great news is that the solution to reconciling the slow nature of LLMs is answered by leveraging the middle ground between these fields: SLMs.</p><h2>LLM-First Software Engineering</h2><p>LLMs brought the unique capability of solving advanced intelligence problems through prompting alone. This has made the creation of data science applications increasingly more accessible to non-data scientists. The naive process for many software engineers has gone in three steps:</p><ol><li><p>Prompt engineer to demo-able</p></li><li><p>Deploy upon stakeholder approval</p></li><li><p>Adjust prompts based on user complaints and new feature requests</p></li></ol><p>This closely mirrors how software development (when lacking automated testing) has been occurring for years throughout enterprises, startups, and dev shops alike. As time has progressed, more sophisticated patterns have emerged:</p><ol><li><p>Work alongside a subject matter expert to curate an evaluation dataset</p></li><li><p>Leverage experts + LLM-as-a-Judge for model selection and prompt optimization</p></li><li><p>Incorporate evaluations into CI/CD as an intelligence regression test</p></li><li><p>Deploy and collect real conversations to supplement the evaluation dataset</p></li><li><p>Add a Human-in-the-Loop tool for the LLM to ask a human to respond</p></li><li><p>Repeat steps 1 - 4</p></li></ol><p>This is a far-improved approach over the naive process, but still lacks crucial steps learned from decades of real-world observations from traditional pre-trained data-science applications.</p><h2>Traditional Data Science Applications</h2><p>Before deep learning, traditional data science models were not pretrained; they existed only as algorithms to be fit to a dataset provided by the data scientist. The earlier deep learning models that were generally pretrained were incapable of domain-specific, human-like performance through prompting only. Therefore, the common phrase &#8220;a model is only as good as its data&#8221; was universally embraced among data scientists, until the inception of ChatGPT. Revising that data-first mindset, the traditional path to building a traditional data science application was as follows:</p><ol><li><p>Have an application already creating real world data</p></li><li><p>Collect and curate a dataset (e.g. data engineering, cleaning, and sampling)</p></li><li><p>Define a north-star metric (e.g. precision, recall, NDGC, etc.)</p></li><li><p>Experiment with different model options</p></li><li><p>If pretrained:</p><ol><li><p>Prompt Engineer</p></li><li><p>Fine Tune</p></li></ol></li><li><p>If not:</p><ol><li><p>Train from Scratch</p></li><li><p>Hyperparameter Optimization (e.g. Grid, Bayesian)</p></li></ol></li><li><p>Evaluate against a holdout set on the north-star metric</p></li><li><p>Shadow deploy the top model and analyze real world results</p></li><li><p>If shadow performs well, deploy</p></li><li><p>Retrain or fine-tune on new data on a regular schedule (e.g. daily, weekly, monthly)</p></li><li><p>Deploy the updated model if outperforming existing</p></li></ol><p>Notably, an important part of experimenting with different models is right sizing the model. Importantly, large models like transformers require GPU acceleration for high-speed inference, whereas smaller models such as XGBoost can run millisecond inference on a single CPU core. Because of the vastly different costs in self-hosting large vs small models, data scientists are pushed towards finding the most pragmatic balance between complexity, cost, and performance.</p><h1>Solving The Hedonic Treadmill with SLMs</h1><p>In late 2024, leading AI labs began reporting slowing improvements in their frontier models (<a href="https://www.bloomberg.com/news/articles/2024-11-13/openai-google-and-anthropic-are-struggling-to-build-more-advanced-ai">Amodei, A., et al., 2024</a>). Since then, researchers have increasingly demonstrated that Small Language Models (SLMs) with appropriate context engineering can outperform LLMs on the same task (<a href="https://arxiv.org/pdf/2506.02153">Belcak et.al 2025</a>). Notably, both SLMs and LLMs show similarly decreased performance on OOD examples when they are many-shot prompted (<a href="https://arxiv.org/pdf/2509.10414">Wynter 2025</a>). In the context of bringing intelligent applications to market, these facts and trends paint a clear picture of LLMs reaching their potential with marginal intelligence improvements lacking meaningful changes to the user&#8217;s experience. In accordance with the Hedonic Treadmill, as people become comfortable with the intelligence limitations of LLMs, they will begin to desire faster responses, and the universal truth will continue to remain that a smaller model will always respond faster than a larger model. Considering this, we must borrow from the learnings of traditional data science applications and begin applying them to LLM-first software engineering.</p><p>Here&#8217;s a suggested path forward:</p><ol><li><p>Work alongside a subject matter expert to curate an evaluation dataset</p></li><li><p>Leverage experts + LLM-as-a-Judge for model selection and light prompt optimization</p></li><li><p>Incorporate evaluations into CI/CD as an intelligence regression test</p></li><li><p>Deploy and collect real conversations to supplement the evaluation dataset</p></li><li><p>Add a Human-in-the-Loop tool for the LLM to ask a human to respond</p></li><li><p>Repeat steps 1 - 4 with some tweaks:</p><ol><li><p>Do not over optimize the LLM&#8217;s prompt, only adjust as needed</p></li><li><p>Continue heavy LLM-as-a-Judge prompt optimization of the SLMs </p></li><li><p>Detect when a SLM outperforms the LLM</p></li><li><p>Deploy the optimized SLM as the new default</p></li><li><p>Add an LLM-in-the-Loop tool for the SLM to ask the LLM to fallback to</p></li></ol></li></ol><p>By reserving heavy automatic prompt optimization to the SLM, and keeping the LLM&#8217;s prompt highly generalized, you strike a pragmatic balance between complexity, cost, and performance. For In-Distribution data (ID, explained below) data you have the fast and cheap responses of the SLM and for Out-of-Distribution data (OOD) you have the LLM which has stronger generalization capabilities, and for the extraordinary scenario you have the human. In essence, a Russian-nesting doll of intelligence.</p><p>In Distribution - Queries and scenarios that closely match the patterns, domains, and types of problems the model was trained or optimized for. These represent the &#8220;expected&#8221; or typical use cases.</p><p>Out of Distribution - Queries that fall outside the model&#8217;s training distribution&#8212;novel scenarios, edge cases, or uncommon combinations of requirements that the model hasn&#8217;t been specifically prepared to handle.</p><h1>Conclusion</h1><p>If you are not already using this approach, I hope you consider it as your next step towards long term wins with your intelligent application. In some ways, we already see similar approaches being embraced by top foundation model providers such as GPT-5&#8217;s model router design (<a href="https://openai.com/index/gpt-5-system-card/">OpenAI 2025</a>). Better yet, there is some very recent research from a fellow Atlanta local which concludes &#8220;this survey firmly positions SLMs as the default, go-to engine for the majority of agent pipelines, reserving larger LLMs as selective fallbacks for only the most challenging cases&#8221; (<a href="https://www.arxiv.org/pdf/2510.03847">Sharma 2025</a>).</p><h4><strong>Food For Thought</strong></h4><p>For those reading who are familiar with traditional data science or NLP, we can take this nesting doll pattern a step further. Frankly, some questions are truly best solved by simple FAQ responses. After deploying an SLM, you could begin a new pattern of progressively clustering high similarity prompt-response pairs into a general FAQ. When such prompts are sent, FAQ responses could then be retrieved by an embedding model with a high threshold, cosine-similarity match, with low scores escalating to the SLM to fallback to. </p><p>Thank you for your time and I hope you leave some feedback!</p>]]></content:encoded></item></channel></rss>