Databricks co-founder on controlling runaway AI coding costs
Companies pushed their engineers onto AI coding tools fast. Now they’re dealing with the bill. As usage scaled across thousands of developers, many engineering orgs found their AI spend growing in ways that threatened to cancel out the productivity gains.
Databricks hit this problem early and decided to build around it rather than restrict usage. Patrick Wendel, co-founder of Databricks and head of engineering there, shared the team’s approach in a blog post that reached the top of Hacker News.
How Databricks Manages the Cost
Two levers stand out from what Wendel described. First, the team takes advantage of steadily falling model prices as newer, cheaper models arrive. Second, they built automatic routing that sends each request to the cheapest model capable of doing the job well, rather than defaulting every call to the most powerful option.
What the Podcast Covers
Wendel joined Kevin Ball on Software Engineering Daily to go deeper on the topic. The conversation covers:
- Why AI coding costs suddenly spiked across engineering teams
- The main levers available to bring spending under control
- The trade-offs between managing costs at the server level versus inside developer tools
- Why giving AI the right context about how a company actually operates is the next big challenge
If your team is running Cursor, Copilot, or any AI coding assistant at scale and the bills are growing faster than the output, this episode is worth the time.
I’m founder of BizStack at Cagri Sarigoz LLC and a passionate advocate for entrepreneurs.
With over 14 years in tech, marketing, and AI, including my role as Head of SEO at CitizenShipper and co-founder of TaleBot at Intale AI, I’m dedicated to sharing genuine, useful product insights and tips.
At BizStack, I aim to cut through the digital noise to provide clear, actionable advice.
And more than all else, I’m a father to a (always) little girl and a husband.
Contact me at [email protected] for assistance.
