THE PRODUCT PROBLEM
In the rapidly evolving landscape of AI-driven search, the traditional model of web discovery is under threat. Users and businesses alike are facing a dilemma: AI search engines provide instant answers, bypassing the need for users to visit the original content creators' sites. This shift undermines the fundamental business model where visibility equates to revenue generation through ads, subscriptions, or audience engagement. The pressing issue is how to maintain discoverability and fair compensation for content creators when AI summaries reduce user clicks on traditional search results. The competitive pressure is mounting as AI becomes the default mode of search, forcing a reevaluation of how content creators can sustain their business models in this new era.
THE DECISION
The strategic decision was to develop new bot options that give customers more control over their site's accessibility and usage by AI. This move required alignment between product management, engineering, and commercial teams to ensure that the solution not only protected content but also laid the groundwork for a new economic model. The tradeoff involved was significant: while blocking AI crawlers could protect content, it doesn't solve the underlying issue of monetization and discoverability. The challenge was to balance content protection with the need to innovate and redefine the business model to ensure creators are compensated fairly. Aligning these diverse teams was complex, as it required a shared vision of both immediate protection and long-term transformation.
THE LESSON
This initiative highlights a crucial aspect of PM and engineering collaboration that isn't often discussed: the necessity of simultaneously defending existing business models while innovating new ones. The engineering solution of bot control was only a part of the puzzle; the real challenge lay in using this as a stepping stone towards a broader strategic shift. It underscores the importance of PMs not just in aligning internal teams, but in envisioning and driving the creation of new economic frameworks. This case illustrates that product decisions are not just about solving immediate technical problems but about anticipating and shaping future market dynamics, requiring a deep partnership with engineering to execute effectively.