Reddit has initiated legal action against four data-scraping companies, notably targeting AI search engine Perplexity and SEO data firm SerpApi. The platform alleges that these companies have been illegally using its content. They are specifically scraping data from Google search results at an ‘industrial scale.’ This accusation highlights a growing concern among online platforms regarding the unauthorized use of their content by external parties.

In its lawsuit, Reddit emphasizes the impact of these practices on its community and overall business model. These companies access and repurpose content without permission. They undermine Reddit’s efforts to keep a secure and original environment for users. They also jeopardize the intellectual property rights that the platform seeks to protect. The outcome of this lawsuit will set a significant precedent. It will define the boundaries of content scraping. It may also determine the legal rights of digital platforms to safeguard their data against unauthorized use. This issue is particularly relevant in an era where AI and advanced algorithms exploit available web content. This raises ethical questions about data ownership. It also brings up legal questions about fair use.

The lawsuit. SerpApi, Oxylabs, AWMProxy, and Perplexity devised a scheme. They scraped Reddit data indirectly from Google. They then resold or reused it to train AI models. That’s according to Reddit’s lawsuit, filied today in the U.S. District Court for the Southern District of New York.

• Reddit alleged the companies hid their identities to bypass technical restrictions and scraped its data “at an industrial scale.”
• Reddit is seeking financial damages, a permanent injunction, and a ban on using or selling earlier scraped data.
• SerpAPI was or is a customer of OpenAI, which explained how Google search results sometimes appeared in ChatGPT.

Why Reddit sued. Reddit already licenses its data to OpenAI and Google. However, others have tried to sidestep those deals. This leads to concerns about misuse of their extensive user-generated content. The platform argues that such actions not only undermine their agreements. They also violate the trust of their community. This community contributes valuable insights and discussions. By taking legal action, Reddit aims to protect its intellectual property. They want to ensure that all companies utilizing its data comply with their licensing terms. This fosters a more transparent. It also promotes an equitable digital environment.

• The complaint claims Reddit even “set a trap” for Perplexity, creating a test post only visible to Google’s crawler. Within hours, that post appeared in Perplexity search results. This was evidence that the company relied on scraped Google data, Reddit said.

Why you should care. It’s harder than ever for SEOs and site owners to access reliable search data. This has become a significant challenge in the digital landscape. Google is cracking down on scraping and tightening APIs, implementing stricter measures to protect its data and ensure fair usage. At the same time, websites are seeing traffic drop from AI overviews. Zero-click results are creating a shift. This shift impacts traditional SEO strategies. The result: less visibility, fewer insights, and a tougher environment to understand or influence AI search. This transformation requires a more adaptive approach from site owners and marketers. They must navigate these intricacies while trying to optimize their online presence. In essence, the landscape is evolving rapidly, and staying informed and proactive is key to thriving under these new dynamics.

Meanwhile. Reddit and Google are reportedly discussing a new partnership. This partnership would weave Reddit content more directly into Google’s AI products. The goal is to create a seamless integration that enhances user experience. If those talks advance, more Reddit discussions will surface in AI Overviews. They will provide richer context and diverse perspectives. This can improve the quality of information available to users. These discussions may appear in other Google experiences. They could show up in search results and Google Assistant responses. This would expand their reach and influence. This collaboration will enhance the information landscape. It will change how Reddit and Google influence your brand visibility and traffic. Businesses can tap into a more engaged audience. This audience values community-driven insights.

The big picture. AI scraping continues to rise, but it still isn’t sending meaningful visitors back to websites. Data from TollBit highlights a significant disparity in web traffic generation. It reveals that Google sends 831 times more visitors than AI systems. AI technology advancements have made it possible to efficiently gather vast amounts of data. However, the traffic it generates often lacks quality and intent. Therefore, businesses and marketers are left to grapple with the challenge of converting AI-driven traffic into tangible engagement and conversions. As a result, there remains a critical need for optimizing strategies. These strategies should ensure that AI complements traditional techniques. It should do this rather than replacing the methods of attracting and retaining visitors.

• Cloudflare shared data in July highlighting the skewed ratio of crawls compared to the number of visitors sent to a website:
  • Google: 18:1
  • OpenAI: 1,500:1
  • Anthropic: 60,000:1
• Google and content creators used to work symbiotically. However, that relationship has turned adversarial. This shift occurred since the emergence of generative AI. The rise of zero clicks and the decline of organic traffic have contributed to this change.

The New York Times report. Reddit Accuses ‘Data Scraper’ Companies of Stealing Its Information (subscription required)