---
title: "Perplexity accused of scraping websites that explicitly blocked AI scraping"
description: "AI startup Perplexity is accused by Cloudflare of scraping content from websites that have explicitly blocked such actions. Cloudflare's research indicates that Perplexity has been circumventing these"
type: "news"
locale: "en"
url: "https://longbridge.com/en/news/251491710.md"
published_at: "2025-08-04T15:47:05.000Z"
---

# Perplexity accused of scraping websites that explicitly blocked AI scraping

> AI startup Perplexity is accused by Cloudflare of scraping content from websites that have explicitly blocked such actions. Cloudflare's research indicates that Perplexity has been circumventing these blocks by altering its bots' user agents and network identifiers. Despite Perplexity's spokesperson dismissing the claims, Cloudflare confirmed the activity across numerous domains. This incident follows previous allegations against Perplexity for unauthorized scraping and plagiarism. Cloudflare has since taken measures to block Perplexity's bots and launched a marketplace for website owners to charge AI scrapers.

AI startup Perplexity is crawling and scraping content from websites that have explicitly indicated they don’t want to be scraped, according to internet infrastructure provider Cloudflare.

On Monday, Cloudflare published research saying it observed the AI startup ignore blocks and hide its crawling and scraping activities. The network infrastructure giant accused Perplexity of obscuring its identity when trying to scrape web pages “in an attempt to circumvent the website’s preferences,” Cloudflare’s researchers wrote.

AI products like those offered by Perplexity rely on gobbling up large amounts of data from the internet, and AI startups have long scraped text, images, and videos from the internet many times without permission to make their products work. In recent times, websites have tried to fight back by using the web standard Robots.txt file, which tells search engines and AI companies which pages can be indexed and which shouldn’t, efforts that have seen mixed results so far.

Perplexity appears to be willingly circumventing these blocks by changing its bots “user agent,” meaning a signal that identifies a website visitor by their device and version type; as well as changing their autonomous system networks, or ASN, essentially a number that identifies large networks on the internet, according to Cloudflare.

“This activity was observed across tens of thousands of domains and millions of requests per day. We were able to fingerprint this crawler using a combination of machine learning and network signals,” read Cloudflare’s post.

Perplexity spokesperson Jesse Dwyer dismissed Cloudflare’s blog post as a “sales pitch,” adding in an email to TechCrunch that the screenshots in the post “show that no content was accessed.” In a follow-up email, Dwyer claimed the bot named in the Cloudflare blog “isn’t even ours.”

Cloudflare said it first noticed the behavior after its customers complained that Perplexity was crawling and scraping their sites, even after they added rules on their Robots file and for specifically blocking Perplexity’s known bots. Cloudflare said it then performed tests to check and confirmed that Perplexity was circumventing these blocks.

Techcrunch event

San Francisco | October 27-29, 2025

“We observed that Perplexity uses not only their declared user-agent, but also a generic browser intended to impersonate Google Chrome on macOS when their declared crawler was blocked,” according to Cloudflare.

The company also said that it has de-listed Perplexity’s bots from its verified list and added new techniques to block them.

Cloudflare has recently taken a public stance against AI crawlers. Last month, Cloudflare announced the launch of a marketplace allowing website owners and publishers to charge AI scrapers who visit their sites. Cloudflare’s chief executive Matthew Prince sounded the alarm at the time, saying AI is breaking the business model of the internet, particularly publishers. Last year, Cloudflare also launched a free tool to prevent bots from scraping websites to train AI.

This is not the first time Perplexity is accused of scraping without authorization.

Last year, news outlets, such as Wired, alleged Perplexity was plagiarizing their content. Weeks later, Perplexity’s CEO Aravind Srinivas was unable to immediately answer when asked to provide the company’s definition of plagiarism during an interview with TechCrunch’s Devin Coldewey at the Disrupt 2024 conference.

### Related Stocks

- [NET.US - CloudFlare](https://longbridge.com/en/quote/NET.US.md)

## Related News & Research

| Title | Description | URL |
|-------|-------------|-----|
| OVHcloud Acquires Seald to Boost Data Security | OVHcloud has acquired Seald, a French company specializing in end-to-end encryption technologies, to enhance its data se | [Link](https://longbridge.com/en/news/273676715.md) |
| Cloudflare (NET) stock analysis 2021 \| High growth SaaS stock (Q2 earnings) | Cloudflare (NET) reported Q2 2021 earnings, surpassing both its own forecasts and analyst expectations. The company is e | [Link](https://longbridge.com/en/news/272915991.md) |
| ConocoPhillips considers selling Permian assets worth $2 billion, Bloomberg News reports | Feb 20 (Reuters) - ConocoPhillipsis exploring a sale of some of its Permian Basin assets as part of a broader streamlini | [Link](https://longbridge.com/en/news/276478732.md) |
| IronBridge Private Wealth LLC Has $905,000 Holdings in Apple Inc. $AAPL | IronBridge Private Wealth LLC reduced its stake in Apple Inc. (NASDAQ:AAPL) by 77.3% in Q3, holding 3,555 shares valued  | [Link](https://longbridge.com/en/news/276436345.md) |
| Inflation rose more quickly than expected in December | Inflation rose more quickly than expected in December | [Link](https://longbridge.com/en/news/276463362.md) |

---

> **Disclaimer**: This article is for reference only and does not constitute any investment advice.
