Skip to Content Facebook Feature Image

New Fastly Threat Research Reveals AI Crawlers Make Up Almost 80% of AI Bot Traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic

News

New Fastly Threat Research Reveals AI Crawlers Make Up Almost 80% of AI Bot Traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic
News

News

New Fastly Threat Research Reveals AI Crawlers Make Up Almost 80% of AI Bot Traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic

2025-08-19 20:29 Last Updated At:20:40

SAN FRANCISCO--(BUSINESS WIRE)--Aug 19, 2025--

Fastly, Inc. (NYSE: FSLY), a leader in global edge cloud platforms, today released its Q2 2025 Threat Insights Report, exposing a striking shift in the nature and scale of automated web traffic. Analysis of traffic from mid-April to mid-July shows that AI crawlers made up almost 80% of all AI bot traffic observed, with Meta generating more than half and eclipsing both Google and OpenAI combined.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20250819795455/en/

Fetcher bots–those that access website content in response to user actions–including those used by ChatGPT and Perplexity, are also driving massive real-time request volumes. In some cases, fetcher request volume exceeds 39,000 requests per minute. This surge is putting pressure on unprotected origin infrastructure, consuming bandwidth, overwhelming servers and mimicking the effects of DDoS attacks, even without malicious intent. North America receives a heavy skew of AI crawler traffic, accounting for nearly 90% of observed activity. Every other region, including Europe, Asia, and Latin America, sees a significantly smaller share, signalling a growing geographic bias in LLM training datasets and raising questions about the long-term neutrality of AI model outputs.

Fastly’s Q1 2025 report found that automated bot traffic already represented 37% of observed activity across Fastly’s global network. While previous concerns centered on the volume of automated traffic, the Q2 data highlights the nature of that traffic, with AI bots now presenting a more complex challenge to security, performance, and operational resilience.

Drawing on 6.5 trillion monthly requests 1 across Fastly’s Next-Gen WAF and Bot Management products, the findings offer a detailed view of how AI-driven automation is reshaping online traffic. With visibility into over 130,000 applications and APIs 2 across a wide range of industries including e-commerce, media, financial services, and technology, Fastly’s insights shed light on the evolving battleground for web security and control.

Additional findings include:

“AI Bots are reshaping how the internet is accessed and experienced, introducing new complexities for digital platforms,” said Arun Kumar, Senior Security Researcher at Fastly. “Whether scraping for training data or delivering real-time responses, these bots create new challenges for visibility, control, and cost. You can’t secure what you can’t see, and without clear verification standards, AI-driven automation risks are becoming a blind spot for digital teams. Businesses need the tools and insights to manage automated traffic with the same precision and urgency as any other infrastructure or security risk.”

The report calls for more transparent bot verification, clearer signalling by bot operators, and smarter bot management strategies. Without them, organizations face growing exposure to shadowy automation, attribution gaps and escalating infrastructure costs.

To read the complete report, visit https://learn.fastly.com/Security-Threat-Insights-Report.

About Fastly, Inc.

Fastly’s powerful and programmable edge cloud platform helps the world’s top brands deliver online experiences that are fast, safe, and engaging through edge compute, delivery, security, and observability offerings that improve site performance, enhance security, and empower innovation at global scale. Compared to other providers, Fastly’s powerful, high-performance, and modern platform architecture empowers developers to deliver secure websites and apps with rapid time-to-market and demonstrated, industry-leading cost savings. Organizations around the world trust Fastly to help them upgrade the internet experience, including Reddit, Neiman Marcus, Universal Music Group, and SeatGeek. Learn more about Fastly at https://www.fastly.com, and follow us @fastly.

Source: Fastly, Inc.

Fastly's latest Threat Insights Report spotlights AI bot behavior.

Fastly's latest Threat Insights Report spotlights AI bot behavior.

HONG KONG (AP) — Hong Kong officials on Wednesday proposed expanding oversight of building maintenance projects and stronger fire safety steps after a blaze in November killed at least 161 people and displaced thousands.

The blaze that spread across seven towers in an apartment complex raised questions about corruption, negligence and government oversight in the city's building maintenance projects, piling pressure on Hong Kong leader John Lee’s administration and Beijing’s “patriots-only” governance system for the city.

In the newly elected legislature's first meeting, Lee said the fire exposed the need for reform and pledged that the investigation by law enforcement agencies and a judge-led independent committee would be thorough.

“We will fairly pursue accountability and take disciplinary action based on facts against anyone who should bear responsibility, regardless of whether they are from within or outside the government, or whether they are junior or senior staff,” Lee said.

To combat bid-rigging, Lee's administration proposed that the Urban Renewal Authority play a greater role in helping homeowners choose contractors for building maintenance projects.

Officials planned to set up a preselected list of consultants and contractors based on official background checks and past reviews from homeowners. The authority would facilitate homeowners in tendering and bid evaluation more.

The government also suggested requiring big renovation projects to hire a third-party professional to supervise the work, necessitating fire department's approval before shutting down major fire safety installations, and banning smoking on any construction site.

Proposals for law changes linked to the smoking ban were expected to be submitted for the legislature's review within the next few weeks, while officials were still discussing some of the other suggestions with the Urban Renewal Authority.

Authorities have pointed to substandard netting and foam boards installed during renovations at the Wang Fuk Court apartment complex as factors that contributed to the fire in November. They also said some fire alarms did not work in tests.

Political analysts and observers worried the tragedy could be the “tip of an iceberg" in Hong Kong, a city whose skyline is built on high-rise buildings. Suspicions of bid-rigging and use of hazardous construction materials in renovation projects across other housing estates have left many fearing the disaster could be repeated.

A man walks past the burnt buildings after a deadly fire that started Wednesday at Wang Fuk Court, a residential estate in the Tai Po district of Hong Kong's New Territories, Friday, Nov. 28 2025. (AP Photo/Ng Han Guan)

A man walks past the burnt buildings after a deadly fire that started Wednesday at Wang Fuk Court, a residential estate in the Tai Po district of Hong Kong's New Territories, Friday, Nov. 28 2025. (AP Photo/Ng Han Guan)

FILE - Smoke rises after a fire broke out at Wang Fuk Court, a residential estate in the Tai Po district of Hong Kong's New Territories, Nov. 26 2025. (AP Photo/Chan Long Hei, File)

FILE - Smoke rises after a fire broke out at Wang Fuk Court, a residential estate in the Tai Po district of Hong Kong's New Territories, Nov. 26 2025. (AP Photo/Chan Long Hei, File)

Recommended Articles