San Francisco Daily 360

collapse
Home / Daily News Analysis / Websites are closing their doors to AI agents

Websites are closing their doors to AI agents

Oct 20, 2026  Twila Rosenbaum 20 views
Websites are closing their doors to AI agents

The pitch is by now familiar: an autonomous AI agent that scours the internet on your behalf, booking dinner reservations, clearing out an inbox, comparing prices, and ordering new shoes while you get on with your day. OpenAI, Meta, Google, and a cluster of well-funded startups have spent the past two years promising exactly that future, and they have shipped the products to back it up.

What they have not shipped is permission. In recent weeks, users of several high-profile agents have reported being blocked from performing tasks across many of the most popular destinations on the web. The walls are going up quietly, one updated terms-of-service page and one bot-detection rule at a time, and they are forcing an uncomfortable question into the open: what happens when much of the internet simply refuses to cooperate?

The list of refusals keeps getting longer

Yelp has made clear that it only permits AI agents operated by companies that pay into its data licensing program. Delta Air Lines has moved to stop agents from booking tickets on behalf of travelers. JPMorgan Chase and Charles Schwab have both confirmed they are blocking agent access to customer accounts, citing security concerns. Users have also reported that services which previously worked with their agents abruptly stopped functioning, including automotive marketplaces and rail booking sites — a pattern suggesting other companies are following suit without public announcements.

The result is a patchwork map of the internet in which a small but growing set of high-value destinations is off limits. The pattern is not random. The sites drawing the hardest lines are the ones where a completed transaction carries real financial value, where account access implies sensitive personal data, or where advertising revenue depends on a human actually looking at a screen.

  • Marketplaces and retail: Agent-driven purchases bypass the browsing, upselling, and ad exposure that fund ecommerce storefronts.
  • Airlines and travel: Ticketing systems are tightly controlled, and agents that book on a customer's behalf complicate liability, fraud screening, and fare rules.
  • Banks and brokerages: Account access is the sharpest red line, with institutions treating robotic sessions as a security and compliance risk rather than a convenience feature.
  • Local and listings services: Businesses that sell their directory and review data want licensing revenue before letting machines read it at scale.

A fight that started long before the current crop of agents

Amazon was already battling agents more than a year before the latest wave of product launches. The company banned an agentic shopping feature built by an AI search startup and sued the firm, arguing that automated purchasing on its site violated its policies. Amazon said at the time that it had repeatedly asked the startup to stop letting its agents shop on the platform, and it framed the dispute as a service-provider's right to decide who participates in its marketplace. Third parties purchasing items on behalf of customers, the company argued, should operate openly and respect those decisions.

The startup pushed back with a very different reading of the same facts. It argued that the real objection was not fraud or security but attention: an AI agent that completes a purchase does not scroll past sponsored listings, does not linger on promotional banners, and does not click through recommendation carousels. In an ad-funded marketplace, the human eyeball is the product being sold alongside the merchandise. The startup likened its agent to an extension of the user — a hired assistant acting on a customer's instructions — and argued that refusing the assistant amounts to refusing the customer's right to delegate.

Courts have now weighed in twice with opposite conclusions. A judge initially ordered the startup to stop letting its agents shop on the site. An appeals court overturned that ruling, allowing the agents to continue while the broader legal questions proceed. The retail giant has since filed an amended complaint, meaning the litigation is likely to grind on and to establish precedent for every other company weighing whether to lock out automated shoppers.

Meanwhile, the agents keep launching

The litigation has done nothing to slow the rollout. Meta's unusually friendly-looking assistant, xAI's Grok, and OpenAI's agent product have all run into the same obstacles. The most prominent clash came when Amazon said Meta's assistant was violating its site policies through continued access, and reports circulated that Grok and other agents were also unable to complete purchases on the platform. One high-profile founder responded to the block by musing publicly about launching a competing ecommerce operation — a suggestion that captures just how much value is at stake if agents become the default front door to online shopping.

For Meta, the answer has been partnership rather than confrontation. The company has struck deals with a roster of major retailers, letting its assistant shop on those sites with explicit permission, and it has argued publicly that turning away a personal agent means turning away the customer standing behind it. The company said it would rather work with businesses to address their underlying concerns than watch them lose the sale. A major commerce platform has taken the same route, opening its network of storefronts to automated agents under agreed terms.

That model — negotiated access instead of scraping — is the emerging compromise. It also carries a cost. If agents can only reach inventory on sites that have signed a deal, then the agent's usefulness is a function of its parent company's business development team, not its model's capabilities.

The anti-bot problem nobody planned for

Even where sites are not deliberately blocking agents, the automation often runs into defenses built for a different enemy. Anti-bot systems are ubiquitous across the web, designed to stop credential stuffing, scraping, card testing, ticket hoarding, and inventory sniping. An autonomous agent driving a browser looks, at the network level, very much like those threats. It moves fast, it does not pause to look at anything, and it completes forms without hesitation.

The collisions are already showing up. Users on community forums have reported account suspensions triggered by what platforms described as suspicious activity shortly after agents were used, while others have described checkout failures on retail sites that had explicitly partnered with an agent maker. As one expert on AI safety evaluation put it, a great deal of web infrastructure was built not to block agents specifically but to block bots and programs that scam or hack — and AI agents trip exactly those same safeguards.

Infrastructure providers have amplified the effect. One major web architecture company introduced a one-click block for AI crawlers, then went further by blocking crawlers that scrape simultaneously for search indexing and for AI training. The motivation is partly philosophical and partly practical: automated traffic strains servers, distorts analytics, floods inboxes with AI-generated mail, and makes it harder for ordinary people to buy concert tickets or secure a reservation against software that never sleeps.

What all of this does to the value of an agent

There is a measurable cost to the standoff, and it lands on the companies selling agents. The central marketing claim for these products is comprehensiveness — that a single assistant can do anything a person can do online. Every blocked checkout and refused login chips away at that claim. As one industry observer put it, if companies are actively working to make sure agents cannot do these things, the perceived value of the biggest AI labs takes a real hit. There are simply fewer useful things the agent can accomplish.

Site operators see the calculation differently. A bank blocking automated account access is protecting against fraud and regulatory exposure. An airline blocking automated ticketing is protecting a system that already struggles with fare abuse. A retailer blocking automated checkout is protecting an advertising model that pays for the free web. A listings service charging for machine access is monetizing the data it spent years compiling. None of these are irrational positions, which is precisely why they are unlikely to disappear.

The likeliest outcome is not a single decisive victory but a slow stratification of the internet into three tiers: sites that welcome agents under negotiated terms, sites that tolerate them and rely on anti-bot systems to keep the volume manageable, and sites that shut them out entirely. Consumers will feel that fragmentation mostly as friction — an agent that works beautifully on one storefront and fails silently on the next.

That friction will also spread to humans. As sites incrementally harden their defenses against automated traffic, the verification challenges designed to separate people from bots will proliferate, moving from banks and ticket sellers into everyday destinations like grocery ordering and appointment scheduling. Users may find themselves repeatedly proving they are human just to complete routine tasks, jumping through loops that exist because the machines became too convincing to distinguish. The agents were supposed to remove clicks from our lives; for now, they appear to be adding them.


Source:The Verge News


Share:

Your experience on this site will be improved by allowing cookies Cookie Policy