Does Google-NotebookLM respect robots.txt?

Not documented. No operator statement says whether Google-NotebookLM reads robots.txt, so add the rule but verify in your logs that the requests actually stop.

How do I verify a request really came from Google-NotebookLM?

Fetches a URL a NotebookLM user pasted in. Google groups this with its user-triggered fetchers, which have their own range file. The reference is published at https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers-google.json.

How do I block Google-NotebookLM?

Add these user-agent tokens (Google-NotebookLM, NotebookLM) to robots.txt with Disallow: /. If the crawler ignores robots.txt, match the user agent at your CDN or reverse proxy and return 403 there instead.

IPScanner

Assistant fetchers

Google-NotebookLM

Google-NotebookLM is a bot operated by Google that fetches single pages on demand for an AI assistant. Google-NotebookLM is an AI-powered research and note-taking assistant that helps users synthesize information from uploaded sources like documents, transcripts, or web co…. Whether it honours robots.txt is undocumented, and a request claiming to be Google-NotebookLM can be checked against a published IP range file.

Also seen as NotebookLM. Rules need to cover every token.

Google-NotebookLM at a glance

Reference data for the Google-NotebookLM crawler
User agent	`Google-NotebookLM` Token only. The operator has not published a full user-agent string, so match on the substring rather than an exact header.
Operator	Google
Purpose	Assistant fetchers
Respects robots.txt	Not documented
Verification method	Published IP range file Fetches a URL a NotebookLM user pasted in. Google groups this with its user-triggered fetchers, which have their own range file. https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers-google.json
Crawl pattern	Not published
Robots.txt tokens	`Google-NotebookLMNotebookLM`
Operator documentation	https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers

Google-NotebookLM is an AI-powered research and note-taking assistant that helps users synthesize information from uploaded sources like documents, transcripts, or web co…

robots.txt

Allow or block Google-NotebookLM

Paste one of these into the robots.txt file at the root of your domain. Rules are per token, so a block on one crawler leaves every other bot untouched.

Block Google-NotebookLM

User-agent: Google-NotebookLM
User-agent: NotebookLM
Disallow: /

Blocks every path for this crawler only.

Allow Google-NotebookLM

User-agent: Google-NotebookLM
User-agent: NotebookLM
Allow: /

Explicit allow. Useful when a wildcard rule above it would otherwise catch this crawler.

Allow, except the pages you never want quoted

User-agent: Google-NotebookLM
User-agent: NotebookLM
Allow: /
Disallow: /account/
Disallow: /checkout/
Disallow: /search

Edit the Disallow paths to match your own account, checkout and search URLs.

What blocking actually costs you

Blocking Google-NotebookLM means a person who asks about one of your URLs gets an error instead of a summary. That is a support and reputation trade-off, not a training one.

Block every crawler in the directory at once

Verification

Is that really Google-NotebookLM?

A user-agent header is a string the client chooses. Scrapers copy Google-NotebookLM precisely because site owners allow it. Fetches a URL a NotebookLM user pasted in. Google groups this with its user-triggered fetchers, which have their own range file.

Paste the IP address from your access log below. You will see whether it belongs to a hosting provider, a residential proxy pool or a Tor exit, plus the ASN that announces it, which is what tells you whether the claim holds up.

Datacenter IP detectionNearly every real AI crawler egresses from cloud ranges. A residential IP claiming to be one is the first thing to check.IP reputation checkSee whether the address behind a fake crawler hit has a history of abuse elsewhere.Residential proxy detectionScrapers that get blocked by user agent often come back through residential proxy pools.

Other crawlers run by Google

Gemini-Deep-ResearchAssistant fetchers Google-AgentAutonomous agents Google-CloudVertexBotAutonomous agents Google-ExtendedTraining crawlers Google-FirebaseOther automated crawlers Google-Gemini-CLICoding agents

Related crawlers

Gemini-Deep-ResearchGoogle · Assistant fetchers Google-AgentGoogle · Autonomous agents Google-CloudVertexBotGoogle · Autonomous agents Amzn-UserAmazon · Assistant fetchers ChatGPT-UserOpenAI · Assistant fetchers

Agentscan

Identify crawlers automatically instead of by hand

Agentscan checks a request against published crawler ranges, reverse DNS and hosting data, then returns a verdict your edge can act on. One call per request, no range files to keep up to date.

How Agentscan works API reference Pricing What is my IP

FAQ