scholar.google.nl
robots.txt

Robots Exclusion Standard data for scholar.google.nl

Resource Scan

Scan Details

Site Domain scholar.google.nl
Base Domain google.nl
Scan Status Ok
Last Scan2025-05-16T07:26:24+00:00
Next Scan 2025-06-15T07:26:24+00:00

Last Scan

Scanned2025-05-16T07:26:24+00:00
URL https://scholar.google.nl/robots.txt
Domain IPs 142.251.12.103, 142.251.12.104, 142.251.12.105, 142.251.12.106, 142.251.12.147, 142.251.12.99
Response IP 172.253.118.147
Found Yes
Hash c30f4b2fe5dcc4b51dc6c5e06bce15dc28b220c42e91f4c709d749cae4968385
SimHash a927d4209ef1

Groups

*

Rule Path
Disallow /search
Disallow /index.html
Disallow /scholar
Disallow /citations?
Allow /citations?user=
Disallow /citations?*cstart=
Disallow /citations?user=*%40
Disallow /citations?user=*%40
Allow /citations?view_op=list_classic_articles
Allow /citations?view_op=metrics_intro
Allow /citations?view_op=new_profile
Allow /citations?view_op=sitemap
Allow /citations?view_op=top_venues

twitterbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

petalbot

Rule Path
Disallow /