scholar.google.com.br
robots.txt

Robots Exclusion Standard data for scholar.google.com.br

Resource Scan

Scan Details

Site Domain scholar.google.com.br
Base Domain google.com.br
Scan Status Ok
Last Scan2024-09-13T04:54:53+00:00
Next Scan 2024-10-13T04:54:53+00:00

Last Scan

Scanned2024-09-13T04:54:53+00:00
URL https://scholar.google.com.br/robots.txt
Domain IPs 74.125.200.103, 74.125.200.104, 74.125.200.105, 74.125.200.106, 74.125.200.147, 74.125.200.99
Response IP 142.251.12.147
Found Yes
Hash c30f4b2fe5dcc4b51dc6c5e06bce15dc28b220c42e91f4c709d749cae4968385
SimHash a927d4209ef1

Groups

*

Rule Path
Disallow /search
Disallow /index.html
Disallow /scholar
Disallow /citations?
Allow /citations?user=
Disallow /citations?*cstart=
Disallow /citations?user=*%40
Disallow /citations?user=*%40
Allow /citations?view_op=list_classic_articles
Allow /citations?view_op=metrics_intro
Allow /citations?view_op=new_profile
Allow /citations?view_op=sitemap
Allow /citations?view_op=top_venues

twitterbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

petalbot

Rule Path
Disallow /