news.sandbox.google.com
robots.txt

Robots Exclusion Standard data for news.sandbox.google.com

Resource Scan

Scan Details

Site Domain news.sandbox.google.com
Base Domain google.com
Scan Status Ok
Last Scan2024-05-02T13:28:12+00:00
Next Scan 2024-05-16T13:28:12+00:00

Last Scan

Scanned2024-05-02T13:28:12+00:00
URL https://news.sandbox.google.com/robots.txt
Domain IPs 2404:6800:4003:c1a::451, 64.233.170.81
Response IP 172.253.118.81
Found Yes
Hash 4e4276b270d24b039b5b763da6da4890143a5ef116e9dce48e99b316b62f662d
SimHash 8856b87a8035

Groups

*

Rule Path
Disallow /
Disallow /search?
Disallow /search/?
Allow /$
Allow /?
Allow /nwshp$
Allow /news$
Allow /news/$
Allow /news/?gl=
Allow /news/?hl=
Allow /news/?ned=
Allow /about$
Allow /about?
Allow /about/
Allow /topics/
Allow /publications/
Allow /stories/
Allow /swg/
Allow /covid19/

googlebot

Rule Path
Disallow /topics/
Disallow /publications/
Disallow /stories/
Disallow /articles/
Disallow /rss/
Disallow /atom/