natgeokids.com
robots.txt

Robots Exclusion Standard data for natgeokids.com

Resource Scan

Scan Details

Site Domain natgeokids.com
Base Domain natgeokids.com
Scan Status Ok
Last Scan2024-05-17T16:35:41+00:00
Next Scan 2024-06-16T16:35:41+00:00

Last Scan

Scanned2024-05-17T16:35:41+00:00
URL https://natgeokids.com/robots.txt
Redirect https://kids.nationalgeographic.com/robots.txt
Redirect Domain kids.nationalgeographic.com
Redirect Base nationalgeographic.com
Domain IPs 75.2.26.191, 99.83.251.4
Redirect IPs 13.33.88.101, 13.33.88.126, 13.33.88.64, 13.33.88.97
Response IP 13.33.88.126
Found Yes
Hash 5be76f6b650ce2e649cdd44eed7c476709285d66a04fa57636fafa0873572352
SimHash 301e39405973

Groups

*

Rule Path
Disallow /*.swf$
Disallow /*eid%3D
Disallow /*email%3D
Disallow /*intcmp%3D
Disallow /*ngc%3D
Disallow /*referrer%3D
Disallow /search*
Disallow /*widgets%3D
Disallow /admin*

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /