Log In Sign Up

pbskids.com
robots.txt

Robots Exclusion Standard data for pbskids.com

Resource Scan

Scan Details

Site Domain pbskids.com
Base Domain pbskids.com
Scan Status Ok
Last Scan2024-05-01T08:08:11+00:00
Next Scan 2024-05-31T08:08:11+00:00

Last Scan

Scanned2024-05-01T08:08:11+00:00
URL http://www.pbskids.com/robots.txt
Redirect https://pbskids.org/robots.txt
Redirect Domain pbskids.org
Redirect Base pbskids.org
Domain IPs 34.237.177.32
Redirect IPs 13.226.210.104, 13.226.210.124, 13.226.210.86, 13.226.210.88, 2600:9000:25ef:2200:1c:c8c6:9740:93a1, 2600:9000:25ef:4c00:1c:c8c6:9740:93a1, 2600:9000:25ef:5a00:1c:c8c6:9740:93a1, 2600:9000:25ef:7000:1c:c8c6:9740:93a1, 2600:9000:25ef:8200:1c:c8c6:9740:93a1, 2600:9000:25ef:9a00:1c:c8c6:9740:93a1, 2600:9000:25ef:9c00:1c:c8c6:9740:93a1, 2600:9000:25ef:e600:1c:c8c6:9740:93a1
Response IP 18.165.171.125
Found Yes
Hash d5d2f24486c9c250b04a9539a09aaec68619148852552aa6358079a76b62805a
SimHash 0864d952e1b3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /cgi-registry/
Disallow /in_your_town/
Disallow /tvschedules/

googlebot

Rule Path
Disallow /cgi-bin/
Allow /cgi-registry/golocal
Disallow /cgi-registry/
Disallow /in_your_town/
Disallow /tvschedules/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top