Log In Sign Up

pbskids.org
robots.txt

Robots Exclusion Standard data for pbskids.org

Resource Scan

Scan Details

Site Domain pbskids.org
Base Domain pbskids.org
Scan Status Ok
Last Scan2024-05-04T12:46:43+00:00
Next Scan 2024-05-18T12:46:43+00:00

Last Scan

Scanned2024-05-04T12:46:43+00:00
URL https://pbskids.org/robots.txt
Domain IPs 18.239.199.111, 18.239.199.37, 18.239.199.58, 18.239.199.91, 2600:9000:201d:1400:1c:c8c6:9740:93a1, 2600:9000:201d:2200:1c:c8c6:9740:93a1, 2600:9000:201d:2800:1c:c8c6:9740:93a1, 2600:9000:201d:4c00:1c:c8c6:9740:93a1, 2600:9000:201d:8c00:1c:c8c6:9740:93a1, 2600:9000:201d:9400:1c:c8c6:9740:93a1, 2600:9000:201d:cc00:1c:c8c6:9740:93a1, 2600:9000:201d:e400:1c:c8c6:9740:93a1
Response IP 18.165.171.62
Found Yes
Hash d5d2f24486c9c250b04a9539a09aaec68619148852552aa6358079a76b62805a
SimHash 0864d952e1b3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /cgi-registry/
Disallow /in_your_town/
Disallow /tvschedules/

googlebot

Rule Path
Disallow /cgi-bin/
Allow /cgi-registry/golocal
Disallow /cgi-registry/
Disallow /in_your_town/
Disallow /tvschedules/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top