Log In Sign Up

crosstitch.com
robots.txt

Robots Exclusion Standard data for crosstitch.com

Resource Scan

Scan Details

Site Domain crosstitch.com
Base Domain crosstitch.com
Scan Status Ok
Last Scan2024-05-29T04:37:56+00:00
Next Scan 2024-06-28T04:37:56+00:00

Last Scan

Scanned2024-05-29T04:37:56+00:00
URL https://crosstitch.com/robots.txt
Redirect https://www.crosstitch.com/robots.txt
Redirect Domain www.crosstitch.com
Redirect Base crosstitch.com
Domain IPs 18.154.132.107, 18.154.132.32, 18.154.132.54, 18.154.132.79, 2600:9000:2778:200:f:96c8:f640:93a1, 2600:9000:2778:3400:f:96c8:f640:93a1, 2600:9000:2778:3a00:f:96c8:f640:93a1, 2600:9000:2778:600:f:96c8:f640:93a1, 2600:9000:2778:7a00:f:96c8:f640:93a1, 2600:9000:2778:8600:f:96c8:f640:93a1, 2600:9000:2778:b600:f:96c8:f640:93a1, 2600:9000:2778:e400:f:96c8:f640:93a1
Redirect IPs 13.33.88.47, 13.33.88.52, 13.33.88.70, 13.33.88.79, 2600:9000:223b:1600:f:163d:8000:93a1, 2600:9000:223b:1800:f:163d:8000:93a1, 2600:9000:223b:2400:f:163d:8000:93a1, 2600:9000:223b:7400:f:163d:8000:93a1, 2600:9000:223b:9600:f:163d:8000:93a1, 2600:9000:223b:e200:f:163d:8000:93a1, 2600:9000:223b:e400:f:163d:8000:93a1, 2600:9000:223b:ea00:f:163d:8000:93a1
Response IP 13.33.88.52
Found Yes
Hash 642cc4188ae9cc2765ae13a4d096edd7df971eb9292581d16bbd9bb054408313
SimHash 41004645fd13

Groups

*

Rule Path
Allow /cgi-bin/msg22.pl
Disallow /cgi-bin/
Disallow /app/
Disallow /help/
Disallow /company.html
Disallow /adminb2/
Back to top

Other Records

Field Value
sitemap http://www.crosstitch.com/sitemap.xml
Back to top