crossword.page
robots.txt

Robots Exclusion Standard data for crossword.page

Resource Scan

Scan Details

Site Domain crossword.page
Base Domain crossword.page
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-30T03:22:48+00:00
Next Scan 2025-07-29T03:22:48+00:00

Last Successful Scan

Scanned2024-10-03T02:45:36+00:00
URL https://crossword.page/robots.txt
Redirect https://cybv.com/robots.txt
Redirect Domain cybv.com
Redirect Base cybv.com
Domain IPs 104.21.86.137, 172.67.220.90, 2606:4700:3033::ac43:dc5a, 2606:4700:3034::6815:5689
Redirect IPs 104.21.58.91, 172.67.202.136, 2606:4700:3031::6815:3a5b, 2606:4700:3032::ac43:ca88
Response IP 104.21.58.91
Found Yes
Hash f128c8a9647570e6d95f9189479f98e33923a2a31963735d6e7afc63b643a209
SimHash 69155545ed13

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://crossword.page/sitemap.xml

Comments

  • Group 1