blockworks.co
robots.txt

Robots Exclusion Standard data for blockworks.co

Resource Scan

Scan Details

Site Domain blockworks.co
Base Domain blockworks.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-19T22:32:57+00:00
Next Scan 2024-10-17T22:32:57+00:00

Last Successful Scan

Scanned2023-09-24T22:07:12+00:00
URL https://blockworks.co/robots.txt
Domain IPs 104.22.4.162, 104.22.5.162, 172.67.7.42, 2606:4700:10::6816:4a2, 2606:4700:10::6816:5a2, 2606:4700:10::ac43:72a
Response IP 104.22.4.162
Found Yes
Hash d3509595da2d3d08acfb7b6da9a7d1dbbe333f3b7c4f4464f345e2a8e04c1ca9
SimHash 65048055c521

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://blockworks.co/sitemap.xml
sitemap https://blockworks.co/news-sitemap-index.xml
sitemap https://blockworks.co/price-sitemap-index.xml
sitemap https://blockworks.co/tags-sitemap-index.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.