thecryptogem.com
robots.txt

Robots Exclusion Standard data for thecryptogem.com

Resource Scan

Scan Details

Site Domain thecryptogem.com
Base Domain thecryptogem.com
Scan Status Ok
Last Scan2025-08-30T19:08:49+00:00
Next Scan 2025-09-06T19:08:49+00:00

Last Scan

Scanned2025-08-30T19:08:49+00:00
URL https://thecryptogem.com/robots.txt
Domain IPs 104.21.55.133, 172.67.148.49, 2606:4700:3031::6815:3785, 2606:4700:3034::ac43:9431
Response IP 104.21.55.133
Found Yes
Hash a7d25598ccd4be9b5907a9fa3acd30ba5c5b150ef7885bd244683cbedf48bfcf
SimHash 6b5485714631

Groups

*

Rule Path
Allow /
Allow /api/og/*

Other Records

Field Value
sitemap https://thecryptogem.com/sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.