aurorascans.com
robots.txt

Robots Exclusion Standard data for aurorascans.com

Resource Scan

Scan Details

Site Domain aurorascans.com
Base Domain aurorascans.com
Scan Status Ok
Last Scan2025-05-18T09:50:17+00:00
Next Scan 2025-06-17T09:50:17+00:00

Last Scan

Scanned2025-05-18T09:50:17+00:00
URL https://aurorascans.com/robots.txt
Domain IPs 104.21.77.31, 172.67.203.253, 2606:4700:3033::6815:4d1f, 2606:4700:3034::ac43:cbfd
Response IP 104.21.77.31
Found Yes
Hash 49efb5ddf89f257ba28579823b39263f69d660fad62f8a755ca5b7fcfde62b55
SimHash 69149a808631

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /dashboard

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • *
  • *
  • Sitemaps