my.epic.leapevent.tech
robots.txt

Robots Exclusion Standard data for my.epic.leapevent.tech

Resource Scan

Scan Details

Site Domain my.epic.leapevent.tech
Base Domain leapevent.tech
Scan Status Ok
Last Scan2025-07-01T11:51:18+00:00
Next Scan 2025-07-31T11:51:18+00:00

Last Scan

Scanned2025-07-01T11:51:18+00:00
URL https://my.epic.leapevent.tech/robots.txt
Domain IPs 104.18.20.102, 104.18.21.102, 2606:4700::6812:1466, 2606:4700::6812:1566
Response IP 104.18.21.102
Found Yes
Hash 53d3f2d0e770701fd8125fc042910a31eb3dc50c8ab21fab3e56845c0baa1feb
SimHash 7835c804d7d1

Groups

ia_archiver

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Comments

  • Block the Wayback Machine (archive.org)
  • Additional common crawlers to block
  • Prevent any other crawlers from accessing the site