rift.events
robots.txt

Robots Exclusion Standard data for rift.events

Resource Scan

Scan Details

Site Domain rift.events
Base Domain rift.events
Scan Status Ok
Last Scan2025-11-28T03:03:41+00:00
Next Scan 2025-12-28T03:03:41+00:00

Last Scan

Scanned2025-11-28T03:03:41+00:00
URL https://rift.events/robots.txt
Domain IPs 104.21.67.218, 172.67.181.102, 2606:4700:3031::ac43:b566, 2606:4700:3033::6815:43da
Response IP 104.21.67.218
Found Yes
Hash 96676a118d04df8a882c700dde151b7a1e9b064e9d75e3696bab36474bbe09cd
SimHash 451cc672c773

Groups

*

Rule Path
Disallow /cdn-cgi/
Allow /

Other Records

Field Value
crawl-delay 5

dotbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /