fairywings.lol
robots.txt

Robots Exclusion Standard data for fairywings.lol

Resource Scan

Scan Details

Site Domain fairywings.lol
Base Domain fairywings.lol
Scan Status Ok
Last Scan2025-02-20T23:26:48+00:00
Next Scan 2025-03-22T23:26:48+00:00

Last Scan

Scanned2025-02-20T23:26:48+00:00
URL https://fairywings.lol/robots.txt
Domain IPs 104.21.92.28, 172.67.185.88, 2606:4700:3034::ac43:b958, 2606:4700:3036::6815:5c1c
Response IP 172.67.185.88
Found Yes
Hash 5d59e72150585e971646dc6b3e1b0b271a77139cc14769748a36075bd39caf47
SimHash 4c889a42bb31

Groups

*

Rule Path
Disallow /*account
Disallow /*recovery/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /*account
Disallow /*recovery/

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Disallow /*account
Disallow /*recovery/

Other Records

Field Value
crawl-delay 1

Warnings

  • `clean-param` is not a known field.