d3reflection.org
robots.txt

Robots Exclusion Standard data for d3reflection.org

Resource Scan

Scan Details

Site Domain d3reflection.org
Base Domain d3reflection.org
Scan Status Ok
Last Scan2024-05-27T17:50:39+00:00
Next Scan 2024-06-26T17:50:39+00:00

Last Scan

Scanned2024-05-27T17:50:39+00:00
URL https://d3reflection.org/robots.txt
Domain IPs 104.21.73.105, 172.67.189.167, 2606:4700:3031::ac43:bda7, 2606:4700:3035::6815:4969
Response IP 104.21.73.105
Found Yes
Hash 7e71b77d41d8eed9a6a0d837816865a2e1e7733ee3c7f3bc135d293ce0db1cfa
SimHash c400b8a087fa

Groups

yandex

Rule Path
Disallow /css
Disallow /img
Disallow /login
Disallow /ratings
Disallow /registration
Disallow /referpage
Disallow /store
Disallow /account

googlebot

Rule Path
Disallow /css
Disallow /img
Disallow /login
Disallow /ratings
Disallow /registration
Disallow /referpage
Disallow /store
Disallow /account

*

Rule Path
Disallow /css
Disallow /img
Disallow /login
Disallow /ratings
Disallow /registration
Disallow /referpage
Disallow /store
Disallow /account

Other Records

Field Value
crawl-delay 2

Warnings

  • `host` is not a known field.