d3reflection.org
robots.txt
Robots Exclusion Standard data for d3reflection.org
Resource Scan
Scan Details
Site Domain | d3reflection.org |
Base Domain | d3reflection.org |
Scan Status | Ok |
Last Scan | 2024-05-27T17:50:39+00:00 |
Next Scan | 2024-06-26T17:50:39+00:00 |
Last Scan
Scanned | 2024-05-27T17:50:39+00:00 |
URL | https://d3reflection.org/robots.txt |
Domain IPs | 104.21.73.105, 172.67.189.167, 2606:4700:3031::ac43:bda7, 2606:4700:3035::6815:4969 |
Response IP | 104.21.73.105 |
Found | Yes |
Hash | 7e71b77d41d8eed9a6a0d837816865a2e1e7733ee3c7f3bc135d293ce0db1cfa |
SimHash | c400b8a087fa |
Groups
yandex
Rule | Path |
---|---|
Disallow | /css |
Disallow | /img |
Disallow | /login |
Disallow | /ratings |
Disallow | /registration |
Disallow | /referpage |
Disallow | /store |
Disallow | /account |
googlebot
Rule | Path |
---|---|
Disallow | /css |
Disallow | /img |
Disallow | /login |
Disallow | /ratings |
Disallow | /registration |
Disallow | /referpage |
Disallow | /store |
Disallow | /account |
*
Rule | Path |
---|---|
Disallow | /css |
Disallow | /img |
Disallow | /login |
Disallow | /ratings |
Disallow | /registration |
Disallow | /referpage |
Disallow | /store |
Disallow | /account |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Warnings
- `host` is not a known field.