davevic.com
robots.txt
Robots Exclusion Standard data for davevic.com
Resource Scan
Scan Details
Site Domain | davevic.com |
Base Domain | davevic.com |
Scan Status | Ok |
Last Scan | 2025-07-23T09:46:25+00:00 |
Next Scan | 2025-08-22T09:46:25+00:00 |
Last Scan
Scanned | 2025-07-23T09:46:25+00:00 |
URL | https://davevic.com/robots.txt |
Domain IPs | 104.18.0.238, 104.18.1.238, 2606:4700::6812:1ee, 2606:4700::6812:ee |
Response IP | 104.18.0.238 |
Found | Yes |
Hash | 9751f3c5836175a38521c8ccdf6b98a61a8f24319ecd88d3df92148836ca6b5e |
SimHash | 4510c0d24335 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 3 |