sciencefacts.net
robots.txt
Robots Exclusion Standard data for sciencefacts.net
Resource Scan
Scan Details
Site Domain | sciencefacts.net |
Base Domain | sciencefacts.net |
Scan Status | Ok |
Last Scan | 2024-11-05T03:57:25+00:00 |
Next Scan | 2024-11-12T03:57:25+00:00 |
Last Scan
Scanned | 2024-11-05T03:57:25+00:00 |
URL | https://sciencefacts.net/robots.txt |
Domain IPs | 67.222.11.19 |
Response IP | 67.222.11.19 |
Found | Yes |
Hash | d3f7449825a42409384342087cf5028533475d411a0399eceb22bd48832d2a45 |
SimHash | d500d440c657 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wp-import-export-lite/ |
Comments