nrvnews.com
robots.txt
Robots Exclusion Standard data for nrvnews.com
Resource Scan
Scan Details
Site Domain | nrvnews.com |
Base Domain | nrvnews.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-03T17:59:26+00:00 |
Next Scan | 2024-12-02T17:59:26+00:00 |
Last Successful Scan
Scanned | 2024-08-05T16:38:10+00:00 |
URL | https://nrvnews.com/robots.txt |
Domain IPs | 23.111.179.26 |
Response IP | 23.111.179.26 |
Found | Yes |
Hash | 2f77abde10816859a59f5fd7846b04ab03c894bb377ee5609e98b82938271bee |
SimHash | 3d7c4ce1d6cb |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /private/ |
Disallow | /tmp/ |
Disallow | /wp-content/cache/ |
*
Rule | Path |
---|---|
Disallow | /?blackhole |