nrvnews.com
robots.txt

Robots Exclusion Standard data for nrvnews.com

Resource Scan

Scan Details

Site Domain nrvnews.com
Base Domain nrvnews.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-03T17:59:26+00:00
Next Scan 2024-12-02T17:59:26+00:00

Last Successful Scan

Scanned2024-08-05T16:38:10+00:00
URL https://nrvnews.com/robots.txt
Domain IPs 23.111.179.26
Response IP 23.111.179.26
Found Yes
Hash 2f77abde10816859a59f5fd7846b04ab03c894bb377ee5609e98b82938271bee
SimHash 3d7c4ce1d6cb

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /cgi-bin/
Disallow /private/
Disallow /tmp/
Disallow /wp-content/cache/

*

Rule Path
Disallow /?blackhole