techrreview.com
robots.txt

Robots Exclusion Standard data for techrreview.com

Resource Scan

Scan Details

Site Domain techrreview.com
Base Domain techrreview.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-05T13:43:57+00:00
Next Scan 2024-12-04T13:43:57+00:00

Last Successful Scan

Scanned2023-11-10T23:08:45+00:00
URL http://techrreview.com/robots.txt
Domain IPs 34.98.99.30
Response IP 34.98.99.30
Found Yes
Hash 4f5a7b4964258b6a971812eb88273a60a7f373bc583794f89867ba5c1c2dc8cf
SimHash 4c54d8146741

Groups

googlebot
bingbot
slurp
baiduspider

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /