producer.com
robots.txt

Robots Exclusion Standard data for producer.com

Resource Scan

Scan Details

Site Domain producer.com
Base Domain producer.com
Scan Status Ok
Last Scan2024-05-06T09:25:38+00:00
Next Scan 2024-05-13T09:25:38+00:00

Last Scan

Scanned2024-05-06T09:25:38+00:00
URL https://producer.com/robots.txt
Redirect https://www.producer.com/robots.txt
Redirect Domain www.producer.com
Redirect Base producer.com
Domain IPs 104.26.2.88, 104.26.3.88, 172.67.72.14
Redirect IPs 104.26.2.88, 104.26.3.88, 172.67.72.14
Response IP 104.26.2.88
Found Yes
Hash a543dd90e3487e5a75d5c944549d5817649b5c00c6a4ace7ba379d1780f2133f
SimHash 0014dc500653

Groups

baiduspider

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10