producer.com
robots.txt

Robots Exclusion Standard data for producer.com

Resource Scan

Scan Details

Site Domain producer.com
Base Domain producer.com
Scan Status Ok
Last Scan2024-10-28T14:03:30+00:00
Next Scan 2024-11-04T14:03:30+00:00

Last Scan

Scanned2024-10-28T14:03:30+00:00
URL https://producer.com/robots.txt
Redirect https://www.producer.com/robots.txt
Redirect Domain www.producer.com
Redirect Base producer.com
Domain IPs 104.26.2.88, 104.26.3.88, 172.67.72.14
Redirect IPs 104.26.2.88, 104.26.3.88, 172.67.72.14
Response IP 172.67.72.14
Found Yes
Hash fc839ed002fd638b92dbd9760c304f3960370ab05893178774afcc96ac763daf
SimHash 0016dc5082e3

Groups

baiduspider
twiceler
meta-externalagent
facebookexternalhit

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10