woodlandcreekfurniture.com
robots.txt
Robots Exclusion Standard data for woodlandcreekfurniture.com
Resource Scan
Scan Details
Site Domain | woodlandcreekfurniture.com |
Base Domain | woodlandcreekfurniture.com |
Scan Status | Ok |
Last Scan | 2024-08-28T05:08:05+00:00 |
Next Scan | 2024-09-27T05:08:05+00:00 |
Last Scan
Scanned | 2024-08-28T05:08:05+00:00 |
URL | https://woodlandcreekfurniture.com/robots.txt |
Domain IPs | 52.84.229.22, 52.84.229.31, 52.84.229.40, 52.84.229.47 |
Response IP | 52.84.229.40 |
Found | Yes |
Hash | 04c770b90da165b17a0976475a7ccc24c1c7e2c3d7f1fa9aa0d282d625160251 |
SimHash | 4f24fc4ae252 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php/ |
Disallow | /*? |
Disallow | /checkout/ |
Disallow | /app/ |
Disallow | /lib/ |
Disallow | /*.php$ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /catalog/ |
Disallow | /customer/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /*SID%3D |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |