hofland.com
robots.txt
Robots Exclusion Standard data for hofland.com
Resource Scan
Scan Details
Site Domain | hofland.com |
Base Domain | hofland.com |
Scan Status | Ok |
Last Scan | 2024-10-25T16:27:10+00:00 |
Next Scan | 2024-11-24T16:27:10+00:00 |
Last Scan
Scanned | 2024-10-25T16:27:10+00:00 |
URL | https://hofland.com/robots.txt |
Redirect | https://www.hofland.com/robots.txt |
Redirect Domain | www.hofland.com |
Redirect Base | hofland.com |
Domain IPs | 104.17.210.9 |
Redirect IPs | 125.56.219.18, 23.32.29.99 |
Response IP | 125.56.219.18 |
Found | Yes |
Hash | 9959a5101ba141664468e628dba7b9098c22b2eb91b9a4cb5415c33dec1570a2 |
SimHash | 6b609cd22393 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cart |
Disallow | *search?* |
Disallow | *range%3D* |
Disallow | */*/*/*/*/*/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.hofland.com/sitemap_www.hofland.com_Index.xml |
Comments