hofland.com
robots.txt

Robots Exclusion Standard data for hofland.com

Resource Scan

Scan Details

Site Domain hofland.com
Base Domain hofland.com
Scan Status Ok
Last Scan2024-10-25T16:27:10+00:00
Next Scan 2024-11-24T16:27:10+00:00

Last Scan

Scanned2024-10-25T16:27:10+00:00
URL https://hofland.com/robots.txt
Redirect https://www.hofland.com/robots.txt
Redirect Domain www.hofland.com
Redirect Base hofland.com
Domain IPs 104.17.210.9
Redirect IPs 125.56.219.18, 23.32.29.99
Response IP 125.56.219.18
Found Yes
Hash 9959a5101ba141664468e628dba7b9098c22b2eb91b9a4cb5415c33dec1570a2
SimHash 6b609cd22393

Groups

*

Rule Path
Allow /
Disallow /cart
Disallow *search?*
Disallow *range%3D*
Disallow */*/*/*/*/*/*

Other Records

Field Value
crawl-delay 10

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.hofland.com/sitemap_www.hofland.com_Index.xml

Comments

  • NS Given
  • Crawlers Setup