mustad-fishing.com
robots.txt

Robots Exclusion Standard data for mustad-fishing.com

Resource Scan

Scan Details

Site Domain mustad-fishing.com
Base Domain mustad-fishing.com
Scan Status Ok
Last Scan6/11/2025, 2:51:17 AM
Next Scan 7/11/2025, 2:51:17 AM

Last Scan

Scanned6/11/2025, 2:51:17 AM
URL https://mustad-fishing.com/robots.txt
Domain IPs 104.21.49.149, 172.67.164.108, 2606:4700:3034::6815:3195, 2606:4700:3035::ac43:a46c
Response IP 172.67.164.108
Found Yes
Hash b247d81d6918e10479aa89a0b1e53a814c5dd8d6a88dd6edde9276f9a6c37ee8
SimHash 6808c844cb91

Groups

*

Rule Path
Allow /
Disallow /api

Other Records

Field Value
sitemap https://mustad-fishing.com/sitemap/sitemap-index.xml

Warnings

  • `host` is not a known field.