fiyo.co.uk
robots.txt

Robots Exclusion Standard data for fiyo.co.uk

Resource Scan

Scan Details

Site Domain fiyo.co.uk
Base Domain fiyo.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/19/2025, 12:13:33 PM
Next Scan 6/18/2025, 12:13:33 PM

Last Successful Scan

Scanned3/28/2025, 12:11:23 PM
URL https://fiyo.co.uk/robots.txt
Redirect https://www.fiyo.co.uk/robots.txt
Redirect Domain www.fiyo.co.uk
Redirect Base fiyo.co.uk
Domain IPs 104.21.16.234, 172.67.216.215, 2606:4700:3034::6815:10ea, 2606:4700:3036::ac43:d8d7
Redirect IPs 104.21.16.234, 172.67.216.215, 2606:4700:3034::6815:10ea, 2606:4700:3036::ac43:d8d7
Response IP 172.67.216.215
Found Yes
Hash ddec91e7b90181d33ce60ef60227cb50f1c416ecfde9215d42106acd95c4dd08
SimHash 6738da30c710

Groups

*

Rule Path
Disallow /customer/
Disallow /errors/
Disallow /skin/adminhtml/
Disallow *checkout*
Disallow *view*
Disallow *?*
Allow *?fee=*&fep=*
Allow *?device_brand=*
Disallow *device_brand%3D*%26*
Allow *?p=*
Disallow *?p=*&*
Disallow *%26*
Allow *%26device_typenumber%3D*
Disallow *device_brand%3D*%26device_typenumber%3D*%26
Disallow *%*
Allow *.css?*
Allow *.js?*
Allow *.woff?*
Allow *.woff2?*
Allow *.ttf?*
Allow *.scss?*

dataforseobot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /*?q=

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fiyo.co.uk/media/sitemaps_2.0/fiyo_co_uk/product/index.xml
sitemap https://www.fiyo.co.uk/media/sitemaps_2.0/fiyo_co_uk/cms/index.xml
sitemap https://www.fiyo.co.uk/media/sitemaps_2.0/fiyo_co_uk/blog/index.xml
sitemap https://www.fiyo.co.uk/media/sitemaps_2.0/fiyo_co_uk/brand/index.xml
sitemap https://www.fiyo.co.uk/media/sitemaps_2.0/fiyo_co_uk/category/index.xml
sitemap https://www.fiyo.co.uk/media/sitemaps_2.0/fiyo_co_uk/category_brand/index.xml

Comments

  • URL Attributes
  • Added by DVN