alfa-deluxe.com
robots.txt

Robots Exclusion Standard data for alfa-deluxe.com

Resource Scan

Scan Details

Site Domain alfa-deluxe.com
Base Domain alfa-deluxe.com
Scan Status Ok
Last Scan2024-10-10T06:56:42+00:00
Next Scan 2024-11-09T06:56:42+00:00

Last Scan

Scanned2024-10-10T06:56:42+00:00
URL https://alfa-deluxe.com/robots.txt
Domain IPs 51.68.107.5, 51.68.97.214
Response IP 51.68.107.5
Found Yes
Hash b635f4e081a719847c2bfdd1dea1cbcba585b0e6392f7e50844e7d0f4595c36d
SimHash 420cdc02ae83

Groups

*

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*%3D*%2C*/
Disallow /*/filter/*%3D*%3B*%3D*%2C*/
Disallow /*/filter/*%3D*%3B*%3D*%3B*%3D*/
Disallow /*/filter/*%3D*%2C*%3B*%3D*/
Disallow /*/filter/page%3D*%3B*/
Disallow /*/filter/*sort_*/
Disallow /*/filter/*view_type*/
Disallow /*/filter/*
Disallow /*/filter/page%3Dall*
Disallow /*/search*
Disallow */checkout
Disallow */profile/
Disallow */quick/*
Disallow */order/*
Disallow *?v=pc
Disallow *?v=mobile
Disallow *?*&v=pc
Disallow *?*&v=mobile
Disallow */loadAssociatedProducts/*
Disallow */load-associated-products*
Disallow /_widget
Disallow /*/_widget
Disallow /*FakeHrefDirector*

sentibot

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

claudebot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

unknown

Rule Path
Disallow /

semrushbot

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

amazonbot

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Allow /*/filter/page%3D*/$
Disallow /*/filter/*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://alfa-deluxe.com/sitemap.xml