alfa-deluxe.com
robots.txt
Robots Exclusion Standard data for alfa-deluxe.com
Resource Scan
Scan Details
Site Domain | alfa-deluxe.com |
Base Domain | alfa-deluxe.com |
Scan Status | Ok |
Last Scan | 2024-10-10T06:56:42+00:00 |
Next Scan | 2024-11-09T06:56:42+00:00 |
Last Scan
Scanned | 2024-10-10T06:56:42+00:00 |
URL | https://alfa-deluxe.com/robots.txt |
Domain IPs | 51.68.107.5, 51.68.97.214 |
Response IP | 51.68.107.5 |
Found | Yes |
Hash | b635f4e081a719847c2bfdd1dea1cbcba585b0e6392f7e50844e7d0f4595c36d |
SimHash | 420cdc02ae83 |
Groups
*
Rule | Path |
---|---|
Allow | /*/filter/page%3D*/$ |
Disallow | /*/filter/*%3D*%2C*/ |
Disallow | /*/filter/*%3D*%3B*%3D*%2C*/ |
Disallow | /*/filter/*%3D*%3B*%3D*%3B*%3D*/ |
Disallow | /*/filter/*%3D*%2C*%3B*%3D*/ |
Disallow | /*/filter/page%3D*%3B*/ |
Disallow | /*/filter/*sort_*/ |
Disallow | /*/filter/*view_type*/ |
Disallow | /*/filter/* |
Disallow | /*/filter/page%3Dall* |
Disallow | /*/search* |
Disallow | */checkout |
Disallow | */profile/ |
Disallow | */quick/* |
Disallow | */order/* |
Disallow | *?v=pc |
Disallow | *?v=mobile |
Disallow | *?*&v=pc |
Disallow | *?*&v=mobile |
Disallow | */loadAssociatedProducts/* |
Disallow | */load-associated-products* |
Disallow | /_widget |
Disallow | /*/_widget |
Disallow | /*FakeHrefDirector* |
sentibot
Rule | Path |
---|---|
Allow | /*/filter/page%3D*/$ |
Disallow | /*/filter/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
geedoproductsearch
Rule | Path |
---|---|
Allow | /*/filter/page%3D*/$ |
Disallow | /*/filter/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
semrushbot
Rule | Path |
---|---|
Allow | /*/filter/page%3D*/$ |
Disallow | /*/filter/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
amazonbot
Rule | Path |
---|---|
Allow | /*/filter/page%3D*/$ |
Disallow | /*/filter/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
ahrefsbot
Rule | Path |
---|---|
Allow | /*/filter/page%3D*/$ |
Disallow | /*/filter/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
blexbot
Rule | Path |
---|---|
Allow | /*/filter/page%3D*/$ |
Disallow | /*/filter/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://alfa-deluxe.com/sitemap.xml |