tom-tailor.be
robots.txt
Robots Exclusion Standard data for tom-tailor.be
Resource Scan
Scan Details
Site Domain | tom-tailor.be |
Base Domain | tom-tailor.be |
Scan Status | Ok |
Last Scan | 2024-09-23T13:01:01+00:00 |
Next Scan | 2024-10-07T13:01:01+00:00 |
Last Scan
Scanned | 2024-09-23T13:01:01+00:00 |
URL | https://tom-tailor.be/robots.txt |
Redirect | https://www.tom-tailor.be/robots.txt |
Redirect Domain | www.tom-tailor.be |
Redirect Base | tom-tailor.be |
Domain IPs | 15.197.167.90, 3.33.186.135 |
Redirect IPs | 13.215.31.72, 175.41.180.202, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e201::1f4 |
Response IP | 13.215.31.72 |
Found | Yes |
Hash | d6b4819e4e883a5c2a9241ba25501706c52f655cacdbaf25390dfd63dcfa5acb |
SimHash | 29019a58ecb3 |
Groups
*
Rule | Path |
---|---|
Allow | * |
Disallow | /checkout |
Disallow | /login |
Disallow | /search |
Disallow | /*?*facets*= |
Disallow | /*?*sortAttributes*= |
Other Records
Field | Value |
---|---|
sitemap | https://www.tom-tailor.be/sitemap-products.xml |
sitemap | https://www.tom-tailor.be/sitemap-categories.xml |
sitemap | https://www.tom-tailor.be/sitemap-images.xml |