the-saleroom.com
robots.txt
Robots Exclusion Standard data for the-saleroom.com
Resource Scan
Scan Details
Site Domain | the-saleroom.com |
Base Domain | the-saleroom.com |
Scan Status | Ok |
Last Scan | 2024-11-10T19:04:13+00:00 |
Next Scan | 2024-12-10T19:04:13+00:00 |
Last Scan
Scanned | 2024-11-10T19:04:13+00:00 |
URL | https://the-saleroom.com/robots.txt |
Redirect | https://www.the-saleroom.com/robots.txt |
Redirect Domain | www.the-saleroom.com |
Redirect Base | the-saleroom.com |
Domain IPs | 54.194.227.166 |
Redirect IPs | 18.203.211.153, 34.250.145.183, 52.210.69.240 |
Response IP | 52.210.69.240 |
Found | Yes |
Hash | 5de7941141ec1dd717b058e72ffd42238911a8178168d35de3944f7c878b120d |
SimHash | d641e80e9b92 |
Groups
*
Rule | Path |
---|---|
Disallow | */my-account* |
Disallow | */*?callingPageUrl* |
Disallow | */*?Country=* |
Disallow | */international-delivery |
Disallow | */archivelot* |
Disallow | */*?preview* |
Disallow | */*%26preview* |
Disallow | */url-for-lot-number* |
Disallow | */timed-bid-details* |
Disallow | */sitemap.xml.gz/* |
Disallow | *.well-known* |
Disallow | */favourite-auctioneers* |
Disallow | */signupwizard* |
Disallow | */login* |
Disallow | */buyitnow* |
Disallow | */*?pgSearchTerm* |
Disallow | */en-us* |
Disallow | */it-it* |
Disallow | */zh-cn* |
Disallow | */search-filter* |
Disallow | *it-it/news |
Disallow | *de-de/news |
Disallow | *fr-fr/news |
Disallow | */marketplace-content/ |
Disallow | *please_ignore_this_404.htm |
Disallow | *PLEASE_IGNORE_THIS_404.htm |
Other Records
Field | Value |
---|---|
sitemap | https://www.the-saleroom.com/sitemapindex |
sitemap | https://www.the-saleroom.com/lots_sitemapindex |
sitemap | https://www.the-saleroom.com/auctions_sitemapindex |
sitemap | https://www.the-saleroom.com/categories_sitemapindex |
sitemap | https://www.the-saleroom.com/filteredpages_sitemapindex |
sitemap | https://www.the-saleroom.com/auctioneers_sitemapindex |
sitemap | https://www.the-saleroom.com/secondary_categories_sitemapindex |