bidspotter.com
robots.txt
Robots Exclusion Standard data for bidspotter.com
Resource Scan
Scan Details
| Site Domain | bidspotter.com |
| Base Domain | bidspotter.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T16:22:37+00:00 |
| Next Scan | 2024-11-27T16:22:37+00:00 |
Last Scan
| Scanned | 2024-10-28T16:22:37+00:00 |
| URL | https://bidspotter.com/robots.txt |
| Redirect | https://www.bidspotter.com/robots.txt |
| Redirect Domain | www.bidspotter.com |
| Redirect Base | bidspotter.com |
| Domain IPs | 54.194.227.166 |
| Redirect IPs | 2600:9000:2795:2000:0:c922:9200:93a1, 2600:9000:2795:2c00:0:c922:9200:93a1, 2600:9000:2795:400:0:c922:9200:93a1, 2600:9000:2795:7400:0:c922:9200:93a1, 2600:9000:2795:7600:0:c922:9200:93a1, 2600:9000:2795:b600:0:c922:9200:93a1, 2600:9000:2795:bc00:0:c922:9200:93a1, 2600:9000:2795:ec00:0:c922:9200:93a1, 3.164.85.113, 3.164.85.2, 3.164.85.35, 3.164.85.63 |
| Response IP | 18.165.122.62 |
| Found | Yes |
| Hash | 6f09db0d4da12989cdc444dd2d20a6680233e3ba3a43afe6982f72ea4d2c2181 |
| SimHash | 8641ecc8dbb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */my-account* |
| Disallow | */*?callingPageUrl* |
| Disallow | */*?Country=* |
| Disallow | */international-delivery |
| Disallow | */archivelot* |
| Disallow | */*?preview* |
| Disallow | */*%26preview* |
| Disallow | */url-for-lot-number* |
| Disallow | */timed-bid-details* |
| Disallow | */sitemap.xml.gz/* |
| Disallow | *.well-known* |
| Disallow | */favourite-auctioneers* |
| Disallow | */signupwizard* |
| Disallow | */login* |
| Disallow | */buyitnow* |
| Disallow | */*?pgSearchTerm* |
| Disallow | */en-gb* |
| Disallow | */fr-fr* |
| Disallow | */de-de* |
| Disallow | */search-filter* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bidspotter.com/sitemapindex |
| sitemap | https://www.bidspotter.com/lots_sitemapindex |
| sitemap | https://www.bidspotter.com/auctions_sitemapindex |
| sitemap | https://www.bidspotter.com/categories_sitemapindex |
| sitemap | https://www.bidspotter.com/filteredpages_sitemapindex |
| sitemap | https://www.bidspotter.com/auctioneers_sitemapindex |
| sitemap | https://www.bidspotter.com/secondary_categories_sitemapindex |