bidspotter.co.uk
robots.txt
Robots Exclusion Standard data for bidspotter.co.uk
Resource Scan
Scan Details
| Site Domain | bidspotter.co.uk |
| Base Domain | bidspotter.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-10-16T02:08:39+00:00 |
| Next Scan | 2025-11-15T02:08:39+00:00 |
Last Scan
| Scanned | 2025-10-16T02:08:39+00:00 |
| URL | https://bidspotter.co.uk/robots.txt |
| Redirect | https://www.bidspotter.co.uk:443/robots.txt |
| Redirect Domain | www.bidspotter.co.uk |
| Redirect Base | bidspotter.co.uk |
| Domain IPs | 52.210.85.19, 54.171.149.157, 54.74.203.180 |
| Redirect IPs | 2600:9000:271a:1000:16:b11c:a940:93a1, 2600:9000:271a:6400:16:b11c:a940:93a1, 2600:9000:271a:6600:16:b11c:a940:93a1, 2600:9000:271a:7e00:16:b11c:a940:93a1, 2600:9000:271a:8000:16:b11c:a940:93a1, 2600:9000:271a:b000:16:b11c:a940:93a1, 2600:9000:271a:b800:16:b11c:a940:93a1, 2600:9000:271a:fc00:16:b11c:a940:93a1, 3.165.75.113, 3.165.75.126, 3.165.75.87, 3.165.75.9 |
| Response IP | 3.165.75.126 |
| Found | Yes |
| Hash | 6c65af678440db7c32c959c5dee938426325b77402c63437f83400b474501b49 |
| SimHash | 93456c6d8b92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */my-account* |
| Disallow | */*?callingPageUrl* |
| Disallow | */*?Country=* |
| Disallow | */international-delivery |
| Disallow | */archivelot* |
| Disallow | */*?preview* |
| Disallow | */*%26preview* |
| Disallow | */url-for-lot-number* |
| Disallow | */timed-bid-details* |
| Disallow | */sitemap.xml.gz/* |
| Disallow | *.well-known* |
| Disallow | */favourite-auctioneers* |
| Disallow | */signupwizard* |
| Disallow | */login* |
| Disallow | */buyitnow* |
| Disallow | */*?pgSearchTerm* |
| Disallow | */it-it* |
| Disallow | */de-de* |
| Disallow | */fr-fr* |
| Disallow | */en-us* |
| Disallow | */es-es* |
| Disallow | */search-filter* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bidspotter.co.uk/sitemapindex |
| sitemap | https://www.bidspotter.co.uk/lots_sitemapindex |
| sitemap | https://www.bidspotter.co.uk/auctions_sitemapindex |
| sitemap | https://www.bidspotter.co.uk/categories_sitemapindex |
| sitemap | https://www.bidspotter.co.uk/filteredpages_sitemapindex |
| sitemap | https://www.bidspotter.co.uk/auctioneers_sitemapindex |
| sitemap | https://www.bidspotter.co.uk/secondary_categories_sitemapindex |