atseuromaster.co.uk
robots.txt
Robots Exclusion Standard data for atseuromaster.co.uk
Resource Scan
Scan Details
| Site Domain | atseuromaster.co.uk |
| Base Domain | atseuromaster.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-06-04T04:47:18+00:00 |
| Next Scan | 2024-06-18T04:47:18+00:00 |
Last Scan
| Scanned | 2024-06-04T04:47:18+00:00 |
| URL | https://atseuromaster.co.uk/robots.txt |
| Redirect | https://www.atseuromaster.co.uk/robots.txt |
| Redirect Domain | www.atseuromaster.co.uk |
| Redirect Base | atseuromaster.co.uk |
| Domain IPs | 2600:9000:20fe:0:a:c433:a880:93a1, 2600:9000:20fe:1c00:a:c433:a880:93a1, 2600:9000:20fe:5200:a:c433:a880:93a1, 2600:9000:20fe:a000:a:c433:a880:93a1, 2600:9000:20fe:ee00:a:c433:a880:93a1, 2600:9000:20fe:f800:a:c433:a880:93a1, 2600:9000:20fe:fa00:a:c433:a880:93a1, 2600:9000:20fe:fe00:a:c433:a880:93a1, 52.84.174.120, 52.84.174.121, 52.84.174.18, 52.84.174.91 |
| Redirect IPs | 18.172.122.121, 18.172.122.49, 18.172.122.53, 18.172.122.6, 2600:9000:2024:1400:a:c433:a880:93a1, 2600:9000:2024:2600:a:c433:a880:93a1, 2600:9000:2024:3600:a:c433:a880:93a1, 2600:9000:2024:a400:a:c433:a880:93a1, 2600:9000:2024:b400:a:c433:a880:93a1, 2600:9000:2024:c800:a:c433:a880:93a1, 2600:9000:2024:d000:a:c433:a880:93a1, 2600:9000:2024:e00:a:c433:a880:93a1 |
| Response IP | 18.165.171.61 |
| Found | Yes |
| Hash | 3e723d9f219132d085afb400a6090a8bc14d917f6eb9c23195a802df6fb73151 |
| SimHash | 2b3e501085f1 |
Groups
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
etaospider
exabot
exabot-thumbnails
ezooms
fasterfox
gaisbot
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
ladenzeile
ladenzeile.de
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
pagesinventory
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
seokicks-robot
shopwiki
snapbot
spbot
speobot
teoma
turnitinbot
twiceler
wikiwix-bot
woozweb-monitoring
woriobot
wotbox
yacybit
yacybot
yeti
yodaobot
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /paymentRedirect |
| Disallow | /searchPriceAjax |
| Disallow | /refCarSearchAjax?type=* |
| Disallow | /order |
| Disallow | /authentify/ |
| Disallow | /payment/ |
| Disallow | /wheelDelivery |
| Disallow | /productSheetAjax |
| Disallow | /deliveryChoice |
| Disallow | /find?&mode=* |
| Disallow | /compare |
| Disallow | /myaccount/* |
| Disallow | /myaccount |
| Disallow | /basket/* |
| Disallow | /basket |
| Disallow | /addToBasket |
| Disallow | /payment/* |
| Disallow | /payment |
| Disallow | /agb |
| Disallow | /cookies |
| Disallow | /paymentRedirect |
| Disallow | *bvstate%3Dpg%3A* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.atseuromaster.co.uk/sitemap.xml |
| sitemap | https://www.atseuromaster.co.uk/sitemap.xml |