atseuromaster.co.uk
robots.txt
Robots Exclusion Standard data for atseuromaster.co.uk
Resource Scan
Scan Details
Site Domain | atseuromaster.co.uk |
Base Domain | atseuromaster.co.uk |
Scan Status | Ok |
Last Scan | 2024-11-05T05:30:20+00:00 |
Next Scan | 2024-11-19T05:30:20+00:00 |
Last Scan
Scanned | 2024-11-05T05:30:20+00:00 |
URL | https://atseuromaster.co.uk/robots.txt |
Redirect | https://www.atseuromaster.co.uk/robots.txt |
Redirect Domain | www.atseuromaster.co.uk |
Redirect Base | atseuromaster.co.uk |
Domain IPs | 13.249.126.21, 13.249.126.60, 13.249.126.73, 13.249.126.84, 2600:9000:2490:1600:a:c433:a880:93a1, 2600:9000:2490:2000:a:c433:a880:93a1, 2600:9000:2490:4c00:a:c433:a880:93a1, 2600:9000:2490:9a00:a:c433:a880:93a1, 2600:9000:2490:9e00:a:c433:a880:93a1, 2600:9000:2490:a800:a:c433:a880:93a1, 2600:9000:2490:d000:a:c433:a880:93a1, 2600:9000:2490:e600:a:c433:a880:93a1 |
Redirect IPs | 2600:9000:20fe:4400:a:c433:a880:93a1, 2600:9000:20fe:5200:a:c433:a880:93a1, 2600:9000:20fe:5a00:a:c433:a880:93a1, 2600:9000:20fe:7e00:a:c433:a880:93a1, 2600:9000:20fe:b200:a:c433:a880:93a1, 2600:9000:20fe:be00:a:c433:a880:93a1, 2600:9000:20fe:cc00:a:c433:a880:93a1, 2600:9000:20fe:ce00:a:c433:a880:93a1, 52.222.144.17, 52.222.144.24, 52.222.144.33, 52.222.144.47 |
Response IP | 3.164.68.121 |
Found | Yes |
Hash | 3e723d9f219132d085afb400a6090a8bc14d917f6eb9c23195a802df6fb73151 |
SimHash | 2b3e501085f1 |
Groups
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
etaospider
exabot
exabot-thumbnails
ezooms
fasterfox
gaisbot
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
ladenzeile
ladenzeile.de
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
pagesinventory
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
seokicks-robot
shopwiki
snapbot
spbot
speobot
teoma
turnitinbot
twiceler
wikiwix-bot
woozweb-monitoring
woriobot
wotbox
yacybit
yacybot
yeti
yodaobot
zyborg
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /paymentRedirect |
Disallow | /searchPriceAjax |
Disallow | /refCarSearchAjax?type=* |
Disallow | /order |
Disallow | /authentify/ |
Disallow | /payment/ |
Disallow | /wheelDelivery |
Disallow | /productSheetAjax |
Disallow | /deliveryChoice |
Disallow | /find?&mode=* |
Disallow | /compare |
Disallow | /myaccount/* |
Disallow | /myaccount |
Disallow | /basket/* |
Disallow | /basket |
Disallow | /addToBasket |
Disallow | /payment/* |
Disallow | /payment |
Disallow | /agb |
Disallow | /cookies |
Disallow | /paymentRedirect |
Disallow | *bvstate%3Dpg%3A* |
Other Records
Field | Value |
---|---|
sitemap | https://www.atseuromaster.co.uk/sitemap.xml |
sitemap | https://www.atseuromaster.co.uk/sitemap.xml |