tyreprice.uk
robots.txt

Robots Exclusion Standard data for tyreprice.uk

Resource Scan

Scan Details

Site Domain tyreprice.uk
Base Domain tyreprice.uk
Scan Status Ok
Last Scan2024-06-03T20:17:14+00:00
Next Scan 2024-06-10T20:17:14+00:00

Last Scan

Scanned2024-06-03T20:17:14+00:00
URL https://tyreprice.uk/robots.txt
Redirect https://www.tyreprice.uk/robots.txt
Redirect Domain www.tyreprice.uk
Redirect Base tyreprice.uk
Domain IPs 104.21.63.169, 172.67.148.15, 2606:4700:3031::ac43:940f, 2606:4700:3034::6815:3fa9
Redirect IPs 104.21.63.169, 172.67.148.15, 2606:4700:3031::ac43:940f, 2606:4700:3034::6815:3fa9
Response IP 104.21.63.169
Found Yes
Hash 787253656e446b3dd6fa2fbaee710b1e80e4a8fbcb90d830f65eda342165507c
SimHash 4794fc21e219

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search*
Disallow /*veicolo%3D*
Disallow /*stagione%3D*
Disallow /*larghezza%3D*
Disallow /*spalla%3D*
Disallow /*diamentro%3D*
Disallow /*carico%3D*
Disallow /*velocita%3D*
Disallow /*ord%3D*
Disallow /*inc/js/js/
Disallow /*contatore*.php*
Disallow /*redirect*
Disallow /*.asp
Disallow /*/alert/
Disallow /alert_*
Disallow /parlano-*
Disallow /*cpt_ratings%3D*

bingbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search*
Disallow /*veicolo%3D*
Disallow /*stagione%3D*
Disallow /*larghezza%3D*
Disallow /*spalla%3D*
Disallow /*diamentro%3D*
Disallow /*carico%3D*
Disallow /*velocita%3D*
Disallow /*ord%3D*
Disallow /*inc/js/js/
Disallow /*contatore*.php*
Disallow /*redirect*
Disallow /*.asp
Disallow /*/alert/
Disallow /alert_*
Disallow /parlano-*
Disallow /*cpt_ratings%3D*

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search*
Disallow /*veicolo%3D*
Disallow /*stagione%3D*
Disallow /*larghezza%3D*
Disallow /*spalla%3D*
Disallow /*diamentro%3D*
Disallow /*carico%3D*
Disallow /*velocita%3D*
Disallow /*ord%3D*
Disallow /*inc/js/js/
Disallow /*contatore*.php*
Disallow /*redirect*
Disallow /*.asp
Disallow /*/alert/
Disallow /alert_*
Disallow /parlano-*
Disallow /*cpt_ratings%3D*

Other Records

Field Value
crawl-delay 20

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

quicksproutbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

mbcrawler/1.0

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /