prezzogomme.it
robots.txt

Robots Exclusion Standard data for prezzogomme.it

Resource Scan

Scan Details

Site Domain prezzogomme.it
Base Domain prezzogomme.it
Scan Status Ok
Last Scan2024-06-02T17:08:31+00:00
Next Scan 2024-06-09T17:08:31+00:00

Last Scan

Scanned2024-06-02T17:08:31+00:00
URL https://prezzogomme.it/robots.txt
Redirect https://www.prezzogomme.it/robots.txt
Redirect Domain www.prezzogomme.it
Redirect Base prezzogomme.it
Domain IPs 172.66.40.137, 172.66.43.119, 2606:4700:3108::ac42:2889, 2606:4700:3108::ac42:2b77
Redirect IPs 172.66.40.137, 172.66.43.119, 2606:4700:3108::ac42:2889, 2606:4700:3108::ac42:2b77
Response IP 172.66.43.119
Found Yes
Hash 4ab6c5135f55877d94ed5fafc31b98812b3ebe8ec2e3ea57034555beae65dd48
SimHash 4594fc25e219

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search*
Disallow /*veicolo%3D*
Disallow /*stagione%3D*
Disallow /*larghezza%3D*
Disallow /*spalla%3D*
Disallow /*diamentro%3D*
Disallow /*carico%3D*
Disallow /*velocita%3D*
Disallow /*ord%3D*
Disallow /*inc/js/js/
Disallow /*contatore*.php*
Disallow /*redirect*
Disallow /*.asp
Disallow /*/alert/
Disallow /alert_*
Disallow /*cpt_ratings%3D*
Disallow /api/

bingbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search*
Disallow /*veicolo%3D*
Disallow /*stagione%3D*
Disallow /*larghezza%3D*
Disallow /*spalla%3D*
Disallow /*diamentro%3D*
Disallow /*carico%3D*
Disallow /*velocita%3D*
Disallow /*ord%3D*
Disallow /*inc/js/js/
Disallow /*contatore*.php*
Disallow /*redirect*
Disallow /*.asp
Disallow /*/alert/
Disallow /alert_*
Disallow /*cpt_ratings%3D*
Disallow /api/

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search*
Disallow /*veicolo%3D*
Disallow /*stagione%3D*
Disallow /*larghezza%3D*
Disallow /*spalla%3D*
Disallow /*diamentro%3D*
Disallow /*carico%3D*
Disallow /*velocita%3D*
Disallow /*ord%3D*
Disallow /*inc/js/js/
Disallow /*contatore*.php*
Disallow /*redirect*
Disallow /*.asp
Disallow /*/alert/
Disallow /alert_*
Disallow /*cpt_ratings%3D*
Disallow /api/

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

quicksproutbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

mbcrawler/1.0

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /