motori.it
robots.txt

Robots Exclusion Standard data for motori.it

Resource Scan

Scan Details

Site Domain motori.it
Base Domain motori.it
Scan Status Ok
Last Scan2024-05-16T17:02:02+00:00
Next Scan 2024-05-23T17:02:02+00:00

Last Scan

Scanned2024-05-16T17:02:02+00:00
URL https://motori.it/robots.txt
Redirect https://www.motori.it/robots.txt
Redirect Domain www.motori.it
Redirect Base motori.it
Domain IPs 104.26.0.93, 104.26.1.93, 172.67.71.193, 2606:4700:20::681a:15d, 2606:4700:20::681a:5d, 2606:4700:20::ac43:47c1
Redirect IPs 104.26.0.93, 104.26.1.93, 172.67.71.193, 2606:4700:20::681a:15d, 2606:4700:20::681a:5d, 2606:4700:20::ac43:47c1
Response IP 104.26.1.93
Found Yes
Hash 746e194b5d65fa4a5b2b2ac72711a5092453a8d295c609f1566d76687769609e
SimHash 623c9c75e795

Groups

grapeshot

Rule Path
Disallow

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /galleria/*/img/*
Disallow /*/*/*.html/amp
Disallow /wp/wp-admin/
Disallow /5902/
Disallow /cerca/?ricerca_avanzata=*
Disallow /tag/*
Disallow /concessionario/*
Disallow /listino/*/*/*-my*/
Disallow /cdn-cgi/
Disallow /curiosita/150560/massimo-ranieri-compra-una-porsche-ma-e-una-truffa.html
Allow /wp/wp-admin/admin-ajax.php
Disallow */%7B%7B*
Disallow */%7B%7B*

Other Records

Field Value
sitemap https://www.motori.it/sitemap_index.xml

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
  • Teads 2019-11-04
  • Aggiunto il 10 giugno 2019
  • Aggiunto il 10 giugno 2019
  • Aggiunto il 10 giugno 2019
  • Aggiunto il 10 giugno 2019
  • Aggiunto il 10 giugno 2019
  • Aggiunto il 10 giugno 2019
  • Aggiunto il 10 giugno 2019
  • Aggiunto il 10 giugno 2019
  • RICHIESTE RIMOZIONI
  • Aggiunto il 26 aprile 2022