Log In Sign Up

ilmetropolitano.it
robots.txt

Robots Exclusion Standard data for ilmetropolitano.it

Resource Scan

Scan Details

Site Domain ilmetropolitano.it
Base Domain ilmetropolitano.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-06T06:31:55+00:00
Next Scan 2024-11-07T06:31:55+00:00

Last Successful Scan

Scanned2024-10-30T06:31:50+00:00
URL https://ilmetropolitano.it/robots.txt
Redirect https://www.ilmetropolitano.it/robots.txt
Redirect Domain www.ilmetropolitano.it
Redirect Base ilmetropolitano.it
Domain IPs 89.46.105.89
Redirect IPs 89.46.105.89
Response IP 89.46.105.89
Found Yes
Hash 0ff15bb7e7c5bb11394facddf8109722ed758d8d8713dd7e81f52aee7a5af8ed
SimHash 3b920153c233

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /contatti/
Disallow /comments/
Disallow */trackback/
Disallow */comments/
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /cgi-bin/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /readme.html
Disallow /license.txt

badbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.ilmetropolitano.it/sitemap.xml
Back to top

Comments

  • Blocco l'accesso ai principali percorsi amministrativi e file sensibili
  • Blocco specifico per bot indesiderati
  • Sitemap per facilitare l'indicizzazione delle pagine
  • Commenti esplicativi
  • Disallow: /example/ -> Blocca l'accesso a un percorso specifico
Back to top