mitosworld.it
robots.txt

Robots Exclusion Standard data for mitosworld.it

Resource Scan

Scan Details

Site Domain mitosworld.it
Base Domain mitosworld.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-05-30T03:06:50+00:00
Next Scan 2025-07-29T03:06:50+00:00

Last Successful Scan

Scanned2025-04-01T02:14:11+00:00
URL https://mitosworld.it/robots.txt
Domain IPs 2a0c:79c0:2:17::4, 86.105.14.23
Response IP 86.105.14.23
Found Yes
Hash 9731661a5340389fc1f52444d4ce7991c162b169536cf5e22d0a7d70757c5736
SimHash 0455529245d1

Groups

applebot

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

baiduspider

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

bingbot

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

ia_archiver

Rule Path
Disallow /
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

msnbot

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

naverbot

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

seznambot

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

slurp

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

teoma

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

yeti

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-
Allow /wp-content/uploads/

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /e/
Disallow /show-error-*
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comment-page-

applebot

Rule Path
Allow /wp-content/uploads/

baiduspider

Rule Path
Allow /wp-content/uploads/

bingbot

Rule Path
Allow /wp-content/uploads/

googlebot

Rule Path
Allow /wp-content/uploads/

ia_archiver

Rule Path
Allow /wp-content/uploads/

msnbot

Rule Path
Allow /wp-content/uploads/

naverbot

Rule Path
Allow /wp-content/uploads/

seznambot

Rule Path
Allow /wp-content/uploads/

slurp

Rule Path
Allow /wp-content/uploads/

teoma

Rule Path
Allow /wp-content/uploads/

yandex

Rule Path
Allow /wp-content/uploads/

yeti

Rule Path
Allow /wp-content/uploads/

*

Rule Path
Allow /wp-content/uploads/

Comments

  • Avviso: Il Crawling del Sito è proibito a meno che non si è in possesso di una autorizzazione espressa per iscritto da parte della proprietÃ