italy4.me
robots.txt

Robots Exclusion Standard data for italy4.me

Resource Scan

Scan Details

Site Domain italy4.me
Base Domain italy4.me
Scan Status Ok
Last Scan2025-04-15T12:32:35+00:00
Next Scan 2025-04-22T12:32:35+00:00

Last Scan

Scanned2025-04-15T12:32:35+00:00
URL https://italy4.me/robots.txt
Domain IPs 104.21.30.102, 172.67.172.189, 2606:4700:3032::6815:1e66, 2606:4700:3033::ac43:acbd
Response IP 172.67.172.189
Found Yes
Hash de0f4157ccdf823d0c602ed4366428559f47c78829948cfe753e03084784842a
SimHash 43f15e550231

Groups

yandex

Rule Path
Disallow */novosti/*
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow */feed/
Disallow */feed
Disallow /?feed=
Disallow /*search*
Disallow /trackback
Disallow */trackback/
Disallow */attachment/
Disallow */comments/
Disallow /?replytocom*
Disallow /*?p=*
Disallow /*?s=*
Disallow /*.zip
Disallow */tag/*
Disallow /home-2/*
Disallow /page
Disallow */page/*
Disallow /home/*
Allow /wp-content/uploads/
Allow /wp-includes/css/
Allow /wp-includes/js/
Allow *css*
Allow /feed/turbo/

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow */feed/
Disallow */feed
Disallow /?feed=
Disallow /*search*
Disallow /trackback
Disallow */trackback/
Disallow */comments/
Disallow /?replytocom*
Disallow /*?p=*
Disallow /*?s=*
Disallow */tag/*
Disallow /home-2/*
Disallow /page
Disallow */page/*
Disallow /home/*
Disallow */attachment/
Allow /wp-content/uploads/
Allow *js*
Allow *css*
Allow /wp-includes/js/
Allow /wp-includes/css/

mediapartners-google

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow */feed/
Disallow */feed
Disallow /?feed=
Disallow /*search*
Disallow /trackback
Disallow */trackback/
Disallow */comments/
Disallow /?replytocom*
Disallow /*?p=*
Disallow /*?s=*
Disallow */tag/*
Disallow /home-2/*
Disallow /page
Disallow */page/*
Disallow /home/*
Disallow */attachment/
Allow /wp-content/uploads/
Allow *js*
Allow *css*
Allow /wp-includes/js/

yadirectbot

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow */feed/
Disallow */feed
Disallow /?feed=
Disallow /*search*
Disallow /trackback
Disallow */trackback/
Disallow */comments/
Disallow /?replytocom*
Disallow /*?p=*
Disallow /*?s=*
Disallow */tag/*
Disallow /home-2/*
Disallow /page
Disallow */page/*
Disallow /home/*
Disallow */attachment/
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mail.ru

Rule Path
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /topics/
Disallow /page/
Disallow */trackback
Disallow /*?
Disallow /*?*
Disallow /home-2/*
Disallow /page
Disallow */page/*
Disallow /home/*
Allow /?gallery*
Disallow /*.php
Disallow /*.zip
Disallow /*.htm
Disallow /*.html
Disallow */tag/*
Disallow */attachment/
Allow /wp-content/uploads/
Allow *css*

Other Records

Field Value
crawl-delay 2

criteobot/0.1

Rule Path
Disallow /

Other Records

Field Value
sitemap https://italy4.me/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.