ilmediconline.it
robots.txt

Robots Exclusion Standard data for ilmediconline.it

Resource Scan

Scan Details

Site Domain ilmediconline.it
Base Domain ilmediconline.it
Scan Status Ok
Last Scan6/4/2025, 3:04:14 AM
Next Scan 6/11/2025, 3:04:14 AM

Last Scan

Scanned6/4/2025, 3:04:14 AM
URL https://ilmediconline.it/robots.txt
Redirect https://www.ilmedicoonline.it/robots.txt
Redirect Domain www.ilmedicoonline.it
Redirect Base ilmedicoonline.it
Domain IPs 104.21.70.178, 172.67.138.40, 2606:4700:3033::6815:46b2, 2606:4700:3036::ac43:8a28
Redirect IPs 104.21.86.66, 172.67.216.89, 2606:4700:3035::6815:5642, 2606:4700:3035::ac43:d859
Response IP 104.21.86.66
Found Yes
Hash 4ffba4b6f5736705fb240674cf693cf89615f60eb9a4361d2e0b43810a2a50a3
SimHash fa04494ca0b3

Groups

*

Rule Path
Disallow /?s=
Disallow /wp-admin/
Disallow /wp-login.php

claudebot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ilmedicoonline.it/sitemap.xml