ilpost.it
robots.txt

Robots Exclusion Standard data for ilpost.it

Resource Scan

Scan Details

Site Domain ilpost.it
Base Domain ilpost.it
Scan Status Ok
Last Scan2024-06-10T07:06:18+00:00
Next Scan 2024-06-17T07:06:18+00:00

Last Scan

Scanned2024-06-10T07:06:18+00:00
URL https://ilpost.it/robots.txt
Redirect https://www.ilpost.it:443/robots.txt
Redirect Domain www.ilpost.it
Redirect Base ilpost.it
Domain IPs 18.159.158.190, 18.195.25.143
Redirect IPs 65.9.112.108, 65.9.112.34, 65.9.112.47, 65.9.112.83
Response IP 3.160.246.33
Found Yes
Hash 361ea28f5eb5b443cfa6f57c39a1138d5548c2fcb1f6bbdbe32c67471d3ce6ff
SimHash 8d64d4fc83b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /newsletter/
Disallow /type/
Disallow /isolavirtuale/
Disallow /cerca/
Disallow /wp-login.php

mediapartners-google

Rule Path
Disallow /2015/12/15/less-is-more-rankin/48x60_nudes-p-056-057-kate-orr/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ilpost.it/sitemaps/sitemap.xml
sitemap https://www.ilpost.it/sitemaps/sitemap-posts-index.xml
sitemap https://www.ilpost.it/sitemaps/sitemap-flashes-index.xml