ilpost.it
robots.txt

Robots Exclusion Standard data for ilpost.it

Resource Scan

Scan Details

Site Domain ilpost.it
Base Domain ilpost.it
Scan Status Ok
Last Scan2024-11-11T12:59:50+00:00
Next Scan 2024-11-18T12:59:50+00:00

Last Scan

Scanned2024-11-11T12:59:50+00:00
URL https://ilpost.it/robots.txt
Redirect https://www.ilpost.it:443/robots.txt
Redirect Domain www.ilpost.it
Redirect Base ilpost.it
Domain IPs 52.58.237.179, 52.59.108.238
Redirect IPs 65.9.112.108, 65.9.112.34, 65.9.112.47, 65.9.112.83
Response IP 18.165.140.30
Found Yes
Hash 52bbc51d1b742b5e3df6b34fe1dc26eb7da361a915b252385e41c9077743043f
SimHash 4d44d4dcc193

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /newsletter/
Disallow /type/
Disallow /isolavirtuale/
Disallow /cerca/
Disallow /wp-login.php

mediapartners-google

Rule Path
Disallow /2015/12/15/less-is-more-rankin/48x60_nudes-p-056-057-kate-orr/

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ilpost.it/sitemaps/sitemap.xml
sitemap https://www.ilpost.it/sitemaps/sitemap-posts-index.xml
sitemap https://www.ilpost.it/sitemaps/sitemap-flashes-index.xml