mondadori.com
robots.txt

Robots Exclusion Standard data for mondadori.com

Resource Scan

Scan Details

Site Domain mondadori.com
Base Domain mondadori.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-06T21:24:02+00:00
Next Scan 2024-11-05T21:24:02+00:00

Last Successful Scan

Scanned2024-06-16T21:22:30+00:00
URL https://mondadori.com/robots.txt
Redirect https://www.mondadorigroup.com:443/robots.txt
Redirect Domain www.mondadorigroup.com
Redirect Base mondadorigroup.com
Response IP 15.161.26.27
Found Yes
Hash ed491b08a7319728f91745291369c9949a89e1e0951b74b210dcef7a4a4331a3
SimHash ca09c810c2e1

Groups

*

Rule Path
Disallow /wordpress/wp-includes/
Disallow /wordpress/wp-content/plugins/
Disallow /wordpress/wp-content/cache/
Disallow /wordpress/wp-admin/
Disallow /trackback/
Disallow /feed/rss/
Disallow /feed/
Disallow /comments/
Disallow /cgi-bin
Disallow /*?*
Disallow /*?
Disallow /*/trackback/
Disallow /*/feed/rss/
Disallow /*/feed/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Disallow /content/copy_link.php?id=*

mediapartners-google*

Rule Path
Allow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.mondadorigroup.com/sitemap_index.xml

Warnings

  • 2 invalid lines.