mademoisellecroziflette.fr
robots.txt

Robots Exclusion Standard data for mademoisellecroziflette.fr

Resource Scan

Scan Details

Site Domain mademoisellecroziflette.fr
Base Domain mademoisellecroziflette.fr
Scan Status Ok
Last Scan2024-10-04T20:29:59+00:00
Next Scan 2024-10-11T20:29:59+00:00

Last Scan

Scanned2024-10-04T20:29:59+00:00
URL https://www.mademoisellecroziflette.fr/robots.txt
Domain IPs 2001:4b98:dc2:950::109, 217.70.186.109
Response IP 217.70.186.109
Found Yes
Hash f9c3bf781d3a3c2031bb7bfc6048138c752f71a91ab63bc8bb65852562c00611
SimHash eb8258c4ceb0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /tag/
Disallow /*/feed
Disallow /*feed$
Disallow /*feed/$
Disallow /*?expand_article=1
Disallow /*?expand_article=1&expand_article=1
Disallow /*/comments
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz
Disallow /*.cgi
Allow /*css?*
Allow /*js?*
Allow /*.js$
Allow /*.css$
Allow /wp-admin/admin-ajax.php

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.mademoisellecroziflette.fr/post-sitemap.xml
sitemap https://www.mademoisellecroziflette.fr/page-sitemap.xml
sitemap https://www.mademoisellecroziflette.fr/category-sitemap.xml
sitemap https://www.mademoisellecroziflette.fr/sitemap_index.xml
sitemap https://www.mademoisellecroziflette.fr/sitemap-news.xml