aspekt.fr
robots.txt

Robots Exclusion Standard data for aspekt.fr

Resource Scan

Scan Details

Site Domain aspekt.fr
Base Domain aspekt.fr
Scan Status Ok
Last Scan2024-09-29T09:35:26+00:00
Next Scan 2024-10-06T09:35:26+00:00

Last Scan

Scanned2024-09-29T09:35:26+00:00
URL https://aspekt.fr/robots.txt
Domain IPs 2001:4b98:dc2:950::109, 217.70.186.109
Response IP 217.70.186.109
Found Yes
Hash 1faaa7e696a2eb2b46db53f39c7e785f017ad716b8430a502da32ac8745622f0
SimHash eb8259048eb0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /tag/
Disallow /*/feed
Disallow /*feed$
Disallow /*feed/$
Disallow /*?expand_article=1
Disallow /*?expand_article=1&expand_article=1
Disallow /*/comments
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz
Disallow /*.cgi
Allow /*css?*
Allow /*js?*
Allow /*.js$
Allow /*.css$
Allow /wp-admin/admin-ajax.php

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://aspekt.fr/sitemap_index.xml
sitemap https://aspekt.fr/post-sitemap.xml
sitemap https://aspekt.fr/page-sitemap.xml
sitemap https://aspekt.fr/category-sitemap.xml
sitemap https://aspekt.fr/sitemap-news.xml