was-ist-depression.net
robots.txt

Robots Exclusion Standard data for was-ist-depression.net

Resource Scan

Scan Details

Site Domain was-ist-depression.net
Base Domain was-ist-depression.net
Scan Status Ok
Last Scan2024-09-22T10:22:14+00:00
Next Scan 2024-09-29T10:22:14+00:00

Last Scan

Scanned2024-09-22T10:22:14+00:00
URL https://was-ist-depression.net/robots.txt
Domain IPs 104.16.159.43, 104.17.9.99
Response IP 104.16.159.43
Found Yes
Hash 0d15edac38256510fa80f4af972852d87ed9cfc6b686eccf19a88c972a1157f2
SimHash 40181a20c3f0

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /trackback/
Disallow */trackback/
Disallow */feed/
Allow /wp-admin/css/
Allow /wp-admin/admin-ajax.php
Allow /comments/
Allow */comments/
Disallow /search?updated-min=
Disallow /search?updated-max=
Disallow /*archive.html
Disallow /category/*/page*

Other Records

Field Value
sitemap https://www.was-ist-depression.net/sitemap_index.xml