d-archive.org
robots.txt

Robots Exclusion Standard data for d-archive.org

Resource Scan

Scan Details

Site Domain d-archive.org
Base Domain d-archive.org
Scan Status Ok
Last Scan2024-09-23T23:24:43+00:00
Next Scan 2024-09-30T23:24:43+00:00

Last Scan

Scanned2024-09-23T23:24:43+00:00
URL https://d-archive.org/robots.txt
Redirect https://www.d-archive.org/robots.txt
Redirect Domain www.d-archive.org
Redirect Base d-archive.org
Domain IPs 72.52.178.18
Redirect IPs 72.52.178.18
Response IP 72.52.178.18
Found Yes
Hash 96409104406a7a54d213e1d5ebf3b2b1e136278c534714ca9d84385aa41c9413
SimHash e00980002fb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.d-archive.org/news-sitemap.xml
sitemap https://www.d-archive.org/video-sitemap.xml
sitemap https://www.d-archive.org/sitemap.xml
sitemap https://www.d-archive.org/sitemap.rss