cdcbentre.org
robots.txt
Robots Exclusion Standard data for cdcbentre.org
Resource Scan
Scan Details
Site Domain | cdcbentre.org |
Base Domain | cdcbentre.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-10-07T13:41:18+00:00 |
Next Scan | 2025-11-06T13:41:18+00:00 |
Last Successful Scan
Scanned | 2025-08-16T12:22:37+00:00 |
URL | https://cdcbentre.org/robots.txt |
Domain IPs | 103.77.162.40 |
Response IP | 103.77.162.40 |
Found | Yes |
Hash | 0917e2576cc4f80f4a1bdfd7ce074522cb116bbd173f98c9286401dcb545b32e |
SimHash | f1456d00fe91 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /data/ |
Disallow | /includes/ |
Disallow | /install/ |
Disallow | /modules/ |
Disallow | /robots.php |
Disallow | /web.config |
Disallow | /users/ |
Disallow | /statistics/ |
Disallow | /vi/users/ |
Disallow | /vi/statistics/ |
Other Records
Field | Value |
---|---|
sitemap | http://cdcbentre.org/sitemap.xml |