cdcbentre.org
robots.txt

Robots Exclusion Standard data for cdcbentre.org

Resource Scan

Scan Details

Site Domain cdcbentre.org
Base Domain cdcbentre.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-07T13:41:18+00:00
Next Scan 2025-11-06T13:41:18+00:00

Last Successful Scan

Scanned2025-08-16T12:22:37+00:00
URL https://cdcbentre.org/robots.txt
Domain IPs 103.77.162.40
Response IP 103.77.162.40
Found Yes
Hash 0917e2576cc4f80f4a1bdfd7ce074522cb116bbd173f98c9286401dcb545b32e
SimHash f1456d00fe91

Groups

*

Rule Path
Disallow /admin/
Disallow /data/
Disallow /includes/
Disallow /install/
Disallow /modules/
Disallow /robots.php
Disallow /web.config
Disallow /users/
Disallow /statistics/
Disallow /vi/users/
Disallow /vi/statistics/

Other Records

Field Value
sitemap http://cdcbentre.org/sitemap.xml