cdm.unfccc.int
robots.txt
Robots Exclusion Standard data for cdm.unfccc.int
Resource Scan
Scan Details
Site Domain | cdm.unfccc.int |
Base Domain | unfccc.int |
Scan Status | Ok |
Last Scan | 2025-06-23T23:39:17+00:00 |
Next Scan | 2025-07-23T23:39:17+00:00 |
Last Scan
Scanned | 2025-06-23T23:39:17+00:00 |
URL | https://cdm.unfccc.int/robots.txt |
Domain IPs | 107.154.251.26 |
Response IP | 107.154.251.26 |
Found | Yes |
Hash | 54050ad15b0d80dbdcd394887f1348f41fad1632c3ffa5fbdad533079bff14d8 |
SimHash | ed723560802e |
Groups
*
Rule | Path |
---|---|
Disallow | /accounts |
Disallow | /accounts/ |
Disallow | /bazaar |
Disallow | /EB/methodologies |
Disallow | /EB/Panels |
Disallow | /EB/Projects |
Disallow | /filestorage/ |
Disallow | /Issuance/MonitoringReports |
Disallow | /Issuance/rejected.html |
Disallow | /Issuance/request_iss.html |
Disallow | /Issuance/SOPByProjectsTable.html |
Disallow | /Meetings/methodologies |
Disallow | /Meetings/Projects |
Disallow | /Panels/methodologies |
Disallow | /Panels/meth/methbackground/Projects |
Disallow | /Panels/meth/methodologies |
Disallow | /Projects/DB/pac |
Disallow | /Projects/methodologies |
Disallow | /Projects/pac/methodologies |
Disallow | /Projects/Projects/pac/methodologies |
Disallow | /Projects/registered.html |
Disallow | /Projects/projsearch.html |
Disallow | /Reference/Documents/cdm |
Disallow | /Reference/Documents/methodologies |
Disallow | /Reference/Documents/Projects |
Disallow | /*/SOPByProjectsTable.html |
Disallow | /Statistics/dna/dna/ |
Disallow | /UserManagement/FileStorage |
Disallow | /UserManagement/FileStorage/ |
Disallow | /Validation/index.html |
Disallow | /workshops/methodologies |
Disallow | /workshops/Projects |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |