ctdbase.com
robots.txt
Robots Exclusion Standard data for ctdbase.com
Resource Scan
Scan Details
| Site Domain | ctdbase.com |
| Base Domain | ctdbase.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-10-04T06:47:28+00:00 |
| Next Scan | 2025-01-02T06:47:28+00:00 |
Last Successful Scan
| Scanned | 2023-05-20T13:18:09+00:00 |
| URL | http://ctdbase.com/robots.txt |
| Domain IPs | 152.7.178.67 |
| Response IP | 152.7.178.67 |
| Found | Yes |
| Hash | c77db4bd1244dd5cff61f29ee365784880321bc66fb0aff23f64576d5a05e5a6 |
| SimHash | 5666556024c4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cas-images/ |
| Disallow | /images/ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /swf/ |
| Disallow | /reports/ |
| Disallow | /tech/ |
| Disallow | /*.ajx$ |
| Disallow | /*%3Bjsessionid%3D |
| Disallow | /*6578706f7274%3D |
| Disallow | /*sort%3D |
| Disallow | /*browser%3Ds |
| Disallow | /detail.go*?*view=chem |
| Disallow | /detail.go*?*view=disease |
| Disallow | /detail.go*?*view=gene |
| Disallow | /detail.go*?*view=gg |
| Disallow | /detail.go*?*view=go |
| Disallow | /detail.go*?*view=ixn |
| Disallow | /detail.go*?*view=pathway |
| Disallow | /detail.go*?*view=reference |
| Disallow | /detail.go*?*view=similarActorAgents |
| Disallow | /detail.go*?*view=phenotype |
| Disallow | /detail.go*?*view=expStudies |
| Disallow | /detail.go*?*view=expConsol |
| Disallow | /voc.go*?*acc= |
| Disallow | /tools/myGeneVenn.go*?*action= |
| Disallow | /tools/myVenn.go*?*action= |
| Disallow | /tools/vennViewer.go*?*action= |
| Disallow | /tools/analyzer.go*?*action= |
| Disallow | /help/contact.go*?*subject= |
| Disallow | /tools/cwExport.go |
| Disallow | /export.go |
| Disallow | /basicQuery.go |
| Disallow | /query.go |
| Disallow | /queryHistory.go |
Other Records
| Field | Value |
|---|---|
| sitemap | http://ctdbase.org/sitemap_index.xml |
Warnings
- `user agent` is not a known field.
Comments