ctdbase.org
robots.txt
Robots Exclusion Standard data for ctdbase.org
Resource Scan
Scan Details
| Site Domain | ctdbase.org |
| Base Domain | ctdbase.org |
| Scan Status | Ok |
| Last Scan | 2024-09-21T20:59:23+00:00 |
| Next Scan | 2024-10-21T20:59:23+00:00 |
Last Scan
| Scanned | 2024-09-21T20:59:23+00:00 |
| URL | https://ctdbase.org/robots.txt |
| Domain IPs | 152.7.178.37 |
| Response IP | 152.7.178.37 |
| Found | Yes |
| Hash | 8fa3768f719b98df9d2571f94e705bcbd8833914ba4f5ab2fc7e3e2fd6d5183a |
| SimHash | 566455e02144 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cas-images/ |
| Disallow | /images/ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /swf/ |
| Disallow | /reports/ |
| Disallow | /tech/ |
| Disallow | /*.ajx$ |
| Disallow | /*%3Bjsessionid%3D |
| Disallow | /*6578706f7274%3D |
| Disallow | /*sort%3D |
| Disallow | /*browser%3Ds |
| Disallow | /detail.go*?*view=chem |
| Disallow | /detail.go*?*view=disease |
| Disallow | /detail.go*?*view=gene |
| Disallow | /detail.go*?*view=gg |
| Disallow | /detail.go*?*view=go |
| Disallow | /detail.go*?*view=ixn |
| Disallow | /detail.go*?*view=pathway |
| Disallow | /detail.go*?*view=reference |
| Disallow | /detail.go*?*view=similarActorAgents |
| Disallow | /detail.go*?*view=phenotype |
| Disallow | /detail.go*?*view=expStudies |
| Disallow | /detail.go*?*view=expConsol |
| Disallow | /voc.go*?*acc= |
| Disallow | /tools/myGeneVenn.go*?*action= |
| Disallow | /tools/myVenn.go*?*action= |
| Disallow | /tools/vennViewer.go*?*action= |
| Disallow | /tools/analyzer.go*?*action= |
| Disallow | /help/contact.go*?*subject= |
| Disallow | /tools/cwExport.go |
| Disallow | /export.go |
| Disallow | /basicQuery.go |
| Disallow | /query.go |
| Disallow | /queryHistory.go |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ctdbase.org/sitemap_index.xml |
Comments