chatbots.org
robots.txt
Robots Exclusion Standard data for chatbots.org
Resource Scan
Scan Details
| Site Domain | chatbots.org |
| Base Domain | chatbots.org |
| Scan Status | Ok |
| Last Scan | 2025-11-19T02:25:57+00:00 |
| Next Scan | 2025-12-19T02:25:57+00:00 |
Last Scan
| Scanned | 2025-11-19T02:25:57+00:00 |
| URL | https://chatbots.org/robots.txt |
| Domain IPs | 104.21.65.169, 172.67.147.70, 2606:4700:3031::ac43:9346, 2606:4700:3033::6815:41a9 |
| Response IP | 172.67.147.70 |
| Found | Yes |
| Hash | 0831f3afd11ec348552bc76dbc730128dcc440d9af03c482a76edc24265d719f |
| SimHash | 10368e76e232 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /10 |
| Disallow | /20 |
| Disallow | /25 |
| Disallow | /26 |
| Disallow | /265 |
| Disallow | /sandbox |
| Disallow | /analysis |
| Disallow | /tools |
| Disallow | /chatbot/preview |
| Disallow | /directory/search_results |
| Disallow | /directory/search_no_results |
| Disallow | /conversational/search_results |
| Disallow | /conversational/search_no_results |
| Disallow | /ai_zone/search_results |
| Disallow | /admin/search_results |
| Disallow | /ww |
| Disallow | /universities/edit |
| Disallow | /companies/animation |
| Disallow | /companies/speech |
| Disallow | /companies/biometrics |
| Disallow | /awards/forward/ |
| Disallow | /community/forward/ |
| Disallow | /conversational/forward/ |
| Disallow | /directory/forward/ |
| Disallow | /journals/forward/ |
| Disallow | /papers/forward/ |
| Disallow | /research_books/forward/ |
| Disallow | /research_events/forward/ |