aibrt.org
robots.txt
Robots Exclusion Standard data for aibrt.org
Resource Scan
Scan Details
Site Domain | aibrt.org |
Base Domain | aibrt.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-10-03T08:01:20+00:00 |
Next Scan | 2025-12-02T08:01:20+00:00 |
Last Successful Scan
Scanned | 2025-05-14T01:53:18+00:00 |
URL | https://aibrt.org/robots.txt |
Domain IPs | 207.244.67.1 |
Response IP | 207.244.67.1 |
Found | Yes |
Hash | c86b3d510c450828c6735d83d0eb3af2ad747ffb1aac559a1333959cbf5042d7 |
SimHash | 231b351a0be3 |
Groups
*
Rule | Path |
---|---|
Disallow | /.errordocs/ |
Disallow | /_db_backups/ |
Disallow | /AblePath/ |
Disallow | /AblePath/survey |
Disallow | /AblePath/privacy |
Disallow | /ablepathassociates/ |
Disallow | /administrator/ |
Disallow | /autocomplete1/ |
Disallow | /autocomplete2-rand/ |
Disallow | /autocomplete3-4_8_rand/ |
Disallow | /autocomplete4_248/ |
Disallow | /backups/ |
Disallow | /bannerads/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /cgi/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /disclosure/ |
Disallow | /disclosure_inventory/ |
Disallow | /downloads/ |
Disallow | /images/ |
Disallow | /includes/ |
Disallow | /intrusiveness/ |
Disallow | /IRB/ |
Disallow | /joombackup/ |
Disallow | /kickstarter/ |
Disallow | /kicktemp/ |
Disallow | /language/ |
Disallow | /layouts/ |
Disallow | /libraries/ |
Disallow | /log/ |
Disallow | /media/ |
Disallow | /mmp_upgrade/ |
Disallow | /modules/ |
Disallow | /opinionmatching1/ |
Disallow | /plugins/ |
Disallow | /POS/ |
Disallow | /POS-AB-1/ |
Disallow | /POS-AB1/ |
Disallow | /POS-AB2-Australia-b/ |
Disallow | /POS-Australia/ |
Disallow | /POS-India/ |
Disallow | /POS-MS/ |
Disallow | /POS-Offline-NT-ai/ |
Disallow | /POS-Offline-NT-bg/ |
Disallow | /POS-Offline-NT-fr/ |
Disallow | /POS-Offline_OC/ |
Disallow | /Offline_real_time_display/ |
Disallow | /Offline_UK/ |
Disallow | /Offline_UKa/ |
Disallow | /Offline-UKba/ |
Disallow | /POS-SSE1/ |
Disallow | /POS-UKa/ |
Disallow | /POS-UKba/ |
Disallow | /POS-WorkerIDs/ |
Disallow | /services/ |
Disallow | /stats/ |
Disallow | /SunlightEnterprises/ |
Disallow | /survey/ |
Disallow | /TechnologyMonitors.org/ |
Disallow | /templates/ |
Disallow | /testTracking/ |
Disallow | /tmp/ |
Disallow | /VTEB1/ |
Disallow | /xyz/ |
Comments