buspar.directory
robots.txt
Robots Exclusion Standard data for buspar.directory
Resource Scan
Scan Details
| Site Domain | buspar.directory |
| Base Domain | buspar.directory |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-09-15T14:14:15+00:00 |
| Next Scan | 2025-11-14T14:14:15+00:00 |
Last Successful Scan
| Scanned | 2025-06-24T14:44:10+00:00 |
| URL | https://buspar.directory/robots.txt |
| Domain IPs | 2a02:4780:15:f990:3696:b082:7bb5:f479, 2a02:4780:39:d6f1:7975:d7c8:3b79:e788, 84.32.84.136, 84.32.84.238 |
| Response IP | 77.37.66.27 |
| Found | Yes |
| Hash | f54c6b5e13cff0a8d0433a4db8365f964963be9f8641812b14ee4d3682a627b5 |
| SimHash | 720e59e27fa7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
duckduckbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/ |
| Disallow | /private/ |
| Disallow | /temp/ |
| Disallow | /logs/ |
| Allow | /blog/ |
| Allow | /css/ |
| Allow | /js/ |
| Allow | /images/ |
| Allow | /php/ |
| Allow | /index.html |
| Allow | /blog.html |
| Allow | /about.html |
| Allow | /contact.html |
| Allow | /search.html |
| Allow | /privacy-policy.html |
| Allow | /terms-of-service.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://buspar.directory/sitemap.xml |
Comments