bae.st
robots.txt
Robots Exclusion Standard data for bae.st
Resource Scan
Scan Details
| Site Domain | bae.st |
| Base Domain | bae.st |
| Scan Status | Ok |
| Last Scan | 2024-10-03T00:52:06+00:00 |
| Next Scan | 2024-10-04T00:52:06+00:00 |
Last Scan
| Scanned | 2024-10-03T00:52:06+00:00 |
| URL | https://bae.st/robots.txt |
| Domain IPs | 198.251.82.229 |
| Response IP | 198.251.82.229 |
| Found | Yes |
| Hash | 68d50c0a7a9f5986df5189cd51ee3de32e6933c5ac268b1d96fcc46d4aee4047 |
| SimHash | aa943bc4ff62 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /web |
| Disallow | /settings |
| Disallow | /login |
| Disallow | /user-search |
| Disallow | /registration |
| Disallow | /cgi-bin |
| Disallow | /pages/DMCA.html |
| Disallow | /oauth |
| Disallow | /search |
Comments