thebrainbin.org
robots.txt
Robots Exclusion Standard data for thebrainbin.org
Resource Scan
Scan Details
Site Domain | thebrainbin.org |
Base Domain | thebrainbin.org |
Scan Status | Ok |
Last Scan | 2024-11-15T19:52:39+00:00 |
Next Scan | 2024-11-16T19:52:39+00:00 |
Last Scan
Scanned | 2024-11-15T19:52:39+00:00 |
URL | https://thebrainbin.org/robots.txt |
Domain IPs | 128.140.7.90 |
Response IP | 128.140.7.90 |
Found | Yes |
Hash | f96cef6d2ecda17cef0f559fcf0a0d9d651f0cd54b7238c1d59ce7c528f052a8 |
SimHash | 73476f7329af |
Groups
*
Rule | Path |
---|---|
Disallow | /login |
Disallow | /login* |
Disallow | /register |
Disallow | /register* |
Disallow | /reset-password |
Disallow | /reset-password* |
Disallow | /sub |
Disallow | /mod |
Disallow | /fav |
Disallow | /new |
Disallow | /new/* |
Disallow | /newMagazine |
Disallow | /terms |
Disallow | /privacy-policy |
Warnings
- 10 invalid lines.
- `request-rate` is not a known field.
Comments