fedia.io
robots.txt
Robots Exclusion Standard data for fedia.io
Resource Scan
Scan Details
Site Domain | fedia.io |
Base Domain | fedia.io |
Scan Status | Ok |
Last Scan | 2024-09-24T08:44:44+00:00 |
Next Scan | 2024-09-25T08:44:44+00:00 |
Last Scan
Scanned | 2024-09-24T08:44:44+00:00 |
URL | https://fedia.io/robots.txt |
Domain IPs | 2a01:4f8:2b03:ba0::2, 46.4.252.36 |
Response IP | 46.4.252.36 |
Found | Yes |
Hash | f96cef6d2ecda17cef0f559fcf0a0d9d651f0cd54b7238c1d59ce7c528f052a8 |
SimHash | 73476f7329af |
Groups
*
Rule | Path |
---|---|
Disallow | /login |
Disallow | /login* |
Disallow | /register |
Disallow | /register* |
Disallow | /reset-password |
Disallow | /reset-password* |
Disallow | /sub |
Disallow | /mod |
Disallow | /fav |
Disallow | /new |
Disallow | /new/* |
Disallow | /newMagazine |
Disallow | /terms |
Disallow | /privacy-policy |
Warnings
- 10 invalid lines.
- `request-rate` is not a known field.
Comments