freereadfeed.com
robots.txt
Robots Exclusion Standard data for freereadfeed.com
Resource Scan
Scan Details
Site Domain | freereadfeed.com |
Base Domain | freereadfeed.com |
Scan Status | Ok |
Last Scan | 2024-11-04T20:49:15+00:00 |
Next Scan | 2024-11-11T20:49:15+00:00 |
Last Scan
Scanned | 2024-11-04T20:49:15+00:00 |
URL | https://freereadfeed.com/robots.txt |
Redirect | https://www.freereadfeed.com/robots.txt |
Redirect Domain | www.freereadfeed.com |
Redirect Base | freereadfeed.com |
Domain IPs | 173.236.163.171 |
Redirect IPs | 173.236.163.171 |
Response IP | 173.236.163.171 |
Found | Yes |
Hash | f855531401fdea94c25b52ac6de0960e233ea77d7d2224b415fdd77d786ad6fa |
SimHash | fc096942c952 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax |
Disallow | /error |
Disallow | /go |
Disallow | /inc |
Disallow | /misc |
Disallow | /resources |
Disallow | /static |
Disallow | /~logs |