freebookspot.pro
robots.txt
Robots Exclusion Standard data for freebookspot.pro
Resource Scan
Scan Details
Site Domain | freebookspot.pro |
Base Domain | freebookspot.pro |
Scan Status | Ok |
Last Scan | 2024-09-28T06:06:09+00:00 |
Next Scan | 2024-10-05T06:06:09+00:00 |
Last Scan
Scanned | 2024-09-28T06:06:09+00:00 |
URL | https://freebookspot.pro/robots.txt |
Domain IPs | 104.21.94.52, 172.67.219.210, 2606:4700:3030::ac43:dbd2, 2606:4700:3037::6815:5e34 |
Response IP | 104.21.94.52 |
Found | Yes |
Hash | b7b90f747ab3b6e4430ccbd76d7b1eb708be15c97b725ddb30aeb7e0159ea49c |
SimHash | e9d8cae40792 |
Groups
*
Rule | Path |
---|---|
Disallow | /ForgotPWD |
Disallow | /epub |
Disallow | /NotFound |
Disallow | /commentsshort |
Disallow | /UserProfile |
Disallow | /ClientFavorites |
Disallow | /Filters |
Disallow | /Recommended |
Disallow | /ClientLinks |
Disallow | /UserSelections |
Disallow | /Newsmakers |
Disallow | /ClientItems |
Disallow | /commentsdeleted |
Disallow | /Subscriptions |
Disallow | /Filters |