pdfdrive.com
robots.txt
Robots Exclusion Standard data for pdfdrive.com
Resource Scan
Scan Details
Site Domain | pdfdrive.com |
Base Domain | pdfdrive.com |
Scan Status | Ok |
Last Scan | 2024-05-16T04:59:28+00:00 |
Next Scan | 2024-05-23T04:59:28+00:00 |
Last Scan
Scanned | 2024-05-16T04:59:28+00:00 |
URL | https://pdfdrive.com/robots.txt |
Redirect | http://www.pdfdrive.com/robots.txt |
Redirect Domain | www.pdfdrive.com |
Redirect Base | pdfdrive.com |
Domain IPs | 104.21.37.10, 172.67.202.44, 2606:4700:3033::6815:250a, 2606:4700:3034::ac43:ca2c |
Redirect IPs | 104.21.37.10, 172.67.202.44, 2606:4700:3033::6815:250a, 2606:4700:3034::ac43:ca2c |
Response IP | 104.21.37.10 |
Found | Yes |
Hash | 8e7b5776d4937a43f40c52f90e7022ade944c205206f20f52e20096c60ad10f2 |
SimHash | c414c2d553fe |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /ebook/broken* |
Disallow | /ebook/preview* |
Disallow | /ebook/counter* |
Disallow | /ebook/c* |
Disallow | /Search/amazon* |
Disallow | /search/complete* |
Disallow | /home/c? |
Disallow | /search? |
Disallow | /book/search? |
Disallow | /home/setLocal? |
Disallow | /download? |
Disallow | /download.pdf? |