netnethunter.com
robots.txt
Robots Exclusion Standard data for netnethunter.com
Resource Scan
Scan Details
| Site Domain | netnethunter.com |
| Base Domain | netnethunter.com |
| Scan Status | Ok |
| Last Scan | 2025-11-01T02:21:00+00:00 |
| Next Scan | 2025-12-01T02:21:00+00:00 |
Last Scan
| Scanned | 2025-11-01T02:21:00+00:00 |
| URL | https://netnethunter.com/robots.txt |
| Domain IPs | 104.21.6.116, 172.67.134.197, 2606:4700:3031::6815:674, 2606:4700:3032::ac43:86c5 |
| Response IP | 172.67.134.197 |
| Found | Yes |
| Hash | a7597072d43145cc6be8effa450de5059b555a96b4555c6c2783f29852b89ec0 |
| SimHash | 9959ec058fd1 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | - |
| Disallow | /pdfs/ | Block the /pdfs/directory. |
| Disallow | *.pdf$ | Block pdf files from all bots. Albeit non-standard, it works for major search engines. |
| Disallow | /members/ | - |
| Disallow | /pdf-download/ | - |
| Disallow | /home-2 | - |
| Disallow | /ncav-media-center/value-investing-basics/ | - |