pathweb.co
robots.txt
Robots Exclusion Standard data for pathweb.co
Resource Scan
Scan Details
| Site Domain | pathweb.co |
| Base Domain | pathweb.co |
| Scan Status | Ok |
| Last Scan | 2025-09-12T16:20:13+00:00 |
| Next Scan | 2025-09-19T16:20:13+00:00 |
Last Scan
| Scanned | 2025-09-12T16:20:13+00:00 |
| URL | https://pathweb.co/robots.txt |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.64.1 |
| Found | Yes |
| Hash | 3dc6a19275d0d7b35ec4ee06aa129ae2ff23b00793a6fdd9ec81dbf590d09a07 |
| SimHash | 62326b4661e2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /data/addonmd5/ |
| Disallow | /data/download/ |
| Disallow | /data/ipdata/ |
| Disallow | /data/log/ |
| Disallow | /data/plugindata/ |
| Disallow | /data/template/ |
| Disallow | /data/threadcache/ |
| Disallow | /source/ |
| Disallow | /install/ |
| Disallow | /template/default/ |
| Disallow | /config/ |
| Disallow | /uc_client/ |
| Disallow | /uc_server/ |
| Disallow | /admin.php |
| Disallow | /search.php |
| Disallow | /member.php |
| Disallow | /api.php |
| Disallow | /misc.php |
| Disallow | /connect.php |
| Disallow | /forum.php?mod=redirect* |
| Disallow | /forum.php?mod=post* |
| Disallow | /home.php?mod=spacecp* |
| Disallow | /*?mod=misc* |
| Disallow | /*?mod=attachment* |
| Disallow | /*mobile%3Dyes* |
Comments