petkd.com
robots.txt
Robots Exclusion Standard data for petkd.com
Resource Scan
Scan Details
| Site Domain | petkd.com |
| Base Domain | petkd.com |
| Scan Status | Ok |
| Last Scan | 2025-10-17T05:36:17+00:00 |
| Next Scan | 2025-10-24T05:36:17+00:00 |
Last Scan
| Scanned | 2025-10-17T05:36:17+00:00 |
| URL | https://petkd.com/robots.txt |
| Domain IPs | 104.21.72.111, 172.67.182.16, 2606:4700:3031::ac43:b610, 2606:4700:3035::6815:486f |
| Response IP | 104.21.72.111 |
| Found | Yes |
| Hash | 0e9bfd58f1b8eb607ec686a7d6e65fff2ecb5987f774412a36ce19f602c1a9d7 |
| SimHash | 602aedc6419a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /videos/ |
| Disallow | /api/ |
| Disallow | /data/ |
| Disallow | /source/ |
| Disallow | /install/ |
| Disallow | /template/ |
| Disallow | /config/ |
| Disallow | /uc_client/ |
| Disallow | /uc_server/ |
| Disallow | /static/ |
| Disallow | /admin.php |
| Disallow | /search.php |
| Disallow | /member.php |
| Disallow | /api.php |
| Disallow | /misc.php |
| Disallow | /connect.php |
| Disallow | /monitor.php |
| Disallow | /forum.php?mod=redirect* |
| Disallow | /forum.php?mod=post* |
| Disallow | /home.php?mod=spacecp* |
| Disallow | /userapp.php?mod=app&* |
| Disallow | /*?mod=misc* |
| Disallow | /*?mod=attachment* |
| Disallow | /yp.php?mod=rating_process |
| Disallow | /yp.php?mod=mapreport |
| Disallow | /yp.php?mod=add |
| Disallow | /yp.php?mod=edit |
| Disallow | /yp.php?mod=search |
| Disallow | /adopt.php?mod=add |
| Disallow | /adopt.php?mod=edit |
| Disallow | /adopt.php?mod=search |
| Disallow | /pets.php?mod=add |
| Disallow | /pets.php?mod=edit |
| Disallow | /pets.php?mod=search |
| Disallow | /old/ |
| Disallow | /test/ |
| Disallow | /old_wallp/ |
| Disallow | /video/video_tags.php |
| Disallow | /video/get_video.php |
| Disallow | /video/show/ |
| Disallow | /trading.php?mod=post |
| Disallow | /trading.php?mod=edit |
| Disallow | /trading.php?mod=finish |
| Disallow | /trading.php?mod=pricing |
Comments