52pet.us
robots.txt
Robots Exclusion Standard data for 52pet.us
Resource Scan
Scan Details
| Site Domain | 52pet.us |
| Base Domain | 52pet.us |
| Scan Status | Ok |
| Last Scan | 2024-11-03T00:16:46+00:00 |
| Next Scan | 2024-12-03T00:16:46+00:00 |
Last Scan
| Scanned | 2024-11-03T00:16:46+00:00 |
| URL | https://www.52pet.us/robots.txt |
| Domain IPs | 128.14.74.99 |
| Response IP | 128.14.74.99 |
| Found | Yes |
| Hash | a8bea988b986a0da1c826e2da553cf5c45ec15fe4884cfc02566740094c8c537 |
| SimHash | 644b6bc441ca |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /data/ |
| Disallow | /source/ |
| Disallow | /install/ |
| Disallow | /template/ |
| Disallow | /config/ |
| Disallow | /uc_client/ |
| Disallow | /uc_server/ |
| Disallow | /static/ |
| Disallow | /admin.php |
| Disallow | /search.php |
| Disallow | /member.php |
| Disallow | /api.php |
| Disallow | /misc.php |
| Disallow | /connect.php |
| Disallow | /forum.php?mod=redirect* |
| Disallow | /forum.php?mod=post* |
| Disallow | /home.php?mod=spacecp* |
| Disallow | /userapp.php?mod=app&* |
| Disallow | /*?mod=misc* |
| Disallow | /*?mod=attachment* |
| Disallow | /*mobile%3Dyes* |
Comments