91gob.com
robots.txt
Robots Exclusion Standard data for 91gob.com
Resource Scan
Scan Details
| Site Domain | 91gob.com |
| Base Domain | 91gob.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-28T10:14:14+00:00 |
| Next Scan | 2024-12-27T10:14:14+00:00 |
Last Successful Scan
| Scanned | 2022-11-12T20:27:09+00:00 |
| URL | http://91gob.com/robots.txt |
| Redirect | http://www.py27.com/robots.txt |
| Redirect Domain | www.py27.com |
| Redirect Base | py27.com |
| Response IP | 114.55.66.118 |
| Found | Yes |
| Hash | a8bea988b986a0da1c826e2da553cf5c45ec15fe4884cfc02566740094c8c537 |
| SimHash | 644b6bc441ca |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /data/ |
| Disallow | /source/ |
| Disallow | /install/ |
| Disallow | /template/ |
| Disallow | /config/ |
| Disallow | /uc_client/ |
| Disallow | /uc_server/ |
| Disallow | /static/ |
| Disallow | /admin.php |
| Disallow | /search.php |
| Disallow | /member.php |
| Disallow | /api.php |
| Disallow | /misc.php |
| Disallow | /connect.php |
| Disallow | /forum.php?mod=redirect* |
| Disallow | /forum.php?mod=post* |
| Disallow | /home.php?mod=spacecp* |
| Disallow | /userapp.php?mod=app&* |
| Disallow | /*?mod=misc* |
| Disallow | /*?mod=attachment* |
| Disallow | /*mobile%3Dyes* |
Comments