pindiy.com
robots.txt
Robots Exclusion Standard data for pindiy.com
Resource Scan
Scan Details
Site Domain | pindiy.com |
Base Domain | pindiy.com |
Scan Status | Ok |
Last Scan | 2024-11-13T10:42:14+00:00 |
Next Scan | 2024-11-20T10:42:14+00:00 |
Last Scan
Scanned | 2024-11-13T10:42:14+00:00 |
URL | https://pindiy.com/robots.txt |
Redirect | https://www.pindiy.com/robots.txt |
Redirect Domain | www.pindiy.com |
Redirect Base | pindiy.com |
Domain IPs | 104.21.37.139, 172.67.209.39, 2606:4700:3033::ac43:d127, 2606:4700:3034::6815:258b |
Redirect IPs | 104.21.37.139, 172.67.209.39, 2606:4700:3033::ac43:d127, 2606:4700:3034::6815:258b |
Response IP | 104.21.37.139 |
Found | Yes |
Hash | ea3e2951fb7517a05178910c67698008db7413f2ea74e1565cfaca7624acbf03 |
SimHash | 6c224b544b78 |
Groups
*
Rule | Path |
---|---|
Disallow | .rar |
Disallow | .zip |
Disallow | /api/ |
Allow | /data/attachment |
Disallow | /install/ |
Disallow | /config/ |
Disallow | /uc_client/ |
Disallow | /uc_server/data/config.inc.php |
Allow | /uc_server/data |
Disallow | /admin.php |
Disallow | /search.php |
Disallow | /member.php |
Disallow | /api.php |
Disallow | /misc.php |
Disallow | /connect.php |
Disallow | /shell.php |
Disallow | /forum.php?mod=redirect* |
Disallow | /forum.php?mod=post* |
Disallow | /home.php?mod=spacecp* |
Disallow | /userapp.php?mod=app&* |
Disallow | /*?mod=misc* |
Disallow | /*?mod=attachment* |
Allow | /data/cache/ |
Allow | /ad/ |
Allow | .jpg$ |
Allow | .gif$ |
Allow | .png$ |
Allow | .js$ |
Allow | .css$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.pindiy.com/data/plugindata/ror_sitemap/sitemap.xml |
sitemap | https://www.pindiy.com/search/sitemap.xml |
sitemap | https://www.pindiy.com/data/plugindata/amp/sitemap.xml |
Comments