pindiy.com
robots.txt

Robots Exclusion Standard data for pindiy.com

Resource Scan

Scan Details

Site Domain pindiy.com
Base Domain pindiy.com
Scan Status Ok
Last Scan2024-09-18T10:40:08+00:00
Next Scan 2024-09-25T10:40:08+00:00

Last Scan

Scanned2024-09-18T10:40:08+00:00
URL https://pindiy.com/robots.txt
Redirect https://www.pindiy.com/robots.txt
Redirect Domain www.pindiy.com
Redirect Base pindiy.com
Domain IPs 104.21.37.139, 172.67.209.39, 2606:4700:3033::ac43:d127, 2606:4700:3034::6815:258b
Redirect IPs 104.21.37.139, 172.67.209.39, 2606:4700:3033::ac43:d127, 2606:4700:3034::6815:258b
Response IP 172.67.209.39
Found Yes
Hash ea3e2951fb7517a05178910c67698008db7413f2ea74e1565cfaca7624acbf03
SimHash 6c224b544b78

Groups

*

Rule Path
Disallow .rar
Disallow .zip
Disallow /api/
Allow /data/attachment
Disallow /install/
Disallow /config/
Disallow /uc_client/
Disallow /uc_server/data/config.inc.php
Allow /uc_server/data
Disallow /admin.php
Disallow /search.php
Disallow /member.php
Disallow /api.php
Disallow /misc.php
Disallow /connect.php
Disallow /shell.php
Disallow /forum.php?mod=redirect*
Disallow /forum.php?mod=post*
Disallow /home.php?mod=spacecp*
Disallow /userapp.php?mod=app&*
Disallow /*?mod=misc*
Disallow /*?mod=attachment*
Allow /data/cache/
Allow /ad/
Allow .jpg$
Allow .gif$
Allow .png$
Allow .js$
Allow .css$

Other Records

Field Value
sitemap https://www.pindiy.com/data/plugindata/ror_sitemap/sitemap.xml
sitemap https://www.pindiy.com/search/sitemap.xml
sitemap https://www.pindiy.com/data/plugindata/amp/sitemap.xml

Comments

  • User-agent: Mediapartners-Google
  • Disallow:
  • Disallow: /*?*
  • Disallow: .attach
  • Disallow: /data/
  • Disallow: /source/
  • Disallow: /template/
  • Disallow: /*mobile=yes*