py9pu.com
robots.txt

Robots Exclusion Standard data for py9pu.com

Resource Scan

Scan Details

Site Domain py9pu.com
Base Domain py9pu.com
Scan Status Ok
Last Scan2025-07-15T03:29:44+00:00
Next Scan 2025-08-14T03:29:44+00:00

Last Scan

Scanned2025-07-15T03:29:44+00:00
URL https://www.py9pu.com/robots.txt
Domain IPs 104.21.42.188, 172.67.208.94, 2606:4700:3031::ac43:d05e, 2606:4700:3035::6815:2abc
Response IP 104.21.42.188
Found Yes
Hash 4401c2a5993baec05012b89240315c4b1db8fe1e5281d0f867be4656709fc6fa
SimHash c05595166f08

Groups

baiduspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-image

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-render

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou web spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou inst spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou spider2

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou blog

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou news spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou orion spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

yisouspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bytespider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

googlebot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bingbot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Warnings

  • 6 invalid lines.