cgi2n.com
robots.txt

Robots Exclusion Standard data for cgi2n.com

Resource Scan

Scan Details

Site Domain cgi2n.com
Base Domain cgi2n.com
Scan Status Ok
Last Scan2025-08-14T09:46:08+00:00
Next Scan 2025-09-13T09:46:08+00:00

Last Scan

Scanned2025-08-14T09:46:08+00:00
URL https://www.cgi2n.com/robots.txt
Domain IPs 104.21.44.244, 172.67.205.125, 2606:4700:3030::6815:2cf4, 2606:4700:3036::ac43:cd7d
Response IP 172.67.205.125
Found Yes
Hash 4401c2a5993baec05012b89240315c4b1db8fe1e5281d0f867be4656709fc6fa
SimHash c05595166f08

Groups

baiduspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-image

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-render

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou web spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou inst spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou spider2

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou blog

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou news spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou orion spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

yisouspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bytespider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

googlebot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bingbot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Warnings

  • 6 invalid lines.