2db1k.com
robots.txt

Robots Exclusion Standard data for 2db1k.com

Resource Scan

Scan Details

Site Domain 2db1k.com
Base Domain 2db1k.com
Scan Status Ok
Last Scan2025-07-15T03:27:32+00:00
Next Scan 2025-08-14T03:27:32+00:00

Last Scan

Scanned2025-07-15T03:27:32+00:00
URL https://www.2db1k.com/robots.txt
Domain IPs 104.21.20.242, 172.67.194.225, 2606:4700:3030::6815:14f2, 2606:4700:3032::ac43:c2e1
Response IP 104.21.20.242
Found Yes
Hash 4401c2a5993baec05012b89240315c4b1db8fe1e5281d0f867be4656709fc6fa
SimHash c05595166f08

Groups

baiduspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-image

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-render

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou web spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou inst spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou spider2

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou blog

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou news spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou orion spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

yisouspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bytespider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

googlebot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bingbot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Warnings

  • 6 invalid lines.