le4rf.com
robots.txt

Robots Exclusion Standard data for le4rf.com

Resource Scan

Scan Details

Site Domain le4rf.com
Base Domain le4rf.com
Scan Status Ok
Last Scan2025-07-15T02:13:25+00:00
Next Scan 2025-08-14T02:13:25+00:00

Last Scan

Scanned2025-07-15T02:13:25+00:00
URL https://www.le4rf.com/robots.txt
Domain IPs 104.21.73.250, 172.67.151.207, 2606:4700:3031::6815:49fa, 2606:4700:3034::ac43:97cf
Response IP 172.67.151.207
Found Yes
Hash 4401c2a5993baec05012b89240315c4b1db8fe1e5281d0f867be4656709fc6fa
SimHash c05595166f08

Groups

baiduspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-image

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

baiduspider-render

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou web spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou inst spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou spider2

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou blog

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou news spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

sogou orion spider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

yisouspider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bytespider

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

googlebot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

bingbot

Rule Path
Disallow /404.html
Disallow /*.php*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Warnings

  • 6 invalid lines.