lababy.by
robots.txt

Robots Exclusion Standard data for lababy.by

Resource Scan

Scan Details

Site Domain lababy.by
Base Domain lababy.by
Scan Status Ok
Last Scan2025-10-10T03:56:39+00:00
Next Scan 2025-11-09T03:56:39+00:00

Last Scan

Scanned2025-10-10T03:56:39+00:00
URL https://lababy.by/robots.txt
Domain IPs 104.21.15.252, 172.67.165.156, 2606:4700:3031::6815:ffc, 2606:4700:3035::ac43:a59c
Response IP 104.21.15.252
Found Yes
Hash 0e0bd0618d9a1fb7958aab6bb90a36918a78c76c18ffe5ca85c56d2f717bb30a
SimHash a874d3126431

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /*?
Disallow /?s=
Disallow /?search=
Allow /*.css$
Allow /*.js$

Comments

  • Global settings for all crawlers
  • Block access to WordPress core directories
  • Prevent crawling of potentially sensitive or unnecessary content
  • Disallow query strings that are commonly used for searches or tracking
  • Allow crawlers to access all CSS and JavaScript files