lnwebworks.com
robots.txt

Robots Exclusion Standard data for lnwebworks.com

Resource Scan

Scan Details

Site Domain lnwebworks.com
Base Domain lnwebworks.com
Scan Status Ok
Last Scan2025-10-12T22:58:44+00:00
Next Scan 2025-11-11T22:58:44+00:00

Last Scan

Scanned2025-10-12T22:58:44+00:00
URL https://lnwebworks.com/robots.txt
Redirect https://www.lnwebworks.com/robots.txt
Redirect Domain www.lnwebworks.com
Redirect Base lnwebworks.com
Domain IPs 104.21.8.165, 172.67.139.200, 2606:4700:3034::ac43:8bc8, 2606:4700:3037::6815:8a5
Redirect IPs 97.74.92.105
Response IP 97.74.92.105
Found Yes
Hash f872c7b4c6068d72a7a6e55a4b75b65e0c009fcb34d4ac37e42be670fbb88914
SimHash c5084bc527db

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /category/
Disallow /tag/
Disallow /insight/?paged=
Disallow /insight/?*paged=
Disallow /insight/?keyword=
Disallow /insight/?*keyword=
Disallow /?s=
Disallow /search/
Disallow /wp-login.php
Disallow /wp-register.php
Allow /

Other Records

Field Value
sitemap https://www.lnwebworks.com/sitemap_index.xml

Comments

  • robots.txt for WordPress
  • Block WordPress admin (except Ajax)
  • Block category archives
  • Block tag archives
  • Block paginated insight pages
  • Block insight search/filter pages
  • Block default WordPress search
  • Block login, register, etc.
  • Allow everything else
  • Sitemap