lbntechsolutions.com
robots.txt

Robots Exclusion Standard data for lbntechsolutions.com

Resource Scan

Scan Details

Site Domain lbntechsolutions.com
Base Domain lbntechsolutions.com
Scan Status Ok
Last Scan2025-11-09T08:14:41+00:00
Next Scan 2025-12-09T08:14:41+00:00

Last Scan

Scanned2025-11-09T08:14:41+00:00
URL https://lbntechsolutions.com/robots.txt
Domain IPs 107.180.14.67
Response IP 107.180.14.67
Found Yes
Hash f25f60742fc453602c62ed3a1c076c33320dfc5237e5d00a79e62e38c92774cb
SimHash 7b1cba51e793

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Disallow /wp-login/
Disallow /private/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

bardcrawler

Rule Path
Allow /

geminibot

Rule Path
Allow /

Other Records

Field Value
sitemap https://lbntechsolutions.com/sitemap.xml
sitemap https://lbntechsolutions.com/blogs/post-sitemap.xml
sitemap https://lbntechsolutions.com/llm.txt

Comments

  • LBN Tech Solutions - robots.txt
  • Allow all crawlers except restricted areas
  • Google & Bing bots
  • AI crawlers
  • Sitemaps