Log In Sign Up

boonindia.ai
robots.txt

Robots Exclusion Standard data for boonindia.ai

Resource Scan

Scan Details

Site Domain boonindia.ai
Base Domain boonindia.ai
Scan Status Ok
Last Scan2025-11-26T19:42:52+00:00
Next Scan 2025-12-10T19:42:52+00:00

Last Scan

Scanned2025-11-26T19:42:52+00:00
URL https://boonindia.ai/robots.txt
Redirect https://www.boonindia.ai/robots.txt
Redirect Domain www.boonindia.ai
Redirect Base boonindia.ai
Domain IPs 3.170.229.104, 3.170.229.128, 3.170.229.39, 3.170.229.87
Redirect IPs 2600:9000:2894:0:17:245d:7280:93a1, 2600:9000:2894:1a00:17:245d:7280:93a1, 2600:9000:2894:1c00:17:245d:7280:93a1, 2600:9000:2894:4200:17:245d:7280:93a1, 2600:9000:2894:4600:17:245d:7280:93a1, 2600:9000:2894:9600:17:245d:7280:93a1, 2600:9000:2894:b600:17:245d:7280:93a1, 2600:9000:2894:ba00:17:245d:7280:93a1, 3.170.229.104, 3.170.229.128, 3.170.229.39, 3.170.229.87
Response IP 3.170.229.39
Found Yes
Hash 60ae9fa5bdfd93592dc90887c937b26f0af590b8e9c0b5ce8dd258054fefe9bc
SimHash 6b1e0c124484

Groups

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://boonindia.ai/sitemap.xml
Back to top

Comments

  • This allows all search engine crawlers to access the entire site.
  • If you had private pages, you would block them like this:
  • Disallow: /admin/
  • Disallow: /private/
  • Location of your sitemap file.
Back to top