boomlive.in
robots.txt

Robots Exclusion Standard data for boomlive.in

Resource Scan

Scan Details

Site Domain boomlive.in
Base Domain boomlive.in
Scan Status Ok
Last Scan2024-09-25T06:55:43+00:00
Next Scan 2024-10-02T06:55:43+00:00

Last Scan

Scanned2024-09-25T06:55:43+00:00
URL https://boomlive.in/robots.txt
Redirect https://www.boomlive.in/robots.txt
Redirect Domain www.boomlive.in
Redirect Base boomlive.in
Domain IPs 104.21.20.137, 172.67.192.240, 2606:4700:3030::6815:1489, 2606:4700:3033::ac43:c0f0
Redirect IPs 2600:9000:20c7:2000:17:bca7:b600:93a1, 2600:9000:20c7:5000:17:bca7:b600:93a1, 2600:9000:20c7:8000:17:bca7:b600:93a1, 2600:9000:20c7:a600:17:bca7:b600:93a1, 2600:9000:20c7:dc00:17:bca7:b600:93a1, 2600:9000:20c7:f400:17:bca7:b600:93a1, 2600:9000:20c7:f600:17:bca7:b600:93a1, 2600:9000:20c7:f800:17:bca7:b600:93a1, 54.230.71.12, 54.230.71.120, 54.230.71.5, 54.230.71.8
Response IP 13.35.18.45
Found Yes
Hash 1fbc745eb312bce6db71cfbce5451440cb729b63a5b5be784046246b147b4f43
SimHash c8421e43cd87

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.boomlive.in/sitemap/sitemap-index.xml
sitemap https://www.boomlive.in/news-sitemap-daily.xml
sitemap https://www.boomlive.in/feeds.xml
sitemap https://www.boomlive.in/sitemap-daily.xml

Comments

  • robots.txt for https://www.boomlive.in/

Warnings

  • 1 invalid line.