sensorindia.co.in
robots.txt

Robots Exclusion Standard data for sensorindia.co.in

Resource Scan

Scan Details

Site Domain sensorindia.co.in
Base Domain sensorindia.co.in
Scan Status Ok
Last Scan2025-07-14T00:03:54+00:00
Next Scan 2025-08-13T00:03:54+00:00

Last Scan

Scanned2025-07-14T00:03:54+00:00
URL https://sensorindia.co.in/robots.txt
Redirect https://www.sensorindia.co.in/robots.txt
Redirect Domain www.sensorindia.co.in
Redirect Base sensorindia.co.in
Domain IPs 153.92.12.179, 2a02:4780:15:942:4170:d2f8:b12b:a36d, 2a02:4780:16:741b:b203:67e1:72f6:9dad, 91.108.119.244
Redirect IPs 179.61.189.89, 2a02:4780:52:f44d:d5a2:2b85:72cf:830, 2a02:4780:53:6d1e:d625:11b7:3b59:12b6, 93.127.201.8
Response IP 93.127.196.176
Found Yes
Hash ac2c5d122a412949e39e93c2756955397e0281f22f39975d29eeabba3f1edec3
SimHash 200d8f4145ba

Groups

*

Rule Path
Allow /

badbot

Rule Path
Disallow /

semalt

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sensorindia.co.in/sitemap.xml
sitemap https://www.sensorindia.co.in/sitemap
sitemap https://www.sensorindia.co.in/index.php?route=extension/feed/simple_google_sitemap

Comments

  • Sitemap (Important for SEO)
  • Block malicious bots (Optional)