Log In Sign Up

snredatas.com
robots.txt

Robots Exclusion Standard data for snredatas.com

Resource Scan

Scan Details

Site Domain snredatas.com
Base Domain snredatas.com
Scan Status Ok
Last Scan2026-01-22T04:26:51+00:00
Next Scan 2026-02-21T04:26:51+00:00

Last Scan

Scanned2026-01-22T04:26:51+00:00
URL https://snredatas.com/robots.txt
Domain IPs 166.62.10.36
Response IP 166.62.10.36
Found Yes
Hash b2518d512622d9fb73b9c0fae1354f005c60e2105378fef5d6f4e33b25275be9
SimHash 4808ce93e5c3

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /*.json$
Disallow /private/
Allow /public/
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.svg
Allow /*.webp
Allow /*.pdf

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.snredatas.com/sitemap.xml
Back to top

Comments

  • SNR EDATAS Pvt Ltd - Robots.txt
  • Smart Cities, Surveillance & Digital Solutions
  • Allow all crawlers to access all content
  • Crawl-delay for better server performance (in seconds)
  • Disallow access to API endpoints and admin areas (if any)
  • Allow access to static resources
  • Sitemap location
  • Specific User-agents (optional - for major search engines)
  • Block bad bots (optional)
Back to top