upecotourism.in
robots.txt

Robots Exclusion Standard data for upecotourism.in

Resource Scan

Scan Details

Site Domain upecotourism.in
Base Domain upecotourism.in
Scan Status Ok
Last Scan5/9/2025, 1:42:39 AM
Next Scan 6/8/2025, 1:42:39 AM

Last Scan

Scanned5/9/2025, 1:42:39 AM
URL https://upecotourism.in/robots.txt
Domain IPs 104.21.88.222, 172.67.153.196, 2606:4700:3031::ac43:99c4, 2606:4700:3036::6815:58de
Response IP 172.67.153.196
Found Yes
Hash 087d43f4420dbb25c62ebe83b0ac96832599b479252f2ec9ec3d368834f36069
SimHash 593e5c6262ca

Groups

*

Rule Path
Disallow /admin/
Disallow /private/
Disallow /backup/
Disallow /tmp/
Disallow /test/
Disallow /cgi-bin/
Disallow /config/
Disallow /database/
Disallow /logs/
Disallow /uploads/
Disallow /cache/
Disallow /secure/
Disallow /*.sql$
Disallow /*.bak$
Disallow /*.log$
Disallow /*.txt$
Disallow /*.htm$
Disallow /*.html$
Disallow /*.shtml$
Disallow /*.asp$
Disallow /*.jsp$
Disallow /*.json$
Disallow /*.php$
Disallow /*.phtm$
Disallow /*.phtml$
Disallow /*.env$
Disallow /*.ini$
Disallow /*.conf$
Disallow /*.xml$
Disallow /*.git$
Disallow /*.DS_Store$

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Comments

  • Block specific file types
  • Block known bad bots
  • Block all unknown bots except search engines