chillzee.in
robots.txt

Robots Exclusion Standard data for chillzee.in

Resource Scan

Scan Details

Site Domain chillzee.in
Base Domain chillzee.in
Scan Status Ok
Last Scan2024-05-11T18:35:16+00:00
Next Scan 2024-05-18T18:35:16+00:00

Last Scan

Scanned2024-05-11T18:35:16+00:00
URL https://chillzee.in/robots.txt
Redirect https://www.chillzee.in/robots.txt
Redirect Domain www.chillzee.in
Redirect Base chillzee.in
Domain IPs 104.21.2.146, 172.67.129.80, 2606:4700:3032::6815:292, 2606:4700:3033::ac43:8150
Redirect IPs 104.21.2.146, 172.67.129.80, 2606:4700:3032::6815:292, 2606:4700:3033::ac43:8150
Response IP 172.67.129.80
Found Yes
Hash 7396bd31753307f186795ee0001c72a6088ca6da432a13a5d1412b814eb1e07b
SimHash 731f1d5807e8

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /index.php?option=com_content&view=article&id=2097
Disallow /serial-story-update-schedule*
Disallow /stories/tamil-thodarkathai-all-list?catid=0&id=*
Disallow /stories/tamil-thodarkathai-all-list?showall=&catid=0&id=*
Disallow /stories/tamil-thodarkathai-all-list?showall=&limitstart=&catid=0&id=*
Disallow /home/50-books?start=*
Disallow /onlinebooks-menu/online-tamil-books?catid=*
Disallow /*?format=feed&type=rss
Disallow /component/search/*
Disallow /component/engage/*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

molokaibot

Rule Path
Disallow /

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml