Log In Sign Up

codechef.com
robots.txt

Robots Exclusion Standard data for codechef.com

Resource Scan

Scan Details

Site Domain codechef.com
Base Domain codechef.com
Scan Status Ok
Last Scan2024-05-21T07:16:30+00:00
Next Scan 2024-05-28T07:16:30+00:00

Last Scan

Scanned2024-05-21T07:16:30+00:00
URL https://codechef.com/robots.txt
Redirect https://www.codechef.com/robots.txt
Redirect Domain www.codechef.com
Redirect Base codechef.com
Domain IPs 104.26.4.157, 104.26.5.157, 172.67.75.52, 2606:4700:20::681a:49d, 2606:4700:20::681a:59d, 2606:4700:20::ac43:4b34
Redirect IPs 104.26.4.157, 104.26.5.157, 172.67.75.52, 2606:4700:20::681a:49d, 2606:4700:20::681a:59d, 2606:4700:20::ac43:4b34
Response IP 172.67.75.52
Found Yes
Hash a3ab3c7780a5e66eb77e18493c288c89f7117999741680984957d811d1b71223
SimHash bc04dd51c574

Groups

*

Rule Path
Allow /includes/*.js
Allow /misc/*.js
Allow /modules/*.js
Allow /profiles/*.js
Allow /scripts/*.js
Allow /sites/*.js
Allow /themes/*.js
Allow /includes/*.js
Allow /misc/*.css
Allow /modules/*.css
Allow /profiles/*.css
Allow /scripts/*.css
Allow /sites/*.css
Allow /themes/*.css
Allow /includes/*.png
Allow /misc/*.png
Allow /modules/*.png
Allow /profiles/*.png
Allow /scripts/*.png
Allow /sites/*.png
Allow /themes/*.png
Allow /includes/*.jpg
Allow /misc/*.jpg
Allow /modules/*.jpg
Allow /profiles/*.jpg
Allow /scripts/*.jpg
Allow /sites/*.jpg
Allow /themes/*.jpg
Allow /includes/*.jpeg
Allow /misc/*.jpeg
Allow /modules/*.jpeg
Allow /profiles/*.jpeg
Allow /scripts/*.jpeg
Allow /sites/*.jpeg
Allow /themes/*.jpeg
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /sites/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin
Disallow /comment/reply
Disallow /contact
Disallow /logout
Disallow /node/add
Disallow /search
Disallow /sets
Disallow /todos
Disallow /viewplaintext/*
Disallow /viewsolution/*
Disallow /recent/user
Disallow /rankings/*
Disallow /campus_chapter/*
Disallow /verify
Disallow /payments
Disallow /jobqueue
Disallow /moss/*
Disallow /lsh/*
Disallow /status/*
Disallow /*/status/*
Disallow /problems/*
Disallow /tags/problems/*
Disallow /users/*
Disallow /teams/view/*
Disallow /teams/list/*
Disallow /?q=admin
Disallow /?q=comment%2Freply
Disallow /?q=contact
Disallow /?q=logout
Disallow /?q=node%2Fadd
Disallow /?q=search
Disallow /?q=sets
Disallow /?q=todos
Disallow /?q=viewplaintext%2F*
Back to top

Other Records

Field Value
sitemap https://www.codechef.com/sitemap.xml
Back to top

Comments

  • $Id: robots.txt,v 1.9.2.1 2008/12/10 20:12:19 goba Exp $
  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • Allowing css, js and images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Add Sitemap
Back to top