Log In Sign Up

codehunger.in
robots.txt

Robots Exclusion Standard data for codehunger.in

Resource Scan

Scan Details

Site Domain codehunger.in
Base Domain codehunger.in
Scan Status Ok
Last Scan2024-09-23T02:24:36+00:00
Next Scan 2024-09-30T02:24:36+00:00

Last Scan

Scanned2024-09-23T02:24:36+00:00
URL https://codehunger.in/robots.txt
Redirect https://www.codehunger.in/robots.txt
Redirect Domain www.codehunger.in
Redirect Base codehunger.in
Domain IPs 2a02:4780:38:d4f2:1324:1ec0:79f5:dd7a, 77.37.75.124
Redirect IPs 2a02:4780:39:7905:d124:dff4:cb67:fd3c, 84.32.84.81
Response IP 191.101.228.31
Found Yes
Hash 3a2bcd3888170aac8f3bd724f1aec07e5a90ae9bccd55dbd9303c461e06fb0a6
SimHash 202c0b75de81

Groups

*

Rule Path Comment
Disallow /admin/ Disallow access to admin section
Disallow /login/ Disallow access to login pages
Disallow /register/ Disallow access to registration pages
Disallow /cgi-bin/ Disallow access to cgi-bin folder
Disallow /private/ Disallow access to private folder
Allow /public/ -
Allow /images/ -
Allow /css/ -
Allow /js/ -
Back to top

Other Records

Field Value
sitemap https://www.codehunger.in/sitemap.xml
Back to top

Comments

  • Start of the robots.txt file
  • All robots are allowed to access everything
  • Allow all robots to access the public and media content
  • Sitemap location
  • End of the robots.txt file
Back to top