humancoders.com
robots.txt

Robots Exclusion Standard data for humancoders.com

Resource Scan

Scan Details

Site Domain humancoders.com
Base Domain humancoders.com
Scan Status Ok
Last Scan2025-10-17T14:22:36+00:00
Next Scan 2025-11-16T14:22:36+00:00

Last Scan

Scanned2025-10-17T14:22:36+00:00
URL https://humancoders.com/robots.txt
Redirect https://www.humancoders.com/robots.txt
Redirect Domain www.humancoders.com
Redirect Base humancoders.com
Domain IPs 104.26.6.116, 104.26.7.116, 172.67.70.193, 2606:4700:20::681a:674, 2606:4700:20::681a:774, 2606:4700:20::ac43:46c1
Redirect IPs 104.26.6.116, 104.26.7.116, 172.67.70.193, 2606:4700:20::681a:674, 2606:4700:20::681a:774, 2606:4700:20::ac43:46c1
Response IP 172.67.70.193
Found Yes
Hash fa74d304cda2c4e3a9f7cd1c9ea98af0d063e732139a6d3f214e0ec96e66296a
SimHash 36850d0d74d5

Groups

*

Rule Path
Disallow /formations/*.pdf$
Disallow /diplomas/**
Disallow /participations/**
Disallow /quote_requests/**

Other Records

Field Value
sitemap https://www.humancoders.com/sitemap.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /