career-edge.net
robots.txt

Robots Exclusion Standard data for career-edge.net

Resource Scan

Scan Details

Site Domain career-edge.net
Base Domain career-edge.net
Scan Status Ok
Last Scan2025-12-01T09:22:48+00:00
Next Scan 2025-12-08T09:22:48+00:00

Last Scan

Scanned2025-12-01T09:22:48+00:00
URL https://career-edge.net/robots.txt
Domain IPs 207.207.26.194
Response IP 207.207.26.194
Found Yes
Hash ca393d716f43f91f82164c14e3d825f191000e0070956dbf6f689128f895cfd9
SimHash b6856d052570

Groups

*

Rule Path
Disallow /create
Disallow /step
Disallow /finish
Disallow /jump_to
Disallow /zip_s
Disallow /lead_s2
Disallow /index3
Disallow /assets

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /