Log In Sign Up

globalcoders.app
robots.txt

Robots Exclusion Standard data for globalcoders.app

Resource Scan

Scan Details

Site Domain globalcoders.app
Base Domain globalcoders.app
Scan Status Ok
Last Scan2026-02-13T08:07:01+00:00
Next Scan 2026-03-15T08:07:01+00:00

Last Scan

Scanned2026-02-13T08:07:01+00:00
URL https://globalcoders.app/robots.txt
Domain IPs 104.21.8.23, 172.67.138.65, 2606:4700:3030::6815:817, 2606:4700:3030::ac43:8a41
Response IP 172.67.138.65
Found Yes
Hash 1bc590f97431190a367c85dc242cd457914c821688b3e1b2aa0fb234fca67405
SimHash e894ff01e5f5

Groups

googlebot

Rule Path
Allow /
Disallow /dashboard
Disallow /profile
Disallow /checkout/*
Disallow /auth/*
Disallow /meeting/*/simulate
Disallow /interview-feedback/*

bingbot

Rule Path
Allow /
Disallow /dashboard
Disallow /profile
Disallow /checkout/*
Disallow /auth/*

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /dashboard
Disallow /profile
Disallow /checkout/*
Disallow /auth/*
Disallow /meeting/*/simulate
Disallow /interview-feedback/*
Disallow /user

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://globalcoders.app/sitemap.xml
Back to top

Comments

  • GlobalCoders - Robots.txt
  • https://globalcoders.app
  • Sitemap location
  • Google
  • Bing
  • Social Media Crawlers (for link previews)
  • All other bots
  • Crawl-delay for respectful crawling (optional)
Back to top