codeshare.me
robots.txt

Robots Exclusion Standard data for codeshare.me

Resource Scan

Scan Details

Site Domain codeshare.me
Base Domain codeshare.me
Scan Status Ok
Last Scan2025-09-23T21:48:41+00:00
Next Scan 2025-09-30T21:48:41+00:00

Last Scan

Scanned2025-09-23T21:48:41+00:00
URL https://codeshare.me/robots.txt
Domain IPs 104.21.54.135, 172.67.138.241, 2606:4700:3032::ac43:8af1, 2606:4700:3034::6815:3687
Response IP 104.21.54.135
Found Yes
Hash 23f44e8af7d917dc3329744f3665142339f324e6e5d11050eebbb2665c2b8f0d
SimHash 0f32dcb22e27

Groups

*

Rule Path
Allow /
Allow /discovery
Allow /users
Allow /features
Allow /pricing
Allow /about
Allow /contact
Allow /terms
Allow /status
Allow /help
Disallow /dashboard
Disallow /my-code
Disallow /api/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://codeshare.me/sitemap.xml
sitemap https://codeshare.me/sitemap-main.xml
sitemap https://codeshare.me/sitemap-users.xml
sitemap https://codeshare.me/sitemap-snippets.xml
sitemap https://codeshare.me/avatarsitemap.xml

Comments

  • Important pages
  • Disallow user-specific pages
  • Sitemaps
  • Crawl delay