code.market
robots.txt

Robots Exclusion Standard data for code.market

Resource Scan

Scan Details

Site Domain code.market
Base Domain code.market
Scan Status Ok
Last Scan2024-09-21T19:57:20+00:00
Next Scan 2024-10-21T19:57:20+00:00

Last Scan

Scanned2024-09-21T19:57:20+00:00
URL https://code.market/robots.txt
Domain IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash 0ef46b83a884dee34d99ea82b868c1faf9d04bd4f0f5cf2141eb8d266a8a1b67
SimHash 115513f6de10

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /
Allow /category/*
Allow /marketplace/*
Allow /tag/*
Allow /product/*
Allow /page/*
Disallow /admin/
Disallow /account/*
Disallow /private/

Other Records

Field Value
sitemap https://code.market/sitemap.xml
sitemap https://code.market/marketplace-sitemap.xml
sitemap https://code.market/codemarket-catalog-sitemap.xml

Comments

  • New dynamic sitemaps for products
  • Prev static sitemaps