codecanyon.net
robots.txt

Robots Exclusion Standard data for codecanyon.net

Resource Scan

Scan Details

Site Domain codecanyon.net
Base Domain codecanyon.net
Scan Status Ok
Last Scan2024-11-03T21:43:07+00:00
Next Scan 2024-11-17T21:43:07+00:00

Last Scan

Scanned2024-11-03T21:43:07+00:00
URL https://codecanyon.net/robots.txt
Domain IPs 104.18.34.245, 172.64.153.11
Response IP 104.18.34.245
Found Yes
Hash 4f00906a46a777f38fc6501399874b6da0a8c6009291e05d586ba2243d81791d
SimHash edbfca53c373

Groups

*

Rule Path
Disallow *?platform*
Disallow */full_screen_preview/
Disallow *?sales*
Disallow */cart/*
Disallow */sign_in?*
Disallow */item_support/
Disallow /affiliate/
Disallow /referral/
Disallow /shopfront-api/
Disallow /shopfront_api/
Disallow /cart/
Disallow *?sort=*
Disallow *%2C*%2C*
Disallow *?attribute_key
Disallow *%5C%2B*%5C%2B*
Disallow /cart$
Disallow /sign_in
Disallow /consociate/
Disallow *price_min%3D*
Disallow *price_max%3D*
Disallow */screenshots/
Disallow /bookmarks/widget
Disallow /favorites?
Disallow *item_id
Disallow /my/*
Disallow *discount_type%3D*
Disallow /storefront/
Disallow /cdn-cgi/

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googleother

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://codecanyon.net/sitemap.xml.gz
sitemap https://codecanyon.net/lp/sitemap.xml
sitemap https://codecanyon.net/useful-sitemap.xml.gz