themeforest.com
robots.txt

Robots Exclusion Standard data for themeforest.com

Resource Scan

Scan Details

Site Domain themeforest.com
Base Domain themeforest.com
Scan Status Ok
Last Scan2025-11-15T16:02:26+00:00
Next Scan 2025-12-15T16:02:26+00:00

Last Scan

Scanned2025-11-15T16:02:26+00:00
URL http://themeforest.com/robots.txt
Redirect https://themeforest.net/robots.txt
Redirect Domain themeforest.net
Redirect Base themeforest.net
Domain IPs 65.8.81.113, 65.8.81.167, 65.8.81.186, 65.8.81.76
Redirect IPs 104.18.43.76, 172.64.144.180
Response IP 104.18.43.76
Found Yes
Hash a231146da6f1fc4a1cd83800e6ae6560d3c43ef0d880a30814113fd0301173a6
SimHash ed9fc053c377

Groups

*

Rule Path
Disallow *?platform*
Disallow */full_screen_preview/
Disallow *?sales*
Disallow */cart/*
Disallow */sign_in?*
Disallow */item_support/
Disallow /affiliate/
Disallow /referral/
Disallow /shopfront-api/
Disallow /shopfront_api/
Disallow /cart/
Disallow *?sort=*
Disallow *%2C*%2C*
Disallow *?attribute_key
Disallow *%5C%2B*%5C%2B*
Disallow /cart$
Disallow /sign_in
Disallow /consociate/
Disallow *price_min%3D*
Disallow *price_max%3D*
Disallow */screenshots/
Disallow /bookmarks/widget
Disallow /favorites?
Disallow *item_id
Disallow /my/*
Disallow *discount_type%3D*
Disallow /storefront/
Disallow /cdn-cgi/
Disallow /checkout/

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://themeforest.net/sitemap.xml.gz
sitemap https://themeforest.net/lp/sitemap.xml
sitemap https://themeforest.net/useful-sitemap.xml.gz