designbundles.net
robots.txt

Robots Exclusion Standard data for designbundles.net

Resource Scan

Scan Details

Site Domain designbundles.net
Base Domain designbundles.net
Scan Status Ok
Last Scan2024-10-05T20:36:49+00:00
Next Scan 2024-10-12T20:36:49+00:00

Last Scan

Scanned2024-10-05T20:36:49+00:00
URL https://designbundles.net/robots.txt
Domain IPs 104.18.28.7, 104.18.29.7, 2606:4700::6812:1c07, 2606:4700::6812:1d07
Response IP 104.18.29.7
Found Yes
Hash cbf96e3a9023200b070c34a8320803820e1dccd88a52542b789ff1c895836657
SimHash 580c5fc5c235

Groups

*

Rule Path
Allow /
Disallow /search*
Disallow /co/s/
Disallow /co/r/
Disallow /switch-currency/*
Disallow /switch-language/*
Disallow /includes/copyright-report.php
Disallow /checkout
Disallow /user/checkoutlogin
Disallow /api/user/validation/*
Disallow /pt/*
Disallow /es/*
Disallow /de/*
Disallow /careers
Disallow /careers/*
Disallow /illustrate-ai/library?search=*
Disallow /api/product/rating/load
Disallow /api/product/product-comment/index
Disallow /admin/
Disallow /community/auth/
Disallow /community/assets/browser-update*.js
Disallow /community/users/
Disallow /community/u/
Disallow /community/my/
Disallow /community/badges/
Disallow /community/search
Disallow /community/search/
Disallow /community/tags
Disallow /community/tags/
Disallow /community/email/
Disallow /community/session
Disallow /community/session/
Disallow /community/admin
Disallow /community/admin/
Disallow /community/user-api-key
Disallow /community/user-api-key/
Disallow /community/*?api_key*
Disallow /community/*?*api_key*
Disallow /community/groups
Disallow /community/groups/
Disallow /community/t/*/*.rss
Disallow /community/tags/*.rss
Disallow /community/c/*.rss
Disallow /community/sitemap.xml
Disallow /templates/fontbundles/common/mustache-templates/*
Disallow /templates/common/mustache-templates/*
Disallow /sitemap-crawl.xml

mauibot

Rule Path
Disallow /community/

semrushbot

Rule Path
Disallow /community/

ahrefsbot

Rule Path
Disallow /community/

blexbot

Rule Path
Disallow /community/

seo spider

Rule Path
Disallow /community/

pinterestbot

Rule Path
Disallow /
Allow /product-feed.php?products=true&bundles=true&all=true

Other Records

Field Value
crawl-delay 0.2

Other Records

Field Value
sitemap https://designbundles.net/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449