despomar.com
robots.txt

Robots Exclusion Standard data for despomar.com

Resource Scan

Scan Details

Site Domain despomar.com
Base Domain despomar.com
Scan Status Ok
Last Scan2025-10-16T03:05:50+00:00
Next Scan 2025-11-15T03:05:50+00:00

Last Scan

Scanned2025-10-16T03:05:50+00:00
URL https://despomar.com/robots.txt
Domain IPs 104.26.2.27, 104.26.3.27, 172.67.74.82, 2606:4700:20::681a:21b, 2606:4700:20::681a:31b, 2606:4700:20::ac43:4a52
Response IP 104.26.2.27
Found Yes
Hash 637ff6ffe6551e2c2f2d2f85f6c387f3d4e00187dac1d1695c29ae7ca64ac4d6
SimHash 6334db4705a6

Groups

*

Rule Path
Disallow /*?
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /admin/
Disallow /catalogsearch/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /review/product/
Disallow /sendfriend/
Disallow /enable-cookies/
Disallow /LICENSE.txt
Disallow /LICENSE.html
Disallow /directory/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /tag/
Disallow /review/

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://ericeirasurfskate.pt/sitemap/ericeira_pt_pt.xml
sitemap https://ericeirasurfskate.pt/sitemap/ericeira_pt_en.xml
sitemap https://ericeirasurfskate.pt/sitemap/ericeira_ww_pt.xml
sitemap https://ericeirasurfskate.pt/sitemap/ericeira_ww_en.xml
sitemap https://58surf.com/sitemap/58surf_pt_pt.xml
sitemap https://58surf.com/sitemap/58surf_pt_en.xml
sitemap https://58surf.com/sitemap/58surf_ww_pt.xml
sitemap https://58surf.com/sitemap/58surf_ww_en.xml
sitemap https://despomar.com/sitemap/despomar_pt.xml
sitemap https://mrstitchservice.com/sitemap/mrstitch_pt.xml
sitemap https://mrstitchservice.com/sitemap/mrstitch_en.xml

Comments

  • Stop crawling user account and checkout pages by search engine robot:
  • Blocking native catalog and search pages:
  • Sometimes Webmasters block pages with filters..
  • Blocking CMS directories.
  • Blocking duplicate content:
  • Sitemaps for each store view

Warnings

  • 1 invalid line.