maplesystems.com
robots.txt

Robots Exclusion Standard data for maplesystems.com

Resource Scan

Scan Details

Site Domain maplesystems.com
Base Domain maplesystems.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-11T23:23:58+00:00
Next Scan 2026-04-12T23:23:58+00:00

Last Successful Scan

Scanned2025-11-21T03:59:37+00:00
URL https://maplesystems.com/robots.txt
Domain IPs 104.26.12.170, 104.26.13.170, 172.67.71.155, 2606:4700:20::681a:caa, 2606:4700:20::681a:daa, 2606:4700:20::ac43:479b
Response IP 104.26.13.170
Found Yes
Hash 5f4ef2d8f67567299c75c3db386db49a2cbf16d0082aaa77fcd9a533593b2acc
SimHash 58606b820ed2

Groups

*

Rule Path
Disallow /*.dwg
Disallow /s%3D
Disallow /*_product_categories%3D
Disallow /*add-to-cart%3D
Disallow /reviews/submission/
Disallow /author/
Disallow /download/
Disallow /*post_type%3Ddlm_download
Disallow /my-account/
Disallow /wp-content/uploads/
Disallow /ms_playlist/
Disallow /checkout/
Disallow /feature/
Disallow /label/
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

scrapy

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

node/simplecrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://maplesystems.com/sitemap_index.xml

Comments

  • General rules for all bots
  • Algolia-Crawler-Verif: DFAA0A631B697C35
  • Block scrapers
  • Sitemap