proteussensor.com
robots.txt

Robots Exclusion Standard data for proteussensor.com

Resource Scan

Scan Details

Site Domain proteussensor.com
Base Domain proteussensor.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-19T21:27:30+00:00
Next Scan 2025-11-26T21:27:30+00:00

Last Successful Scan

Scanned2025-11-04T14:01:00+00:00
URL https://proteussensor.com/robots.txt
Domain IPs 192.124.249.87
Response IP 192.124.249.87
Found Yes
Hash b13e13a3403bc3fb694c1ac00216ba1f3c6dcb7e7bc19ff1fd40bf3fdd70c650
SimHash 49a4dcd2c112

Groups

*

Rule Path
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /tag/
Disallow /review/
Disallow /downloads?amp=1
Disallow /about-us?amp=1
Disallow /wireless-sensor-cloud?amp=1
Disallow /warranty?amp=1
Disallow /support?amp=1
Disallow /customer-service?amp=1
Disallow /home?amp=1
Disallow /terms-of-service?amp=1
Disallow /catalog/product/view/id/8
Disallow /catalog/product/view/id/36
Disallow /test.html
Disallow /catalogsearch/result/index/
Disallow /catalogsearch/result/index/?cat=9&product_list_dir=desc&product_list_order=name&q=%28SELECT%2B%28CASE%2BWHEN%2B%288905%3D8905%29%2BTHEN
Disallow /pub/index.php?
Disallow /pub/index.php?q=test
Disallow /pub/index.php?amp=1
Disallow /pub/index.php?srsltid
Disallow /pub/index.php?amp=1&q=apex
Disallow /pub/index.php?q=test&_
Disallow /pub/index.php?q=
Disallow /pub/index.php?_

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://proteussensor.com/sitemap.xml

Comments

  • Crawl-delay: 120
  • Disallow: /customer/account/
  • Disallow: /customer/account/login/
  • Disallow: /pub/
  • Disallow: /*?amp=1*

Warnings

  • 7 invalid lines.