jensentools.com
robots.txt

Robots Exclusion Standard data for jensentools.com

Resource Scan

Scan Details

Site Domain jensentools.com
Base Domain jensentools.com
Scan Status Ok
Last Scan2025-08-21T19:37:27+00:00
Next Scan 2025-09-20T19:37:27+00:00

Last Scan

Scanned2025-08-21T19:37:27+00:00
URL https://jensentools.com/robots.txt
Redirect https://www.jensentools.com/robots.txt
Redirect Domain www.jensentools.com
Redirect Base jensentools.com
Domain IPs 52.3.163.37
Redirect IPs 104.18.33.131, 172.64.154.125, 2606:4700:4400::6812:2183, 2606:4700:4400::ac40:9a7d
Response IP 104.18.33.131
Found Yes
Hash 1b6e5266215906dce12039044950fb9c6dcc6e0a57f69d2bc9eadfba9c8c3c06
SimHash 727fdab8e890

Groups

petalbot

Rule Path
Disallow /

petal bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bytespide

Rule Path
Disallow /

coccobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

hubspotcontentsearchbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

brightedge crawler

Rule Path
Disallow /

pubmatic crawler bot

Rule Path
Disallow /

nimble crawler

Rule Path
Disallow /

prewave crawler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

seekport

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

*

Rule Path
Disallow /Search
Disallow /search
Disallow /MyAccount
Disallow /MyAccount/
Disallow /Account
Disallow /QuickBuy
Disallow /Catalog/ProductComparison/*

Other Records

Field Value
sitemap https://www.jensentools.com/sitemapindex.xml