jeffersonwells.com
robots.txt

Robots Exclusion Standard data for jeffersonwells.com

Resource Scan

Scan Details

Site Domain jeffersonwells.com
Base Domain jeffersonwells.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-11T15:06:19+00:00
Next Scan 2024-12-10T15:06:19+00:00

Last Successful Scan

Scanned2024-02-08T07:47:04+00:00
URL https://jeffersonwells.com/robots.txt
Redirect https://www.jeffersonwells.com/robots.txt
Redirect Domain www.jeffersonwells.com
Redirect Base jeffersonwells.com
Domain IPs 104.18.35.166, 172.64.152.90, 2606:4700:4400::6812:23a6, 2606:4700:4400::ac40:985a
Redirect IPs 104.18.35.166, 172.64.152.90, 2606:4700:4400::6812:23a6, 2606:4700:4400::ac40:985a
Response IP 172.64.152.90
Found Yes
Hash 7183b4b6293c5ed96ee4bb131349c0a90c993ef6b09e3ac513e37449ef41cb92
SimHash 2a50b901c011

Groups

*

Rule Path
Disallow /

slurp

Rule Path
Allow /
Disallow /candidate

teoma

Rule Path
Allow /
Disallow /candidate

google

Rule Path
Allow /
Disallow /candidate

msnbot

Rule Path
Allow /
Disallow /candidate

exabot

Rule Path
Allow /
Disallow /candidate

bingbot

Rule Path
Allow /
Disallow /candidate

applebot

Rule Path
Allow /
Disallow /candidate

aolbuild

Rule Path
Allow /
Disallow /candidate

googlebot

Rule Path
Allow /
Disallow /candidate

deepcrawl

Rule Path
Allow /
Disallow /candidate

ahrefsbot

Rule Path
Allow /
Disallow /candidate

bingpreview

Rule Path
Allow /
Disallow /candidate

duckduckbot

Rule Path
Allow /
Disallow /candidate

ia_archiver

Rule Path
Allow /
Disallow /candidate

facebot/1.0

Rule Path
Allow /
Disallow /candidate

siteauditbot

Rule Path
Allow /
Disallow /candidate

adsbot-google

Rule Path
Allow /
Disallow /candidate

semrushbot-sa

Rule Path
Allow /
Disallow /candidate

semrushbot-ba

Rule Path
Allow /
Disallow /candidate

semrushbot-si

Rule Path
Allow /
Disallow /candidate

semrushbot-ct

Rule Path
Allow /
Disallow /candidate

semrushbot-bm

Rule Path
Allow /
Disallow /candidate

semrushbot-swa

Rule Path
Allow /
Disallow /candidate

splitsignalbot

Rule Path
Allow /
Disallow /candidate

archive.org_bot

Rule Path
Allow /
Disallow /candidate

mediapartners-google

Rule Path
Allow /
Disallow /candidate

screaming frog seo spider

Rule Path
Allow /
Disallow /candidate

Other Records

Field Value
sitemap https://www.jeffersonwells.com/sitemap.xml