Log In Sign Up

jeffersonwells.nl
robots.txt

Robots Exclusion Standard data for jeffersonwells.nl

Resource Scan

Scan Details

Site Domain jeffersonwells.nl
Base Domain jeffersonwells.nl
Scan Status Ok
Last Scan2024-11-13T20:20:30+00:00
Next Scan 2024-11-27T20:20:30+00:00

Last Scan

Scanned2024-11-13T20:20:30+00:00
URL https://jeffersonwells.nl/robots.txt
Redirect https://www.jeffersonwells.nl/robots.txt
Redirect Domain www.jeffersonwells.nl
Redirect Base jeffersonwells.nl
Domain IPs 104.18.137.88, 104.18.138.88, 2606:4700::6812:8958, 2606:4700::6812:8a58
Redirect IPs 104.18.137.88, 104.18.138.88, 2606:4700::6812:8958, 2606:4700::6812:8a58
Response IP 104.18.138.88
Found Yes
Hash 4d31e1d4a92bd569e89b0fd6e156bdb5526e286ab6270579142177a9ca8a9d6d
SimHash 2a5099d0c011

Groups

teoma

Rule Path
Allow /
Disallow /en
Disallow /candidate

google

Rule Path
Allow /
Disallow /en
Disallow /candidate

msnbot

Rule Path
Allow /
Disallow /en
Disallow /candidate

exabot

Rule Path
Allow /
Disallow /en
Disallow /candidate

bingbot

Rule Path
Allow /
Disallow /en
Disallow /candidate

applebot

Rule Path
Allow /
Disallow /en
Disallow /candidate

aolbuild

Rule Path
Allow /
Disallow /en
Disallow /candidate

googlebot

Rule Path
Allow /
Disallow /en
Disallow /candidate

deepcrawl

Rule Path
Allow /
Disallow /en
Disallow /candidate

ahrefsbot

Rule Path
Allow /
Disallow /en
Disallow /candidate

bingpreview

Rule Path
Allow /
Disallow /en
Disallow /candidate

duckduckbot

Rule Path
Allow /
Disallow /en
Disallow /candidate

ia_archiver

Rule Path
Allow /
Disallow /en
Disallow /candidate

facebot/1.0

Rule Path
Allow /
Disallow /en
Disallow /candidate

siteauditbot

Rule Path
Allow /
Disallow /en
Disallow /candidate

adsbot-google

Rule Path
Allow /
Disallow /en
Disallow /candidate

semrushbot-sa

Rule Path
Allow /
Disallow /en
Disallow /candidate

semrushbot-ba

Rule Path
Allow /
Disallow /en
Disallow /candidate

semrushbot-si

Rule Path
Allow /
Disallow /en
Disallow /candidate

semrushbot-ct

Rule Path
Allow /
Disallow /en
Disallow /candidate

semrushbot-bm

Rule Path
Allow /
Disallow /en
Disallow /candidate

semrushbot-swa

Rule Path
Allow /
Disallow /en
Disallow /candidate

splitsignalbot

Rule Path
Allow /
Disallow /en
Disallow /candidate

archive.org_bot

Rule Path
Allow /
Disallow /en
Disallow /candidate

*
slurp

Rule Path
Allow /
Disallow /en
Disallow /candidate

mediapartners-google

Rule Path
Allow /
Disallow /en
Disallow /candidate

screaming frog seo spider

Rule Path
Allow /
Disallow /en
Disallow /candidate
Back to top

Other Records

Field Value
sitemap https://www.jeffersonwells.nl/sitemap.xml
Back to top