michaelhohlgm.com
robots.txt

Robots Exclusion Standard data for michaelhohlgm.com

Resource Scan

Scan Details

Site Domain michaelhohlgm.com
Base Domain michaelhohlgm.com
Scan Status Ok
Last Scan2024-09-26T23:01:56+00:00
Next Scan 2024-10-26T23:01:56+00:00

Last Scan

Scanned2024-09-26T23:01:56+00:00
URL https://michaelhohlgm.com/robots.txt
Redirect https://www.michaelhohlgm.com/robots.txt
Redirect Domain www.michaelhohlgm.com
Redirect Base michaelhohlgm.com
Domain IPs 13.35.18.17, 13.35.18.3, 13.35.18.35, 13.35.18.42
Redirect IPs 13.35.18.17, 13.35.18.3, 13.35.18.35, 13.35.18.42
Response IP 13.35.18.42
Found Yes
Hash fa586f0193bcba83625d7978d8f96eb039313f25049ca9b295b19a3cec470499
SimHash 6b141031c6b0

Groups

googlebot
googlebot-mobile
adsbot-google

Rule Path
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

bingbot
applebot
msnbot
adidxbot
motominerbot
mj12bot
rogerbot
ravencrawler
twitterbot
slurp
duckduckbot
semrushbot
teoma
archive.org_bot

Rule Path
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.michaelhohlgm.com/sitemap.xml
sitemap https://www.idostream.com/sitemaps/96/sitemap1/video-sitemap.xml