Log In Sign Up

gundersonfh.com
robots.txt

Robots Exclusion Standard data for gundersonfh.com

Resource Scan

Scan Details

Site Domain gundersonfh.com
Base Domain gundersonfh.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-22T04:54:54+00:00
Next Scan 2024-11-21T04:54:54+00:00

Last Successful Scan

Scanned2024-08-13T04:53:29+00:00
URL https://gundersonfh.com/robots.txt
Redirect https://www.gundersonfh.com/robots.txt
Redirect Domain www.gundersonfh.com
Redirect Base gundersonfh.com
Domain IPs 104.22.40.182, 104.22.41.182, 172.67.43.160, 2606:4700:10::6816:28b6, 2606:4700:10::6816:29b6, 2606:4700:10::ac43:2ba0
Redirect IPs 104.22.40.182, 104.22.41.182, 172.67.43.160, 2606:4700:10::6816:28b6, 2606:4700:10::6816:29b6, 2606:4700:10::ac43:2ba0
Response IP 172.67.43.160
Found Yes
Hash 16fc3e8d0eceea7e2281a9906cc1a5e9e19992ce9e259707608882624012c094
SimHash 2a0771d2cd42

Groups

*

Rule Path
Disallow /bin/
Disallow /VideoUtils/
Disallow /gb/
Disallow /SocialMedia/
Disallow /FunHelper/
Disallow /ObituariesHelper/RefreshComments
Disallow /ObituariesHelper/ObituaryEventsLoad
Disallow /ObituariesHelper/PurchaseWallProduct
Allow /FunHelper/Print

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

uptimebot/1.0

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

naver.me

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

addthis

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

lanaibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

panscient

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /obituaries/*
Back to top

Other Records

Field Value
sitemap https://www.gundersonfh.com/sitemap.xml
sitemap https://www.gundersonfh.com/obituaries-sitemap/19.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/18.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/17.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/16.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/15.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/14.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/13.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/12.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/11.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/10.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/9.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/8.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/7.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/6.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/5.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/4.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/3.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/2.xml.gz
sitemap https://www.gundersonfh.com/obituaries-sitemap/1.xml.gz
sitemap https://www.gundersonfh.com/static-sitemap.xml
Back to top

Comments

  • robots.txt for Umbraco
Back to top

Warnings

  • 2 invalid lines.
Back to top