foundandsons.com
robots.txt

Robots Exclusion Standard data for foundandsons.com

Resource Scan

Scan Details

Site Domain foundandsons.com
Base Domain foundandsons.com
Scan Status Ok
Last Scan2024-10-02T01:46:31+00:00
Next Scan 2024-11-01T01:46:31+00:00

Last Scan

Scanned2024-10-02T01:46:31+00:00
URL https://foundandsons.com/robots.txt
Redirect https://www.foundandsons.com/robots.txt
Redirect Domain www.foundandsons.com
Redirect Base foundandsons.com
Domain IPs 108.168.254.210
Redirect IPs 104.16.112.135, 104.16.113.135, 104.16.114.135, 104.16.115.135, 104.16.116.135, 2606:4700::6810:7087, 2606:4700::6810:7187, 2606:4700::6810:7287, 2606:4700::6810:7387, 2606:4700::6810:7487
Response IP 104.16.115.135
Found Yes
Hash c430d3c96d44d837292cdf34e355f045e661b581d844ad845b8c03cee85a5a1c
SimHash 779b70e3c7e0

Groups

*

Rule Path
Disallow /tag/tag.js
Disallow /Obituary/Map
Disallow /planning-guide/*.pdf
Disallow /obituaries/RemoveGuestbookMedia
Disallow /obituaries/FacebookObitSearch
Disallow /obituaries/api/search.json
Disallow /obituaries/api/notifications/subscribe.json
Disallow /obituaries/RemoveAlbumMedia
Disallow /obituaries/CheckMediaFileActiveState
Disallow /obituaries/RemoveProcessedFile
Disallow /obituaries/CheckAlbumMediaActiveState
Disallow /obituaries/CreateNewAlbumInline
Disallow /obituaries/DeleteAlbumInline
Disallow /obituaries/DeleteMediaInline
Disallow /obituaries/PaymentUtilities*
Disallow /obituaries/ShowCropBox
Disallow /obituaries/CropBox
Disallow /obituaries/VideoRecorder*
Disallow /obituaries/PhotoUploader*
Disallow /obituaries/SaveSessionState
Disallow /obituaries/SeeHowItWorks
Disallow /obituaries/GetAddressDataByZipCode
Disallow /obituaries/IframeFlowPlayer
Disallow /obituaries/StoreServices*
Disallow /obituaries/StoreServicesAutoComplete
Disallow /obituaries/CreateSharedGuestbookEntry
Disallow /obituaries/CheckEmail
Disallow /obituaries/ChangeProfilePhoto
Disallow /obituaries/MySubscriptions*
Disallow /obituaries/GetTributesAsXML
Disallow /obituaries/Register*
Disallow /obituaries/Recover
Disallow /*/facebookShare*
Disallow /*/GetWeather*
Disallow /*/SaveGuestbookMedia*
Disallow /*/CreateGuestBookEntry*
Disallow /*/AddGuestbookMediaFromUrl*
Disallow /*/CreateRecommentEntry*
Disallow /*/InsertCandle*
Disallow /*/InsertGift*
Disallow /*/StoreInsertGift*
Disallow /*/InsertPaydGift*
Disallow /*/setsimplecookie*
Disallow /*/SubscribeUpdate*
Disallow /*/Unsubscribe*
Disallow /obituaries/FamilyTree/FamilyMapUpdateAddress
Disallow /obituaries/FamilyTree/AddAddress*
Disallow /obituaries/FamilyTree/ProcessCreateAddress
Disallow /*/LoginCallback*
Disallow /*/GiftStore*
Disallow /*/SaveTributePicture*
Disallow /*/ProcessUpdate*
Disallow /*/twitterLogin*
Disallow /*/TwitterLogout*
Disallow /*/TwitterMessageForm*
Disallow /*/SaveAlbumMedia*
Disallow /*/CreateAlbumEntry*
Disallow /*/CreateExpiredGuestbookEntry*
Disallow /*/twitterShareTribute
Disallow /*/Print/Wall*
Disallow /m/obituaries/*/comments/*
Disallow /m/store/*?

mauibot
ahrefsbot
panscient.com
yandex
bubing
megaindex
megaindex.ru
spbot
blexbot
dotbot

Rule Path
Disallow /

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

updownerbot
omniexplorer_bot
freefind
becomebot
nutch
jetbot/1.0
jetbot
webvac
stanford
naver
dumbot
hatena antenna
grub-client
grub
webzip
larbin
b2w/0.1
copernic
psbot
python-urllib
netmechanic
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
copyrightcheck
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
alexibot
teleport
teleportpro
stanford comp sci
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
bullseye/1.0
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
bunnyslippers
microsoft url control - 6.00.8169
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind data gathere
openfind
xenu's link sleuth 1.1c
xenu's
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
getright/4.2
fairad client
gaisbot
aqua_products
radiation retriever 1.1
flaming attackbot
oracle ultra search
msiecrawler
perman
searchpreview
sootle
enterprise_search/1.0
enterprise_search

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.foundandsons.com/sitemap.xml
sitemap https://www.foundandsons.com/store/store-sitemap-root.xml
sitemap https://www.foundandsons.com/store/store-sitemap-categories.xml
sitemap https://www.foundandsons.com/store/store-sitemap-products.xml
sitemap https://www.foundandsons.com/store/store-sitemap-customer-service.xml
sitemap https://www.foundandsons.com/obituaries/sitemap.xml