thehypothesis.com
robots.txt

Robots Exclusion Standard data for thehypothesis.com

Resource Scan

Scan Details

Site Domain thehypothesis.com
Base Domain thehypothesis.com
Scan Status Ok
Last Scan2025-07-17T06:24:16+00:00
Next Scan 2025-08-16T06:24:16+00:00

Last Scan

Scanned2025-07-17T06:24:16+00:00
URL https://thehypothesis.com/robots.txt
Redirect https://www.thehypothesis.com/robots.txt
Redirect Domain www.thehypothesis.com
Redirect Base thehypothesis.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.48.1
Found Yes
Hash b5f99236b566a7b0901464920595adec182837c054946820cfede4d2a7f1277c
SimHash 2b3a53ab5cf1

Groups

linkpadbot
linkpad
ahrefsbot
meanpathbot
advbot
afilias web mining tool
aihitbot
archive.org_bot
backlinkcrawler
bdbrandprotect
betabot
blexbot
bpimagewalker*
catchbot
ccbot
cliqzbot
comodo ssl checker
comodo-certificates-spider
content crawler
curl
dcpbot
deusu
discobot
docomo/2.0
dotbot
drupact
ec2linkfinder
edisterbot
exabot
exb language crawler
ezooms
findlinks
go 1.1 package http
gonzo
gslfbot
htdig
httpget
huaweisymantecspider
infohelfer
ips-agent
ipsagent
it2media-domain-crawler
java
jobboerse
kaloogabot
larbin
lb-spider
lex
libwww-perl
linkdex.com
linkpadbot
meanpathbot
megaindex
mia
mj12bot
mlbot
msiecrawler
netestate ne crawler
nutch
obot
openindexspider
opidoobot
pagepeeker
picmole
qualidator*
reverseget
savetheworldheritage
savetheworldheritage.org
schrein
scooter
screenerbot
seodiver
seokicks
seokicks-robot
seznambot
sistrix
sistrix
siteexplorer/1.0b
siteexplorer
slysearch
solomonobot
solomonolinkchecker
sosospider
spbot
spiderlytics
ssearch
suggybot
surveybot
swebot
tineye
turnitinbot
unister*
unisterbot
updownerbot
wbsearchbot
webinator
webliste.ch
webofantbot
wevikabot
wget
wotbox
wotbox
x28-job-bot
xovibot
yacybot
youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /*pmax
Disallow /*pmin
Disallow /*prefn*
Disallow /*prefv*
Disallow /*crefn*
Disallow /*crefv*
Disallow /Account-EditPassword
Disallow /Account-EditProfile
Disallow /Account-Login
Disallow /Account-PasswordReset
Disallow /Account-SaveProfile
Disallow /Account-SetNewPassword
Disallow /Account-Show
Disallow /Account-SubmitRegistration
Disallow /Address-AddAddress
Disallow /Address-DeleteAddress
Disallow /Address-EditAddress
Disallow /Address-List
Disallow /Address-SaveAddress
Disallow /Address-SetDefault
Disallow /CSRF-AjaxFail
Disallow /CSRF-Fail
Disallow /CSRF-Generate
Disallow /Cart-AddBonusProducts
Disallow /Cart-AddCoupon
Disallow /Cart-AddProduct
Disallow /Cart-EditBonusProduct
Disallow /Cart-EditProductLineItem
Disallow /Cart-RemoveCouponLineItem
Disallow /Cart-RemoveProductLineItem
Disallow /Cart-SelectShippingMethod
Disallow /Cart-Show
Disallow /Cart-UpdateQuantity
Disallow /Checkout-Begin
Disallow /Checkout-Login
Disallow /Default-Offline
Disallow /Default-Start
Disallow /Error-Start
Disallow /Globale-Cache
Disallow /Home-ErrorNotFound
Disallow /Login-Logout
Disallow /Login-Show
Disallow /Order-Confirm
Disallow /Order-Details
Disallow /Order-History
Disallow /Order-Track
Disallow /Page-SetLocale
Disallow /Product-ShowBonusProducts
Disallow /Product-ShowQuickView
Disallow /Product-Variation
Disallow /Saveforlater-AddProduct
Disallow /Saveforlater-MoreList
Disallow /Saveforlater-RemoveProduct
Disallow /Search-Content
Disallow /Search-Show
Disallow /variation
Disallow /es/variation
Disallow /Stores-FindStores

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

microsoftpreview

Rule Path
Allow /

bingpreview

Rule Path
Allow /

adidxbot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.uniformadvantage.com/sitemap_index.xml
sitemap https://www.uniformadvantage.com/sitemap_0-product.xml
sitemap https://www.uniformadvantage.com/sitemap_1-image.xml
sitemap https://www.uniformadvantage.com/sitemap_2-category.xml
sitemap https://www.uniformadvantage.com/sitemap_3-content.xml
sitemap https://www.uniformadvantage.com/sitemap_4-pipeline.xml
sitemap https://www.uniformadvantage.com/sitemap_5.xml

Comments

  • Production Robots.txt for The Hypothesis

Warnings

  • 3 invalid lines.