chefuniforms.com
robots.txt
Robots Exclusion Standard data for chefuniforms.com
Resource Scan
Scan Details
| Site Domain | chefuniforms.com |
| Base Domain | chefuniforms.com |
| Scan Status | Ok |
| Last Scan | 2024-09-08T17:42:44+00:00 |
| Next Scan | 2024-10-08T17:42:44+00:00 |
Last Scan
| Scanned | 2024-09-08T17:42:44+00:00 |
| URL | https://chefuniforms.com/robots.txt |
| Redirect | https://www.chefuniforms.com/robots.txt |
| Redirect Domain | www.chefuniforms.com |
| Redirect Base | chefuniforms.com |
| Domain IPs | 104.20.2.28, 104.20.3.28, 2606:4700:10::6814:21c, 2606:4700:10::6814:31c |
| Redirect IPs | 104.20.2.28, 104.20.3.28, 2606:4700:10::6814:21c, 2606:4700:10::6814:31c |
| Response IP | 104.20.3.28 |
| Found | Yes |
| Hash | 3f9297b269bb9f3b1c3e7823c09123e476aa7dadc9e124bad9941dac20e65efb |
| SimHash | 0a3a03ab4cf3 |
Groups
linkpadbot
linkpad
ahrefsbot
baiduspider
meanpathbot
advbot
afilias web mining tool
ahrefsbot
aihitbot
archive.org_bot
backlinkcrawler
baiduspider
baidu
baiduspider+
baiduspider
bdbrandprotect
betabot
blexbot
bpimagewalker*
catchbot
ccbot
cliqzbot
comodo ssl checker
comodo-certificates-spider
content crawler
curl
dcpbot
deusu
discobot
docomo/2.0
dotbot
drupact
ec2linkfinder
edisterbot
exabot
exb language crawler
ezooms
findlinks
go 1.1 package http
gonzo
gslfbot
htdig
httpget
huaweisymantecspider
ia_archiver
icjobs
infohelfer
ips-agent
ipsagent
it2media-domain-crawler
java
jobboerse
kaloogabot
larbin
lb-spider
lex
libwww-perl
linkdex.com
linkpadbot
linkpad
lssrocketcrawler
magpie-crawler
mail.ru_bot
meanpath
meanpathbot
megaindex
mia
mj12bot
mlbot
msiecrawler
netestate ne crawler
nutch
obot
openindexspider
opidoobot
pagepeeker
picmole
pixray-seeker
psbot
publiclibraryarchive
qualidator*
reverseget
savetheworldheritage
savetheworldheritage.org
schrein
scooter
screenerbot
seodiver
seokicks
seokicks-robot
seznambot
sistrix
sistrix
siteexplorer/1.0b
siteexplorer
slysearch
solomonobot
solomonolinkchecker
sosospider
spbot
spiderlytics
ssearch
suggybot
surveybot
swebot
tineye
turnitinbot
unister*
unisterbot
updownerbot
waybackarchive.org/1.0
waybackarchive.org
waybackarchive
wbsearchbot
webinator
webliste.ch
webliste
webmastercoffee
webmeup-crawler
webofantbot
wevikabot
wget
wotbox
wotbox
x28-job-bot
xovibot
yacybot
yandexbot/3.0
yandexbot
yandex
yandeximages/3.0
yandeximages
yeti
typhoeus
yeti-mobile
youdaobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*pmax |
| Disallow | /*pmin |
| Disallow | /*prefn* |
| Disallow | /*prefv* |
| Disallow | /*crefn* |
| Disallow | /*crefv* |
| Disallow | /Account-EditPassword |
| Disallow | /Account-EditProfile |
| Disallow | /Account-Login |
| Disallow | /Account-PasswordReset |
| Disallow | /Account-SaveProfile |
| Disallow | /Account-SetNewPassword |
| Disallow | /Account-Show |
| Disallow | /Account-SubmitRegistration |
| Disallow | /Address-AddAddress |
| Disallow | /Address-DeleteAddress |
| Disallow | /Address-EditAddress |
| Disallow | /Address-List |
| Disallow | /Address-SaveAddress |
| Disallow | /Address-SetDefault |
| Disallow | /CSRF-AjaxFail |
| Disallow | /CSRF-Fail |
| Disallow | /CSRF-Generate |
| Disallow | /Cart-AddBonusProducts |
| Disallow | /Cart-AddCoupon |
| Disallow | /Cart-AddProduct |
| Disallow | /Cart-EditBonusProduct |
| Disallow | /Cart-EditProductLineItem |
| Disallow | /Cart-RemoveCouponLineItem |
| Disallow | /Cart-RemoveProductLineItem |
| Disallow | /Cart-SelectShippingMethod |
| Disallow | /Cart-Show |
| Disallow | /Cart-UpdateQuantity |
| Disallow | /Checkout-Begin |
| Disallow | /Checkout-Login |
| Disallow | /Default-Offline |
| Disallow | /Default-Start |
| Disallow | /Error-Start |
| Disallow | /Globale-Cache |
| Disallow | /Home-ErrorNotFound |
| Disallow | /Login-Logout |
| Disallow | /Login-Show |
| Disallow | /Order-Confirm |
| Disallow | /Order-Details |
| Disallow | /Order-History |
| Disallow | /Order-Track |
| Disallow | /Page-SetLocale |
| Disallow | /Product-ShowBonusProducts |
| Disallow | /Product-ShowQuickView |
| Disallow | /Product-Variation |
| Disallow | /Saveforlater-AddProduct |
| Disallow | /Saveforlater-MoreList |
| Disallow | /Saveforlater-RemoveProduct |
| Disallow | /Search-Content |
| Disallow | /Search-Show |
| Disallow | /variation |
| Disallow | /es/variation |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.chefuniforms.com/sitemap_index.xml |
Warnings
- 3 invalid lines.
Comments