campsider.com
robots.txt
Robots Exclusion Standard data for campsider.com
Resource Scan
Scan Details
| Site Domain | campsider.com |
| Base Domain | campsider.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-02-23T20:39:01+00:00 |
| Next Scan | 2024-05-23T20:39:01+00:00 |
Last Successful Scan
| Scanned | 2023-10-20T18:18:08+00:00 |
| URL | https://campsider.com/robots.txt |
| Domain IPs | 52.17.240.133, 52.18.3.224, 52.50.252.183 |
| Response IP | 52.18.3.224 |
| Found | Yes |
| Hash | 5d73bc75e4a7cae2185e8e1433e75b6a2d2413996aad774beca1062bbc69deab |
| SimHash | 7b5d18029ef0 |
Groups
*
adsbot-google
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /produit/* |
| Disallow | /produit/ |
| Disallow | /version-test/ |
| Disallow | /admin/ |
| Disallow | /thank-you |
| Disallow | /merci |
| Disallow | /mon-compte |
| Disallow | /my-account |
| Disallow | /*/filters |
| Disallow | /admin |
| Disallow | /contactez-nous |
| Disallow | /recherche |
| Disallow | /boutique |
| Disallow | /ma-commande |
| Disallow | /panier |
| Disallow | /geolocation |
semrushbot
admantx
ahrefsbot
attentio
barkrowler
barkrowler/0.9
blexbot
boitho.com-dc
cazoodlebot
ccbot
clickagy intelligence bot v2
cliqzbot
converacrawler
discordbot
doc
domain re-animator bot
dotbot
echoping
experibot_v1
fasterfox
fatbot
gaisbot
genieo
getintent crawler
gigabot
grapeshot
heritrix
huaweisymantecspider
ichiro
imrbot
irlbot
jakarta
kalooga
konqueror
lexxebot
livelapbot/0.2
magpie-crawler
mfibot/1.1
mj12bot
mlbot
nutch
ocelli
paperlibot/2.0
penthesilea
petalbot
phpdig
proximic
psbot
scoutjet
searchdaimon.com-dc
searchmetricsbot
semrushbot
semvisubot
shopwiki
snapbot
socialrankiobot
sogou web spider
surveybot
trovitbot
turnitinbot
twiceler
ubicrawler
updownerbot
uxcrawlerbot
velenpublicwebcrawler
veoozbot
webmeupbot
wget
woobot
woozweb-monitoring
woriobot
xenu link sleuth/1.3.8
xenu's
xenu's link sleuth 1.1c
yacybit
yacybot
yandex
yodaobot
zao
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.campsider.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments