Log In Sign Up

conteo.io
robots.txt

Robots Exclusion Standard data for conteo.io

Resource Scan

Scan Details

Site Domain conteo.io
Base Domain conteo.io
Scan Status Ok
Last Scan2025-08-26T14:54:48+00:00
Next Scan 2025-09-09T14:54:48+00:00

Last Scan

Scanned2025-08-26T14:54:48+00:00
URL https://conteo.io/robots.txt
Redirect https://www.conteo.io/robots.txt
Redirect Domain www.conteo.io
Redirect Base conteo.io
Domain IPs 34.65.176.150
Redirect IPs 34.65.176.150
Response IP 34.65.176.150
Found Yes
Hash c08e16774fd0e76431d2dcf4a0a0815e4b0630278f23155dec6c960bacf48a6b
SimHash 74fc78d09329

Groups

*

Rule Path
Disallow /de/suche/
Disallow /en/search/
Disallow /fr/recherche/
Disallow /de/user/
Disallow /en/user/
Disallow /fr/user/

Other Records

Field Value
crawl-delay 5

aihitbot
alyze.com bot
awario crawler
bad-neighborhood
barkrowler
blexbot
botify
brightedge crawler
brokenlinkcheck.com
builtwith crawler
chrome-lighthouse
cocolyze bot
cocolyzebot
contentking
critical path css generator
dataforseo bot
dataforseobot
dataprovider.com
dead link checker
deadlinkchecker
deepcrawl
diffbot
domainsbot
domainstatsbot
domcop bot
dotbot
gtmetrix
hypefactors crawler
hypestat
hyscore.io crawler
linkdexbot
linktiger
magellan
marketingminer bot
megaindex
metainspector
mj12bot
monitorbacklinks.com bot
netpeak bot
online-webceo-bot
pagespeed
pandalytics
petalbot
prerender
rankurbot
rogerbot
ryte bot
schema-markup-validator
semaltbot
semrushbot
semrushbot-ba
semrushbot-ct
semrushbot-si
semrushbot-swa
senutobot
seobilitybot
seocherrybot
seoclarity bot
seokicks-robot
seolizer
seositecheckup
serpstatbot
serptimizerbot
sistrix optimizer
siteauditbot
sitecheckerbot
siteimprove.com bot
sitescorebot
spaziodati bot
stractbot
textrazor crawler
uaslinkchecker
urlsumabot
wappalyzer
web measure
wmtips.com
yandex.metrica
yandex.webmaster
yellowlabtools
zoominfo bot
zoominfobot

Rule Path
Disallow /

adbeat bot
awin.com crawler
brandverity
checkmarknetwork
clickagy intelligence bot
ezoic crawler
feed image audit
google adsense
google-ads
gumgum bot
hubspot crawler
proximic
pulsepoint crawler
snapchatads
webgains-bot

Rule Path
Disallow /

amazonbot
dataprovider spider
google storebot
google-shopping
hlidam.to robot
mergadobot
playstore-google
pricedroneshoppingbot
priecobot
scrapeherobot
tineye

Rule Path
Disallow /
Back to top

Comments

  • SEO
  • User-agent: AhrefsBot
  • User-agent: AhrefsSiteAudit
  • User-agent: Screaming Frog SEO Spider
  • Advertising & marketing
  • E-commerce
Back to top