cortizo.com
robots.txt
Robots Exclusion Standard data for cortizo.com
Resource Scan
Scan Details
| Site Domain | cortizo.com |
| Base Domain | cortizo.com |
| Scan Status | Ok |
| Last Scan | 2024-09-08T20:35:54+00:00 |
| Next Scan | 2024-10-08T20:35:54+00:00 |
Last Scan
| Scanned | 2024-09-08T20:35:54+00:00 |
| URL | https://cortizo.com/robots.txt |
| Domain IPs | 77.26.24.26 |
| Response IP | 77.26.24.26 |
| Found | Yes |
| Hash | 2319436891507a74c76a6fd793b8901bc39974cfc365b47b872d6726325847b1 |
| SimHash | 3a9849c2c2b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /websclientes/ |
| Disallow | /data/ |
| Disallow | /es/entradasdirectorio/ |
| Disallow | /en/entradasdirectorio/ |
| Disallow | /fr/entradasdirectorio/ |
| Disallow | /pt/entradasdirectorio/ |
| Disallow | /sk/entradasdirectorio/ |
| Disallow | /pl/entradasdirectorio/ |
| Disallow | /cz/entradasdirectorio/ |
| Disallow | /ro/entradasdirectorio/ |
| Disallow | /tr/entradasdirectorio/ |
| Disallow | /it/entradasdirectorio/ |
| Disallow | /instaladores/desplegar/ |
| Disallow | /es/instaladores/desplegar/ |
| Disallow | /en/instaladores/desplegar/ |
| Disallow | /fr/instaladores/desplegar/ |
| Disallow | /pt/instaladores/desplegar/ |
| Disallow | /sk/instaladores/desplegar/ |
| Disallow | /pl/instaladores/desplegar/ |
| Disallow | /cz/instaladores/desplegar/ |
| Disallow | /ro/instaladores/desplegar/ |
| Disallow | /tr/instaladores/desplegar/ |
| Disallow | /it/instaladores/desplegar/ |
ahrefsbot
blexbot
baiduspider
baiduspider-image
baiduspider-video
barkrowler
ccbot
dotbot
exabot
gurujibot
hl_ftien_spider
httrack
komodiabot
libwww
linkdexbot
megaindex.com
megaindex.ru
microsoft.url.control
mj12bot
msiecrawler
petalbot
semrushbot
semrushbot-ba
semrushbot-sa
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
semrushbot-seoab
sogou
sogou spider
webcopier
yandex
yandexbot
yeti
yodaobot
zoominfobot
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
imagesiftbot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
youbot
anthropic-ai
cohere-ai
facebookexternalhit
img2dataset
omgili
omgilibot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |