enmalaga.casa
robots.txt

Robots Exclusion Standard data for enmalaga.casa

Resource Scan

Scan Details

Site Domain enmalaga.casa
Base Domain enmalaga.casa
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-10T17:25:04+00:00
Next Scan 2024-11-08T17:25:04+00:00

Last Successful Scan

Scanned2024-04-13T17:01:22+00:00
URL https://enmalaga.casa/robots.txt
Redirect https://viviendas.malaga.wiki/robots.txt
Redirect Domain viviendas.malaga.wiki
Redirect Base malaga.wiki
Domain IPs 51.75.249.108
Redirect IPs 104.21.14.97, 172.67.158.155, 2606:4700:3030::6815:e61, 2606:4700:3031::ac43:9e9b
Response IP 104.21.14.97
Found Yes
Hash 68eb737591731e2f7c19dea7bbf6759d909212470f59f7cf2b6d61ea80b433a1
SimHash 3b340250c830

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /politica-privacidad/
Disallow /aviso-legal/
Disallow /politica-de-cookies/
Disallow /?s=
Disallow /search

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /

mj12bot
ia_archiver
ahrefsbot
semrushbot
semrushbot-sa
sistrix
dotbot
rogerbot
seokicks-robot
searchmetricsbot
spbot
xovi
xovibot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://malaga.wiki/sitemaps.xml
sitemap https://turismo.malaga.wiki/sitemaps.xml

Comments

  • Bots
  • Bots seo
  • IAs y similares