famaga.es
robots.txt

Robots Exclusion Standard data for famaga.es

Resource Scan

Scan Details

Site Domain famaga.es
Base Domain famaga.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-18T04:30:34+00:00
Next Scan 2025-06-17T04:30:34+00:00

Last Successful Scan

Scanned2025-03-27T03:02:13+00:00
URL https://famaga.es/robots.txt
Domain IPs 104.21.27.60, 172.67.169.7, 2606:4700:3037::6815:1b3c, 2606:4700:3037::ac43:a907
Response IP 172.67.169.7
Found Yes
Hash 4cac1c854a34d77ee48dab67d67fd965827318242ce0a3c8c279f474df1fbd24
SimHash 455d59f04699

Groups

*

Rule Path
Disallow /*?
Disallow /auth
Disallow /presentation
Disallow /*delivery
Disallow /catalog/zima
Disallow /assets/f/
Allow /news
Allow /*alias
Allow /*letters

googlebot

Rule Path
Disallow /*?
Disallow /*artikul/id*
Disallow /auth
Disallow /presentation
Disallow /*delivery
Disallow /catalog/zima
Disallow /assets/f/
Allow /news
Allow /*alias
Allow /*letters
Allow /*.js
Allow /*.css

bingbot

Rule Path
Disallow /*?
Disallow /auth
Disallow /presentation
Disallow /*delivery
Disallow /catalog/zima
Disallow /assets/f/
Allow /news
Allow /*alias
Allow /*letters

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

trident

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

teleport

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

larbin

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandexrenderresourcesbot/1.0

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexrenderresourcesbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://famaga.es/sitemap_famaga_es.xml