Log In Sign Up

argia.eus
robots.txt

Robots Exclusion Standard data for argia.eus

Resource Scan

Scan Details

Site Domain argia.eus
Base Domain argia.eus
Scan Status Ok
Last Scan2024-09-27T13:28:48+00:00
Next Scan 2024-10-27T13:28:48+00:00

Last Scan

Scanned2024-09-27T13:28:48+00:00
URL https://argia.eus/robots.txt
Redirect https://www.argia.eus/robots.txt
Redirect Domain www.argia.eus
Redirect Base argia.eus
Domain IPs 178.33.118.72
Redirect IPs 178.33.118.72
Response IP 178.33.118.72
Found Yes
Hash 3c2d0a8c0e31111c4d3701524fb093d85dc353d1cdbe5638ed628f6bda635280
SimHash 6b5357ce9ad5

Groups

twitterbot

Rule Path
Allow /argia/fitx/

facebookexternalhit

Rule Path
Allow /argia/fitx/

googlebot

Rule Path
Allow /argia/fitx/

whatsapp

Rule Path
Allow /argia/fitx/

ahrefsbot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

gynxbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

moreover

Rule Path
Disallow /

ecoresearchcrawler

Rule Path
Disallow /

trendsmapresolver

Rule Path
Disallow /

*

Rule Path
Disallow /argia/fitx/
Disallow /cgi*/
Disallow /icons/
Disallow /images/
Disallow /aurrebista/
Disallow /albistea-z/
Disallow /argia-astekaria-z/
Disallow /azala/
Disallow /interaktiboak/
Disallow /API/
Disallow /komunitatea/
Disallow /adserver/
Disallow /blogak/urko-saenz-buruaga/calendar/
Disallow /bilaketa?
Disallow /multimedia/bilaketa?

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Creado el 17/4/98
  • Modificado el 20/4/2007 (cgi*)
  • Asimov-en robotikaren 3 legeak (Itzulpena: Makilakixki, 2014ko urrian gehitua)
  • 1. Robot batek ez dio gizaki bati kalterik egingo ez eta ekintza faltagatik gizaki bat kaltetua izaten utziko.
  • 2. Robot batek gizakiek emandako aginduak bete behar ditu, aginduok Lehenengo Legea urratzen ez duten bitartean.
  • 3. Robot batek bere izatea babestu behar du, Lehenengo edo Bigarren Legeekin gatazka sortzen denean izan ezik.
  • Disallow: /*/inprimatu$
Back to top