kellagumi.hu
robots.txt

Robots Exclusion Standard data for kellagumi.hu

Resource Scan

Scan Details

Site Domain kellagumi.hu
Base Domain kellagumi.hu
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-01-05T13:33:04+00:00
Next Scan 2026-04-05T13:33:04+00:00

Last Successful Scan

Scanned2025-02-17T00:21:46+00:00
URL https://kellagumi.hu/robots.txt
Domain IPs 185.111.89.222
Response IP 185.111.89.222
Found Yes
Hash f501ff58370f0baef8e91f78b05a7c40716cb976b6eada0a27802726d909d633
SimHash 6811cf92d615

Groups

adsbot-google
googlebot
googlebot-image
googlebot-mobile
googlebot-news
msnbot
slurp

Rule Path
Disallow /
Allow /images/
Allow /index.php
Allow /$

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Comments

  • Whitelist
  • User-agent: BaiDuSpider
  • User-agent: MSNBot-Media
  • User-agent: MSNBot-News
  • User-agent: MSNPTC
  • User-agent: ScoutJet
  • User-agent: Teoma
  • User-agent: Yahoo-Blogs
  • User-agent: Yahoo-MMCrawler
  • User-agent: Yandex
  • Blacklist