hatharomhu.com
robots.txt

Robots Exclusion Standard data for hatharomhu.com

Resource Scan

Scan Details

Site Domain hatharomhu.com
Base Domain hatharomhu.com
Scan Status Ok
Last Scan2025-12-12T19:07:18+00:00
Next Scan 2025-12-19T19:07:18+00:00

Last Scan

Scanned2025-12-12T19:07:18+00:00
URL https://hatharomhu.com/robots.txt
Redirect https://www.hatharom.com/robots.txt
Redirect Domain www.hatharom.com
Redirect Base hatharom.com
Domain IPs 104.21.79.70, 172.67.169.54, 2606:4700:3033::ac43:a936, 2606:4700:3037::6815:4f46
Redirect IPs 104.26.8.56, 104.26.9.56, 172.67.68.137, 2606:4700:20::681a:838, 2606:4700:20::681a:938, 2606:4700:20::ac43:4489
Response IP 104.26.8.56
Found Yes
Hash 01ad406f7b3584bdc5775b62690d8342ad5ffbf0d04591a56781bf72627abeab
SimHash 711dd400afa3

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

msnbot/bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /livescore
Disallow /livescore/*
Disallow /elo-eredmenyek
Disallow /elo-eredmenyek/*
Disallow /tip/*/*
Disallow /bet*
Disallow /_internal/*

Other Records

Field Value
sitemap https://www.hatharom.com/sitemap/sitemapindex.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449