bebicsosz.hu
robots.txt

Robots Exclusion Standard data for bebicsosz.hu

Resource Scan

Scan Details

Site Domain bebicsosz.hu
Base Domain bebicsosz.hu
Scan Status Ok
Last Scan4/6/2025, 2:55:46 PM
Next Scan 4/20/2025, 2:55:46 PM

Last Scan

Scanned4/6/2025, 2:55:46 PM
URL https://bebicsosz.hu/robots.txt
Redirect https://www.bebicsosz.hu/robots.txt
Redirect Domain www.bebicsosz.hu
Redirect Base bebicsosz.hu
Domain IPs 104.26.12.245, 104.26.13.245, 172.67.69.102, 2606:4700:20::681a:cf5, 2606:4700:20::681a:df5, 2606:4700:20::ac43:4566
Redirect IPs 104.26.12.245, 104.26.13.245, 172.67.69.102, 2606:4700:20::681a:cf5, 2606:4700:20::681a:df5, 2606:4700:20::ac43:4566
Response IP 104.26.12.245
Found Yes
Hash 3d795500c9ccf9eb3f6d368220d55b828676ca2db1abac3d1dc348fc4ec618d1
SimHash 6dcfc4228429

Groups

*

Rule Path Comment
Disallow /auth/facebook Authentication
Disallow /auth/mojeid Authentication
Disallow /auth/mojeid-oidc Authentication
Disallow /*?cancel_time= City overview action
Disallow /*?local= Language switcher
Disallow /tagsag -
Disallow /foglalas -
Disallow /bebicsosz-uzenetek -
Disallow /uzenetek/new -
Disallow /en/orders -
Disallow /en/bookings -
Disallow /en/hlidacka-zpravy -
Disallow /en/zpravy/new -

xovibot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seoscanners.net/1

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

yandex

Rule Path
Allow /$
Disallow /

dotbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

zoominfobot (zoominfobot at zoominfo dot com)

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

metasr

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

tpradstxtcrawler

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

appnexusadstxtcrawler

Rule Path
Disallow /

adstxtcrawler

Rule Path
Disallow /

pimeyes.com

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

punkspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bebicsosz.hu/new_sitemap_index.xml.gz

Comments

  • Non translated URLs
  • Translated URLs
  • Locale hu
  • Locale en