turistamagazin.hu
robots.txt

Robots Exclusion Standard data for turistamagazin.hu

Resource Scan

Scan Details

Site Domain turistamagazin.hu
Base Domain turistamagazin.hu
Scan Status Ok
Last Scan2024-11-15T09:22:34+00:00
Next Scan 2024-11-22T09:22:34+00:00

Last Scan

Scanned2024-11-15T09:22:34+00:00
URL https://turistamagazin.hu/robots.txt
Redirect https://www.turistamagazin.hu/robots.txt
Redirect Domain www.turistamagazin.hu
Redirect Base turistamagazin.hu
Domain IPs 87.229.72.35
Redirect IPs 87.229.72.35
Response IP 87.229.72.35
Found Yes
Hash 232736ca70dc6714a44ca804702271d07a4a1cccd98e4a13a64811457e4497fb
SimHash 6f281247e153

Groups

*

Rule Path
Allow /
Disallow /core
Allow /core/js
Allow /core/assets
Disallow /public/dynamic
Disallow /action
Disallow /purchase
Disallow /purchase/do
Disallow /client
Disallow /tmp
Disallow /protected
Disallow /assets
Disallow /qrcode
Disallow /themes
Disallow /adventi-naptar

googlebot

Rule Path
Disallow /css/page.css

bingbot

Rule Path
Disallow /css/page.css

sentibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

crawler_eb_germany_2.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.turistamagazin.hu/sitemap.xml