Log In Sign Up

biroto.eu
robots.txt

Robots Exclusion Standard data for biroto.eu

Resource Scan

Scan Details

Site Domain biroto.eu
Base Domain biroto.eu
Scan Status Ok
Last Scan2024-10-23T08:39:02+00:00
Next Scan 2024-11-22T08:39:02+00:00

Last Scan

Scanned2024-10-23T08:39:02+00:00
URL https://biroto.eu/robots.txt
Redirect https://www.biroto.eu/robots.txt
Redirect Domain www.biroto.eu
Redirect Base biroto.eu
Domain IPs 188.40.32.13
Redirect IPs 188.40.32.13
Response IP 188.40.32.13
Found Yes
Hash a91f45ee14554ff1844e65a6f5c10ca5bcc50eef74dd18451ab894899113bf51
SimHash 0018fd6bfb31

Groups

googlebot-image

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

bubing

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

crawlbot

Rule Path
Disallow /

special_archiver

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

obot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

umbot-ln

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

wasalive-bot

Rule Path
Disallow /

freewebmonitoring sitechecker

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /print_TRO1.php
Disallow /RTFM.php
Disallow /USR1.php
Disallow /de/anwender/
Disallow /en/community/
Disallow /de/datenschutzhinweis
Disallow /en/privacy-policy
Disallow /de/anbieter/unterkuenfte/promotion
Disallow /en/providers/accommodation/promotion
Disallow /de/anbieter/unterkuenfte/verwalten
Disallow /en/providers/accommodation/manage
Disallow /de/radwege-und-radtouren-karte
Disallow /en/find-cycle-routes-and-tours-on-map
Back to top

Other Records

Field Value
sitemap https://www.biroto.eu/sitemap.xml
Back to top