dadalo.pl
robots.txt

Robots Exclusion Standard data for dadalo.pl

Resource Scan

Scan Details

Site Domain dadalo.pl
Base Domain dadalo.pl
Scan Status Ok
Last Scan2025-09-21T16:51:10+00:00
Next Scan 2025-09-22T16:51:10+00:00

Last Scan

Scanned2025-09-21T16:51:10+00:00
URL https://dadalo.pl/robots.txt
Domain IPs 138.2.133.244, 2603:c020:8014:c500:aba6:813f:c3:a092
Response IP 138.2.133.244
Found Yes
Hash 849d348687a8452b15a91890b04dc89d382ff2cbf00aeb50f474ecf4227dc991
SimHash 500ad143e23a

Groups

*

Rule Path
Allow /

claude
anthropic-ai
anthropicbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

chatgpt
gptbot
openaibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot
bingbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot
mj12bot
semrushbot
semrushbot-sa
seokicks
seokicks-robot
sistrix
sistrixcrawler
cognitiveseo
screaming frog seo spider
rogerbot
dotbot
spbot
mauibot
seolyticscrawler
seekport
searchmetricsbot

Rule Path
Disallow /

turnitinbot
turnitinbot/3.0
heritrix
pimonster
pimonster
eccp/1.0 (search@eniro.com)
yandex
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
ezooms robot
perl lwp
blexbot
netestate ne crawler (+http://www.website-datenbank.de/)
wiseguys robot
megaindex.ru
gsa-crawler (enterprise; t4-knhh62cdkc2w3; gsa_manage@nikon-sys.co.jp)

Rule Path
Disallow /
Disallow /api/
Disallow /private/
Disallow /temp/
Disallow /drafts/

Other Records

Field Value
sitemap https://dadalo.pl/sitemap.xml
sitemap https://dadalo.pl/index_pl.xml

Comments

  • Crawl delay for specific bots
  • Block SEO monitoring tools
  • Block specific bots
  • Block specific paths