easygifts.com.pl
robots.txt

Robots Exclusion Standard data for easygifts.com.pl

Resource Scan

Scan Details

Site Domain easygifts.com.pl
Base Domain easygifts.com.pl
Scan Status Ok
Last Scan3/8/2025, 5:59:36 PM
Next Scan 4/7/2025, 5:59:36 PM

Last Scan

Scanned3/8/2025, 5:59:36 PM
URL https://www.easygifts.com.pl/robots.txt
Domain IPs 185.38.249.122
Response IP 185.38.249.122
Found Yes
Hash 8b9bb7980d12fa5b717ab80d5001a922120a102983ae8c2161c2d3a623edcee6
SimHash 2854d961c463

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /tmp/
Disallow /scripts/
Disallow /include/
Disallow /elements/
Disallow /js/
Disallow /*.php$
Disallow /*.pdf$
Disallow /*.js$
Disallow /*.css$
Disallow /*.exe$
Disallow /*.zip$
Disallow /*.tar$
Disallow /*.gz$
Disallow /*.bak$
Disallow /*.tmp$

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

spbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

siteexplorer.info

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

sogou

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

kaszonibot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

openai

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

gpt-3

Rule Path
Disallow /

bard

Rule Path
Disallow /

jasper

Rule Path
Disallow /

copyai

Rule Path
Disallow /

rytr

Rule Path
Disallow /

writesonic

Rule Path
Disallow /

frase

Rule Path
Disallow /

anyword

Rule Path
Disallow /

articoolo

Rule Path
Disallow /

copymatic

Rule Path
Disallow /

kafkai

Rule Path
Disallow /

scalenut

Rule Path
Disallow /

ink

Rule Path
Disallow /

peppertype

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Comments

  • Blokowanie niektórych znanych agresywnych botów i spamujÄ
  • Zapobieganie hammeringowi dla wszystkich botów

Warnings

  • 3 invalid lines.