Log In Sign Up

enemef.pl
robots.txt

Robots Exclusion Standard data for enemef.pl

Resource Scan

Scan Details

Site Domain enemef.pl
Base Domain enemef.pl
Scan Status Ok
Last Scan2025-05-23T10:32:28+00:00
Next Scan 2025-06-22T10:32:28+00:00

Last Scan

Scanned2025-05-23T10:32:28+00:00
URL https://enemef.pl/robots.txt
Domain IPs 2.57.138.83
Response IP 2.57.138.83
Found Yes
Hash 0c208c740463b804c12d4f56ccab8b42007af7701982be753f1e76a57c8118bd
SimHash 1944d0c0c5d5

Groups

googlebot

Rule Path
Disallow /kosz

gulliver

Rule Path
Disallow /kosz
Disallow /test

slurp

Rule Path
Disallow /kosz
Disallow /test

fast

Rule Path
Disallow /kosz
Disallow /test

scooter

Rule Path
Disallow /kosz
Disallow /test

vscooter

Rule Path
Disallow /kosz
Disallow /test

ia_archiver

Rule Path
Disallow /kosz
Disallow /test

nutch

Rule Path
Disallow /kosz
Disallow /test

fast-webcrawler

Rule Path
Disallow /kosz
Disallow /test

teoma_agent1

Rule Path
Disallow /kosz
Disallow /test

lycos_spider_(t-rex)

Rule Path
Disallow /kosz
Disallow /test

msnbot/0.1

Rule Path
Disallow /kosz
Disallow /test

architextspider

Rule Path
Disallow /kosz
Disallow /test

zyborg

Rule Path
Disallow /kosz
Disallow /test

surveybot

Rule Path
Disallow /kosz
Disallow /test

*

Rule Path
Disallow /
Back to top

Comments

  • Disallow all other crawlers
Back to top