Log In Sign Up

saferinternet.pl
robots.txt

Robots Exclusion Standard data for saferinternet.pl

Resource Scan

Scan Details

Site Domain saferinternet.pl
Base Domain saferinternet.pl
Scan Status Ok
Last Scan2024-10-02T01:16:31+00:00
Next Scan 2024-11-01T01:16:31+00:00

Last Scan

Scanned2024-10-02T01:16:31+00:00
URL https://saferinternet.pl/robots.txt
Redirect https://www.saferinternet.pl/robots.txt
Redirect Domain www.saferinternet.pl
Redirect Base saferinternet.pl
Domain IPs 195.187.242.142
Redirect IPs 195.187.242.142
Response IP 195.187.242.142
Found Yes
Hash 25d85fc297726053e131980835de5f6dec5333f659db97beb489126690e2ec80
SimHash 1a5dfdd0f991

Groups

ahrefsbot

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

http://webmeup.com/crawler.html

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandex/1.01.001

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /
Back to top

Warnings

  • 2 invalid lines.
Back to top