bezposrednie.com
robots.txt

Robots Exclusion Standard data for bezposrednie.com

Resource Scan

Scan Details

Site Domain bezposrednie.com
Base Domain bezposrednie.com
Scan Status Ok
Last Scan2024-06-03T03:11:10+00:00
Next Scan 2024-06-10T03:11:10+00:00

Last Scan

Scanned2024-06-03T03:11:10+00:00
URL http://bezposrednie.com/robots.txt
Response IP 85.232.249.60
Found Yes
Hash 77bb5dfdcd58dd558bae458991ffd537848f18614119c1219288782f84a844dd
SimHash 8c795887e573

Groups

sistrix

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

seokicks robot

Rule Path
Disallow /

*

Rule Path
Disallow /cennik
Disallow /regulamin
Disallow /polityka_cookies

Comments

  • http://www.80legs.com/webcrawler.html
  • http://crawler.sistrix.net/
  • http://www.trendiction.de/bot
  • http://www.seokicks.de/robot.html
  • all spiders - keep at bottom

Warnings

  • 2 invalid lines.