puzzles-games.eu
robots.txt

Robots Exclusion Standard data for puzzles-games.eu

Resource Scan

Scan Details

Site Domain puzzles-games.eu
Base Domain puzzles-games.eu
Scan Status Ok
Last Scan2024-09-25T07:21:43+00:00
Next Scan 2024-10-02T07:21:43+00:00

Last Scan

Scanned2024-09-25T07:21:43+00:00
URL https://puzzles-games.eu/robots.txt
Domain IPs 147.124.215.113
Response IP 147.124.215.113
Found Yes
Hash ee9b0b5d7987d3580bbb6e2244dea815d12d9ef38082cf498aef3182c4f25de4
SimHash 2021db811695

Groups

mediapartners-google
googlebot
googlebot-imageuser-agent
yahoo-blogs
yahoo-mmcrawler
slurp

Rule Path
Disallow

architextspider
baiduspider
msnbot
msnbot-media
scooter
teoma
yandex

Rule Path
Disallow /admin/
Disallow /applet/
Disallow /data/
Disallow /images/
Disallow /includes/
Disallow /js/
Disallow /lang/
Disallow /pictures/
Disallow /scripts/
Disallow /track/
Disallow /cache/
Disallow /search.html

Comments

  • allow only important bots