jonneweb.net
robots.txt

Robots Exclusion Standard data for jonneweb.net

Resource Scan

Scan Details

Site Domain jonneweb.net
Base Domain jonneweb.net
Scan Status Ok
Last Scan2025-05-31T09:21:37+00:00
Next Scan 2025-06-07T09:21:37+00:00

Last Scan

Scanned2025-05-31T09:21:37+00:00
URL https://jonneweb.net/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.80.1
Found Yes
Hash 98fba632cfc9d5b454fd739a92f40199291add7e3aad6a1b25b9e0e8d965f27f
SimHash 805059d0c5f7

Groups

*

Rule Path
Disallow /spammiansa.php
Disallow /koodit/tulosta.php
Disallow /ps2-koodit/tulosta.php
Disallow /ps2-koodit/koodi.php
Disallow /koodit/pdf/
Disallow /koodit/pdf/ps2-koodi.php
Disallow /koodit/koodi.php
Disallow /Koodit/
Disallow /mobiili/
Disallow /foorumi/
Disallow /keskustelu/db/
Disallow /keskustelu/images/
Disallow /keskustelu/includes/
Disallow /keskustelu/language/
Disallow /keskustelu/templates/
Disallow /keskustelu/common.php
Disallow /keskustelu/config.php
Disallow /keskustelu/groupcp.php
Disallow /keskustelu/memberlist.php
Disallow /keskustelu/modcp.php
Disallow /keskustelu/posting.php
Disallow /keskustelu/printview.php
Disallow /keskustelu/privmsg.php
Disallow /keskustelu/profile.php
Disallow /keskustelu/search.php
Disallow /keskustelu/viewonline.php
Disallow /keskustelu/topics_anywhere.php
Disallow /dl.php
Disallow /pelit/email/
Disallow /pelit/popup.php
Disallow /pelit/rate/
Disallow /pelit/dl_start.php
Disallow /zipit/
Disallow /zipit_/
Disallow /linkdb/jump.php
Disallow /linkdb/search.php
Disallow /linkdb/add.php
Disallow /pelit/comments.php
Disallow /kotisivteko/

googlebot

Rule Path
Disallow /keskustelu/viewtopic.php?p=

msiecrawler

Rule Path
Disallow /

inktomi slurp

Rule Path
Disallow /

ibm_planetwide

Rule Path
Disallow /

gazz

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

grub

Rule Path
Disallow /

slurp

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow