Log In Sign Up

sourceforge.jp
robots.txt

Robots Exclusion Standard data for sourceforge.jp

Resource Scan

Scan Details

Site Domain sourceforge.jp
Base Domain sourceforge.jp
Scan Status Ok
Last Scan2024-11-13T17:32:21+00:00
Next Scan 2024-11-20T17:32:21+00:00

Last Scan

Scanned2024-11-13T17:32:21+00:00
URL https://www.sourceforge.jp/robots.txt
Domain IPs 35.82.187.220, 54.218.18.206
Response IP 54.218.18.206
Found Yes
Hash 5c0a12d192517c29667faa0ccd239267f273ef5af78dd52c1dcda0f7b64713d1
SimHash 63350bce5f83

Groups

mediapartners-google

Rule Path
Disallow

mediapartners-google*

Rule Path
Disallow

googlebot

Rule Path
Disallow /pm
Disallow /auth/
Disallow /frs/redir.php
Disallow /frs/g_redir.php
Disallow /cvs/view/
Disallow /projects/*/svn/view/
Disallow /users/*/pf/*/git
Disallow /users/takinoya/pf/linux_3.x_apsh4a0a/git/
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/
Disallow /projects/linux-kernel-docs/scm/git/linux-2.6/
Disallow /projects/git-core/scm/git/git/
Disallow /projects/armadillo-ux/scm/git/linux-2.6-armadillo/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains4x/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains3x/
Disallow /projects/eos/scm/git/others/
Disallow /projects/uclinux-h8/scm/git/linux/
Allow /projects/*/scm/git/*/tree/master
Allow /projects/*/scm/git/*/blobs/master
Allow /projects/*/scm/hg/*/tree/default
Allow /projects/*/scm/hg/*/tree/tip
Allow /projects/*/scm/hg/*/blobs/default
Allow /projects/*/scm/hg/*/blobs/tip
Allow /projects/*/scm/svn/tree/head
Allow /projects/*/scm/svn/blobs/head
Allow /users/*/pf/*/scm/tree/master
Allow /users/*/pf/*/scm/blobs/master
Allow /users/*/pf/*/scm/tree/tip
Allow /users/*/pf/*/scm/blobs/tip
Allow /users/*/pf/*/scm/tree/default
Allow /users/*/pf/*/scm/blobs/default
Allow /users/*/pf/*/scm/tree/head
Allow /users/*/pf/*/scm/blobs/head
Allow /projects/mingw/lists/
Disallow /projects/*/scm/*/*/tree/
Disallow /projects/*/scm/*/*/blobs/
Disallow /projects/*/scm/*/*//tree/
Disallow /projects/*/scm/*/*//blobs/
Disallow /projects/*/scm/svn/tree/
Disallow /projects/*/scm/svn/blobs/
Disallow /users/*/pf/*/scm/tree/
Disallow /users/*/pf/*/scm/blobs/
Disallow /users/*/pf/*/scm//tree/
Disallow /users/*/pf/*/scm//blobs/
Disallow /projects/*/translate/
Disallow */wiki/%21feeds/*
Disallow */wiki/%21pdf/*
Disallow */wiki/RecentChanges
Disallow /account/setlang.php

merocrawl

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

yandex

Rule Path
Disallow /pm
Disallow /search
Disallow /auth/
Disallow /frs/redir.php
Disallow /frs/g_redir.php
Disallow /cvs/view/
Disallow /projects/*/svn/view/
Disallow /users/*/pf/*/git
Disallow /users/takinoya/pf/linux_3.x_apsh4a0a/git/
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/
Disallow /projects/linux-kernel-docs/scm/git/linux-2.6/
Disallow /projects/git-core/scm/git/git/
Disallow /projects/armadillo-ux/scm/git/linux-2.6-armadillo/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains4x/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains3x/
Disallow /projects/eos/scm/git/others/
Disallow /projects/uclinux-h8/scm/git/linux/
Allow /projects/*/scm/git/*/tree/master
Allow /projects/*/scm/git/*/blobs/master
Allow /projects/*/scm/hg/*/tree/default
Allow /projects/*/scm/hg/*/tree/tip
Allow /projects/*/scm/hg/*/blobs/default
Allow /projects/*/scm/hg/*/blobs/tip
Allow /projects/*/scm/svn/tree/head
Allow /projects/*/scm/svn/blobs/head
Allow /users/*/pf/*/scm/tree/master
Allow /users/*/pf/*/scm/blobs/master
Allow /users/*/pf/*/scm/tree/tip
Allow /users/*/pf/*/scm/blobs/tip
Allow /users/*/pf/*/scm/tree/default
Allow /users/*/pf/*/scm/blobs/default
Allow /users/*/pf/*/scm/tree/head
Allow /users/*/pf/*/scm/blobs/head
Allow /projects/mingw/lists/
Disallow /projects/*/scm/*/*/tree/
Disallow /projects/*/scm/*/*/blobs/
Disallow /projects/*/scm/*/*//tree/
Disallow /projects/*/scm/*/*//blobs/
Disallow /projects/*/scm/svn/tree/
Disallow /projects/*/scm/svn/blobs/
Disallow /users/*/pf/*/scm/tree/
Disallow /users/*/pf/*/scm/blobs/
Disallow /users/*/pf/*/scm//tree/
Disallow /users/*/pf/*/scm//blobs/
Disallow /projects/*/translate/
Disallow */wiki/%21feeds/*
Disallow */wiki/%21pdf/*
Disallow */wiki/RecentChanges

Other Records

Field Value
crawl-delay 20

baiduspider

Rule Path
Disallow /pm
Disallow /search
Disallow /auth/*
Disallow /frs/redir.php
Disallow /frs/g_redir.php
Disallow /cvs/view/*
Disallow /projects/*/svn/view/*
Disallow /users/*/pf/*/git
Disallow /users/takinoya/pf/linux_3.x_apsh4a0a/git/*
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/*
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/*
Disallow /projects/linux-kernel-docs/scm/git/linux-2.6/*
Disallow /projects/git-core/scm/git/git/*
Disallow /projects/armadillo-ux/scm/git/linux-2.6-armadillo/*
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains4x/*
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains3x/*
Disallow /projects/eos/scm/git/others/
Disallow /projects/uclinux-h8/scm/git/linux/
Allow /projects/*/scm/git/*/tree/master
Allow /projects/*/scm/git/*/blobs/master
Allow /projects/*/scm/hg/*/tree/default
Allow /projects/*/scm/hg/*/tree/tip
Allow /projects/*/scm/hg/*/blobs/default
Allow /projects/*/scm/hg/*/blobs/tip
Allow /projects/*/scm/svn/tree/head
Allow /projects/*/scm/svn/blobs/head
Allow /users/*/pf/*/scm/tree/master
Allow /users/*/pf/*/scm/blobs/master
Allow /users/*/pf/*/scm/tree/tip
Allow /users/*/pf/*/scm/blobs/tip
Allow /users/*/pf/*/scm/tree/default
Allow /users/*/pf/*/scm/blobs/default
Allow /users/*/pf/*/scm/tree/head
Allow /users/*/pf/*/scm/blobs/head
Allow /projects/mingw/lists/
Disallow /projects/*/scm/*/*/tree/*
Disallow /projects/*/scm/*/*/blobs/*
Disallow /projects/*/scm/*/*//tree/*
Disallow /projects/*/scm/*/*//blobs/*
Disallow /projects/*/scm/svn/tree/*
Disallow /projects/*/scm/svn/blobs/*
Disallow /users/*/pf/*/scm/tree/*
Disallow /users/*/pf/*/scm/blobs/*
Disallow /users/*/pf/*/scm//tree/*
Disallow /users/*/pf/*/scm//blobs/*
Disallow /projects/*/translate/*
Disallow */wiki/%21feeds/*
Disallow */wiki/%21pdf/*
Disallow */wiki/RecentChanges
Disallow /projects/*/svn/view/*

Other Records

Field Value
crawl-delay 50

yeti

Rule Path
Disallow /pm
Disallow /search
Disallow /auth/
Disallow /frs/redir.php
Disallow /frs/g_redir.php
Disallow /cvs/view/
Disallow /projects/*/svn/view/
Disallow /users/*/pf/*/git
Disallow /users/takinoya/pf/linux_3.x_apsh4a0a/git/
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/
Disallow /projects/linux-kernel-docs/scm/git/linux-2.6/
Disallow /projects/git-core/scm/git/git/
Disallow /projects/armadillo-ux/scm/git/linux-2.6-armadillo/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains3x/
Disallow /projects/eos/scm/git/others/
Disallow /projects/uclinux-h8/scm/git/linux/
Allow /projects/*/scm/git/*/tree/master
Allow /projects/*/scm/git/*/blobs/master
Allow /projects/*/scm/hg/*/tree/default
Allow /projects/*/scm/hg/*/tree/tip
Allow /projects/*/scm/hg/*/blobs/default
Allow /projects/*/scm/hg/*/blobs/tip
Allow /projects/*/scm/svn/tree/head
Allow /projects/*/scm/svn/blobs/head
Allow /users/*/pf/*/scm/tree/master
Allow /users/*/pf/*/scm/blobs/master
Allow /users/*/pf/*/scm/tree/tip
Allow /users/*/pf/*/scm/blobs/tip
Allow /users/*/pf/*/scm/tree/default
Allow /users/*/pf/*/scm/blobs/default
Allow /users/*/pf/*/scm/tree/head
Allow /users/*/pf/*/scm/blobs/head
Allow /projects/mingw/lists/
Disallow /projects/*/scm/*/*/tree/
Disallow /projects/*/scm/*/*/blobs/
Disallow /projects/*/scm/*/*//tree/
Disallow /projects/*/scm/*/*//blobs/
Disallow /projects/*/scm/svn/tree/
Disallow /projects/*/scm/svn/blobs/
Disallow /users/*/pf/*/scm/tree/
Disallow /users/*/pf/*/scm/blobs/
Disallow /users/*/pf/*/scm//tree/
Disallow /users/*/pf/*/scm//blobs/
Disallow /projects/*/translate/
Disallow */wiki/%21feeds/*
Disallow */wiki/%21pdf/*
Disallow */wiki/RecentChanges

Other Records

Field Value
crawl-delay 20

applebot

Rule Path
Disallow /pm
Disallow /auth/
Disallow /frs/redir.php
Disallow /frs/g_redir.php
Disallow /cvs/view/
Disallow /projects/*/svn/view/
Disallow /users/*/pf/*/git
Disallow /users/takinoya/pf/linux_3.x_apsh4a0a/git/
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/
Disallow /projects/linux-kernel-docs/scm/git/linux-2.6/
Disallow /projects/git-core/scm/git/git/
Disallow /projects/armadillo-ux/scm/git/linux-2.6-armadillo/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains4x/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains3x/
Disallow /projects/eos/scm/git/others/
Disallow /projects/uclinux-h8/scm/git/linux/
Allow /projects/*/scm/git/*/tree/master
Allow /projects/*/scm/git/*/blobs/master
Allow /projects/*/scm/hg/*/tree/default
Allow /projects/*/scm/hg/*/tree/tip
Allow /projects/*/scm/hg/*/blobs/default
Allow /projects/*/scm/hg/*/blobs/tip
Allow /projects/*/scm/svn/tree/head
Allow /projects/*/scm/svn/blobs/head
Allow /users/*/pf/*/scm/tree/master
Allow /users/*/pf/*/scm/blobs/master
Allow /users/*/pf/*/scm/tree/tip
Allow /users/*/pf/*/scm/blobs/tip
Allow /users/*/pf/*/scm/tree/default
Allow /users/*/pf/*/scm/blobs/default
Allow /users/*/pf/*/scm/tree/head
Allow /users/*/pf/*/scm/blobs/head
Allow /projects/mingw/lists/
Disallow /projects/*/scm/*/*/tree/
Disallow /projects/*/scm/*/*/blobs/
Disallow /projects/*/scm/*/*//tree/
Disallow /projects/*/scm/*/*//blobs/
Disallow /projects/*/scm/svn/tree/
Disallow /projects/*/scm/svn/blobs/
Disallow /users/*/pf/*/scm/tree/
Disallow /users/*/pf/*/scm/blobs/
Disallow /users/*/pf/*/scm//tree/
Disallow /users/*/pf/*/scm//blobs/
Disallow /projects/*/translate/
Disallow */wiki/%21feeds/*
Disallow */wiki/%21pdf/*
Disallow */wiki/RecentChanges
Disallow /account/setlang.php

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /pm
Disallow /search
Disallow /auth/
Disallow /frs/redir.php
Disallow /frs/g_redir.php
Disallow /cvs/view/
Disallow /projects/*/svn/view/
Disallow /users/*/pf/*/git
Disallow /users/takinoya/pf/linux_3.x_apsh4a0a/git/
Disallow /projects/pf3gnuchains/scm/git/gcc-fork/
Disallow /projects/linux-kernel-docs/scm/git/linux-2.6/
Disallow /projects/git-core/scm/git/git/
Disallow /projects/armadillo-ux/scm/git/linux-2.6-armadillo/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains4x/
Disallow /projects/pf3gnuchains/scm/git/pf3gnuchains3x/
Disallow /projects/eos/scm/git/others/
Disallow /projects/uclinux-h8/scm/git/linux/
Allow /projects/*/scm/git/*/tree/master
Allow /projects/*/scm/git/*/blobs/master
Allow /projects/*/scm/hg/*/tree/default
Allow /projects/*/scm/hg/*/tree/tip
Allow /projects/*/scm/hg/*/blobs/default
Allow /projects/*/scm/hg/*/blobs/tip
Allow /projects/*/scm/svn/tree/head
Allow /projects/*/scm/svn/blobs/head
Allow /users/*/pf/*/scm/tree/master
Allow /users/*/pf/*/scm/blobs/master
Allow /users/*/pf/*/scm/tree/tip
Allow /users/*/pf/*/scm/blobs/tip
Allow /users/*/pf/*/scm/tree/default
Allow /users/*/pf/*/scm/blobs/default
Allow /users/*/pf/*/scm/tree/head
Allow /users/*/pf/*/scm/blobs/head
Allow /projects/mingw/lists/
Disallow /projects/*/scm/*/*/tree/
Disallow /projects/*/scm/*/*/blobs/
Disallow /projects/*/scm/*/*//tree/
Disallow /projects/*/scm/*/*//blobs/
Disallow /projects/*/scm/svn/tree/
Disallow /projects/*/scm/svn/blobs/
Disallow /users/*/pf/*/scm/tree/
Disallow /users/*/pf/*/scm/blobs/
Disallow /users/*/pf/*/scm//tree/
Disallow /users/*/pf/*/scm//blobs/
Disallow /projects/*/translate/
Disallow */wiki/%21feeds/*
Disallow */wiki/%21pdf/*
Disallow */wiki/RecentChanges
Disallow /account/setlang.php

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • robots.txt file for http://osdn.net and https://osdn.net
  • please contact admin@osdn.net with questions or concerns
Back to top