getgnu.org
robots.txt

Robots Exclusion Standard data for getgnu.org

Archived Snapshots

Resource Scan

Scan Details

Site Domain	getgnu.org
Base Domain	getgnu.org
Scan Status	Ok
Last Scan	2025-07-04T08:53:37+00:00
Next Scan	2025-08-03T08:53:37+00:00

Last Scan

Scanned	2025-07-04T08:53:37+00:00
URL	https://getgnu.org/robots.txt
Domain IPs	104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP	104.21.16.1
Found	Yes
Hash	f75010c4519173004f293f1eeb0ce228665a82c0442f502672105200bf3970d9
SimHash	69941f80d485

Groups

duckduckbot/1.1

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

duckduckbot/1.0

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

duckduckgo bot

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

googlebot

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

googlebot-mobile

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

yandex

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

msnbot

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

bingbot

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

yahoo

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

yahoo! slurp

Rule	Path
Disallow	/wp-admin/
Disallow	/wp-content/uploads/
Disallow	/wp-content/uploads.orig/
Disallow	/wp-content/wptouch-data/
Disallow	/wp-includes/
Disallow	/dosya/
Disallow	/*id%3D
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css

Rule

Path

Disallow

/wp-admin/

Disallow

/wp-content/uploads/

Disallow

/wp-content/uploads.orig/

Disallow

/wp-content/wptouch-data/

Disallow

/wp-includes/

Disallow

/dosya/

Disallow

/*id%3D

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Other Records

Field	Value	Comment
crawl-delay	60	her 60 saniyede maksimum 1 sayfa

Field

Value

Comment

crawl-delay

her 60 saniyede maksimum 1 sayfa

yahoo-blogs/v3.9

Rule	Path
Disallow	/

Rule

Path

Disallow

yahoo-mmcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefs

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

adsbot-google

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot-image

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	http://www.getgnu.org/sitemap.xml

Field

Value

sitemap

http://www.getgnu.org/sitemap.xml

getgnu.orgrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

duckduckbot/1.1

Other Records

duckduckbot/1.0

Other Records

duckduckgo bot

Other Records

googlebot

Other Records

googlebot-mobile

Other Records

yandex

Other Records

msnbot

Other Records

bingbot

Other Records

yahoo

Other Records

yahoo! slurp

Other Records

yahoo-blogs/v3.9

yahoo-mmcrawler

slurp

ahrefs

baiduspider

ia_archiver

adsbot-google

googlebot-image

semrushbot

semrushbot-sa

Other Records

getgnu.org
robots.txt