Log In Sign Up

gamedev.ventures
robots.txt

Robots Exclusion Standard data for gamedev.ventures

Resource Scan

Scan Details

Site Domain gamedev.ventures
Base Domain gamedev.ventures
Scan Status Ok
Last Scan2024-11-12T09:06:33+00:00
Next Scan 2024-11-19T09:06:33+00:00

Last Scan

Scanned2024-11-12T09:06:33+00:00
URL http://gamedev.ventures/robots.txt
Redirect https://gamedev.net:443/robots.txt
Redirect Domain gamedev.net
Redirect Base gamedev.net
Domain IPs 130.211.24.203
Redirect IPs 130.211.24.203
Response IP 130.211.24.203
Found Yes
Hash 12c0544db46c6fb7bb81af86af31856870ae49d836a2b3459df90c79917d4585
SimHash 690f846828f3

Groups

*

Rule Path
Disallow /api/
Disallow /*admin/
Disallow /cgi-bin/
Disallow /datastore/
Disallow /system/
Disallow /login/
Disallow /logout/
Disallow /profile/*

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://gamedev.net/sitemap.xml
Back to top

Comments

  • Disallow: /applications/
  • Disallow: /plugins/
  • Disallow files
  • Disallow: /403error.php
  • Disallow: /404error.php
  • Disallow: /500error.php
  • Disallow: /Credits.txt
  • Disallow: /error.php
  • Disallow: /upgrading.html
  • Querystring
  • Disallow: /?tab=*
  • Disallow: /*?app=*
  • Disallow: /*sortby=*
  • Disallow: /*/?do=download
  • Disallow: /profile/*/?do=*
  • Disallow: /profile/*/content/
  • Disallow: /*?do=add
  • Disallow: /*?do=email
  • Disallow: /*?do=getNewComment
  • Disallow: /*?do=getLastComment
  • Disallow: /*?do=getLastComment
  • Disallow: /*?do=reportComment
  • Allow specific parts
  • Allow: /applications/core/interface/imageproxy/imageproxy.php?img=*
Back to top