gamedev.ventures
robots.txt

Robots Exclusion Standard data for gamedev.ventures

Resource Scan

Scan Details

Site Domain gamedev.ventures
Base Domain gamedev.ventures
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-05-23T17:53:08+00:00
Next Scan 2025-06-22T17:53:08+00:00

Last Successful Scan

Scanned2025-03-30T16:53:17+00:00
URL http://gamedev.ventures/robots.txt
Redirect https://gamedev.net:443/robots.txt
Redirect Domain gamedev.net
Redirect Base gamedev.net
Domain IPs 130.211.24.203
Redirect IPs 130.211.24.203
Response IP 130.211.24.203
Found Yes
Hash 12c0544db46c6fb7bb81af86af31856870ae49d836a2b3459df90c79917d4585
SimHash 690f846828f3

Groups

*

Rule Path
Disallow /api/
Disallow /*admin/
Disallow /cgi-bin/
Disallow /datastore/
Disallow /system/
Disallow /login/
Disallow /logout/
Disallow /profile/*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://gamedev.net/sitemap.xml

Comments

  • Disallow: /applications/
  • Disallow: /plugins/
  • Disallow files
  • Disallow: /403error.php
  • Disallow: /404error.php
  • Disallow: /500error.php
  • Disallow: /Credits.txt
  • Disallow: /error.php
  • Disallow: /upgrading.html
  • Querystring
  • Disallow: /?tab=*
  • Disallow: /*?app=*
  • Disallow: /*sortby=*
  • Disallow: /*/?do=download
  • Disallow: /profile/*/?do=*
  • Disallow: /profile/*/content/
  • Disallow: /*?do=add
  • Disallow: /*?do=email
  • Disallow: /*?do=getNewComment
  • Disallow: /*?do=getLastComment
  • Disallow: /*?do=getLastComment
  • Disallow: /*?do=reportComment
  • Allow specific parts
  • Allow: /applications/core/interface/imageproxy/imageproxy.php?img=*