Log In Sign Up

gamedev.me
robots.txt

Robots Exclusion Standard data for gamedev.me

Resource Scan

Scan Details

Site Domain gamedev.me
Base Domain gamedev.me
Scan Status Failed
Failure ReasonScan timed out.
Last Scan4/9/2025, 6:12:40 PM
Next Scan 7/8/2025, 6:12:40 PM

Last Successful Scan

Scanned11/18/2024, 6:11:27 PM
URL http://gamedev.me/robots.txt
Redirect https://gamedev.net:443/robots.txt
Redirect Domain gamedev.net
Redirect Base gamedev.net
Domain IPs 130.211.24.203
Redirect IPs 130.211.24.203
Response IP 130.211.24.203
Found Yes
Hash 12c0544db46c6fb7bb81af86af31856870ae49d836a2b3459df90c79917d4585
SimHash 690f846828f3

Groups

*

Rule Path
Disallow /api/
Disallow /*admin/
Disallow /cgi-bin/
Disallow /datastore/
Disallow /system/
Disallow /login/
Disallow /logout/
Disallow /profile/*

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://gamedev.net/sitemap.xml
Back to top

Comments

  • Disallow: /applications/
  • Disallow: /plugins/
  • Disallow files
  • Disallow: /403error.php
  • Disallow: /404error.php
  • Disallow: /500error.php
  • Disallow: /Credits.txt
  • Disallow: /error.php
  • Disallow: /upgrading.html
  • Querystring
  • Disallow: /?tab=*
  • Disallow: /*?app=*
  • Disallow: /*sortby=*
  • Disallow: /*/?do=download
  • Disallow: /profile/*/?do=*
  • Disallow: /profile/*/content/
  • Disallow: /*?do=add
  • Disallow: /*?do=email
  • Disallow: /*?do=getNewComment
  • Disallow: /*?do=getLastComment
  • Disallow: /*?do=getLastComment
  • Disallow: /*?do=reportComment
  • Allow specific parts
  • Allow: /applications/core/interface/imageproxy/imageproxy.php?img=*
Back to top