Log In Sign Up

wetenschapsforum.nl
robots.txt

Robots Exclusion Standard data for wetenschapsforum.nl

Resource Scan

Scan Details

Site Domain wetenschapsforum.nl
Base Domain wetenschapsforum.nl
Scan Status Ok
Last Scan2024-10-05T16:48:30+00:00
Next Scan 2024-10-12T16:48:30+00:00

Last Scan

Scanned2024-10-05T16:48:30+00:00
URL https://www.wetenschapsforum.nl/robots.txt
Domain IPs 104.21.38.174, 172.67.137.14, 2606:4700:3033::6815:26ae, 2606:4700:3036::ac43:890e
Response IP 172.67.137.14
Found Yes
Hash d8ed2501a2f7a0bd68fa868b97702ef345aee7f3dc2b56edabfeb2115201e226
SimHash 467ed29155ba

Groups

*

Rule Path
Disallow /bijeenkomst/
Disallow /bnr/
Disallow /cgi-bin/
Disallow /dev/
Disallow /enquete/
Disallow /errordocs/
Disallow /graph/
Disallow /invision*/
Disallow /mods/
Disallow /onderhoud/
Disallow /stats/
Disallow /specialetekens.html
Back to top

Comments

  • Eerst een opsomming van te blokkeren directories in de root
  • Eerst enkele toevoegingen op de bijgeleverde robots.txt (zie hieronder)
  • onderstaande op basis van een bij IPB bijgeleverde robots.txt
  • De volgende directories staan in de invision subdir, maar aangezien deze in de htacess worden herschreven naar directories direct onder de root worden ze hier ook zo genoemd
  • Disallow: /admin/
  • Disallow: /cache/
  • Disallow: /converge_local/
  • Disallow: /hooks/
  • Disallow: /ips_kernel/
  • Disallow: /retail/
  • Disallow: /public/style_captcha/
  • Disallow: /index.php?app=core&module=task
  • Disallow: /index.php?app=core&module=usercp&tab=forums&area=forumsubs
  • Disallow: /index.php?app=core&module=usercp&tab=forums&area=watch&watch=topic
  • Disallow: /index.php?app=forums&module=extras&section=forward
  • Disallow: /index.php?app=members&module=messaging
  • Disallow: /index.php?app=members&module=chat
  • Disallow: /index.php?app=members&module=search
  • Disallow: /index.php?app=members&module=search&do=active
  • Disallow: /index.php?&unlockUserAgent=1
  • Disallow: /*app=core&module=usercp
  • Disallow: /*app=core&module=usercp
  • Disallow: /*app=members&module=messaging
  • Disallow: /*&p=
  • Disallow: /*&pid=
  • Disallow: /*&hl=
  • Disallow: /*&start=
  • Disallow: /*view__getnewpost$
  • Disallow: /*view__getlastpost$
  • Disallow: /*view__old$
  • Disallow: /*view__new$
  • Disallow: /*view__getfirst$
  • Disallow: /*view__getprevious$
  • Disallow: /*view__getnext$
  • Disallow: /*view__getlast$
  • Disallow: /*&view=getnewpost$
  • Disallow: /*&view=getlastpost$
  • Disallow: /*&view=old$
  • Disallow: /*&view=new$
  • Disallow: /*&view=getfirst$
  • Disallow: /*&view=getprevious$
  • Disallow: /*&view=getnext$
  • Disallow: /*&view=getlast$
  • Disallow: /*?s=
  • Disallow: /*&s=
  • Disallow: /index.php?app=core&module=global&section=login&do=deleteCookies
  • Disallow: /index.php?app=forums&module=extras&section=rating
  • Disallow: /index.php?app=forums&module=forums&section=markasread
  • Google toegang geven tot alles:
  • User-agent: Mediapartners-Google
  • User-agent: Googlebot
  • Allow: /*
Back to top