Log In Sign Up

solvetic.com
robots.txt

Robots Exclusion Standard data for solvetic.com

Resource Scan

Scan Details

Site Domain solvetic.com
Base Domain solvetic.com
Scan Status Ok
Last Scan2024-05-15T00:32:26+00:00
Next Scan 2024-05-22T00:32:26+00:00

Last Scan

Scanned2024-05-15T00:32:26+00:00
URL https://solvetic.com/robots.txt
Domain IPs 178.33.118.246
Response IP 178.33.118.246
Found Yes
Hash 346d9bd3a9bd9480ed3c5106a9858c6c280b0c55589ccaea824cdd12474d1041
SimHash 2630294b469e

Groups

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /cache/
Disallow /converge_local/
Disallow /hooks/
Disallow /ips_kernel/
Disallow /retail/
Disallow /public/style_captcha/
Disallow /index.php?app=core&module=task
Disallow /index.php?app=forums&module=moderate&section=moderate
Disallow /index.php?app=forums&module=extras&section=forward
Disallow /index.php?app=members&module=chat
Disallow /index.php?&unlockUserAgent=1
Disallow /*%26module%3Dsearch
Disallow /*%26search_tags%3D
Disallow /*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /*app%3Dcore%26module%3Dusercp
Disallow /*app%3Dmembers%26module%3Dmessaging
Disallow /*%26p%3D
Disallow /*%26pid%3D
Disallow /*%26hl%3D
Disallow /*%26start%3D
Disallow /*view__getnewpost$
Disallow /*view__getlastpost$
Disallow /*view__old$
Disallow /*view__new$
Disallow /*view__getfirst$
Disallow /*view__getprevious$
Disallow /*view__getnext$
Disallow /*view__getlast$
Disallow /*%26view%3Dgetnewpost$
Disallow /*?view=getnewpost$
Disallow /*%26view%3Dgetlastpost$
Disallow /*%26view%3Dold$
Disallow /*%26view%3Dnew$
Disallow /*%26view%3Dgetfirst$
Disallow /*%26view%3Dgetprevious$
Disallow /*%26view%3Dgetnext$
Disallow /*%26view%3Dgetlast$
Disallow /*view%3Dgetnextunread$
Disallow /*?s=
Disallow /*%26s%3D
Disallow /index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /index.php?app=forums&module=extras&section=rating
Disallow /index.php?app=forums&module=forums&section=markasread
Disallow /*%26do%3Dwho
Disallow /*%26section%3Ddname
Disallow /*module%3Dextras%26section%3Dunanswered%26do%3DnoReplies
Disallow /user/*?tab=reputation&app_tab
Disallow /members
Disallow /index.php?app=core&module=search&do=viewNewContent&search_app=
Disallow /descargas/getdownload/
Disallow /descargas/go/
Disallow /index.php?app=core&module=global&section=login
Disallow /*forums%26section%3Dattach%26tid%3D
Disallow /index.php?app=core&module=attach&section=attach&attach_id=
Disallow /index.php?app=sospromote
Disallow /index.php?app=core&module=reports&rcom=
Disallow /*module%3Dattach%26section%3Dattach%26attach_id%3D
Disallow /statuses/
Disallow /public/style_images/bienvenida.html
Disallow /app%3Dcalendar?module=calendar&section=view&cal_id=1&do=showweek&week=
Disallow /index.php?app=calendar&module=calendar&section=view&cal_id=*
Disallow /calendario/*
Disallow /public/style_images/destacados/objetivo/
Disallow /index.php?app=contactus
Disallow /help/
Disallow /tags/forums/*
Disallow /tags/downloads/*
Disallow /tags/ccs/*
Disallow /index.php?app=core&module=help
Disallow /*actions%26section%3Dattachments
Disallow /*markasread
Disallow /membermap/
Disallow /?app=membermap%2F
Disallow /index.php?app=motm
Disallow /?app=motm
Disallow /*?mode=best
Disallow /page/recopilaciones/s/*/?view=archive*
Disallow /index.php?app=ccs&module=databases&section=courses*
Disallow /other_addons/*
Back to top

Other Records

Field Value
sitemap https://www.solvetic.com/sitemap.xml
Back to top

Comments

  • First, this is the robots.txt from http://www.wikipedia.org/ for "other" robots. Thanks a lot Wikipedia!
  • Please note: There are a lot of pages on this site, and there are
  • some misbehaved spiders out there that go _way_ too fast. If you're
  • irresponsible, your access to the site may be blocked.
  • Crawlers that are kind enough to obey, but which we'd rather not have
  • unless they're feeding search engines.
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
  • User-agent: Microsoft.URL.Control
  • Disallow: /
  • Sorry, wget in its recursive mode is a frequent problem.
  • Please read the man page and use it properly; there is a
  • --wait option you can use to set the delay between hits,
  • for instance.
  • The 'grub' distributed client has been *very* poorly behaved.
  • Doesn't follow robots.txt anyway, but...
  • Hits many times per second, not acceptable
  • http://www.nameprotect.com/botinfo.html
  • A capture bot, downloads gazillions of pages with no public benefit
  • http://www.webreaper.net/
  • Solvetic main sitemap index
Back to top