original post: https://redd.it/1gmnv6f
5 months ago, I released Vector Companion. Ever since then, I added major performance updates, including decreased latency, lower VRAM requirements and more interesting responses. Here are the results. Repo in the comments.
LocalLLaMA by swagonflyyyy