Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
TrevorJ
on Nov 30, 2023
|
parent
|
context
|
favorite
| on:
Is anyone using self hosted LLM day to day and tra...
I think with RAG it's pretty reasonable. Put your corpus in pinecone or some other vector store and relevant sections get injected along with your prompt which lessens the burden on context window.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: