@repligate how does the server work in terms of context windows? you aren't feeding these guys the entire chatlog every query right? do you go back N tokens or feed them summaries or what?
Posters: QiaochuYuan. QiaochuYuan
2 likes recorded by the source corpus.
Topics: AI & LLMs
View Post: https://x.com/QiaochuYuan/status/1836322282802942171