@repligate how does the server work in terms of context windows? you aren't feeding these guys the entire chatlog every query right? do you go back N tokens or feed them summaries or what?

Posters: QiaochuYuan. QiaochuYuan

2 likes recorded by the source corpus.

Topics: AI & LLMs

View Post: https://x.com/QiaochuYuan/status/1836322282802942171