why does nobody offer a bulk inference product for llms? eg “here are 10,000 prompts, give me results in the next 24 hours”. any time when a gpu would be unused (presumably often?) you could work on…

Posters: cis_female. cis_female

3 likes recorded by the source corpus.