why is [list(logits).index(token_ids[i]) for i, indices in enumerate(sorted_logits)] soooooo much slower than torch.argmax((sorted_logits == token_ids.unsqueeze(1)).int(), dim=1) ? I tested it and…

Posters: natural_hazard. natural_hazard

3 likes recorded by the source corpus.

Topics: Software

View Post: https://x.com/natural_hazard/status/1791679056041136341