Show HN: 60% higher tokens per second for 70B custom LLMs

1 points by mikejulietbravo a year ago · 0 comments · 1 min read

We optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost

No comments yet.