Settings

Theme

1.8-3.3x faster Embedding finetuning now in Unsloth

unsloth.ai

3 points by electroglyph 10 days ago · 3 comments

Reader

storystarling 10 days ago

Do the memory savings carry over to inference or is this strictly optimizing the backward pass? I'm running embedding pipelines via Celery and being able to squeeze this into lower VRAM would help the margins quite a bit.

danielhanchen 10 days ago

Excited to have collabed on this! Thanks electroglyph for the contrib!

electroglyphOP 10 days ago

see also: https://www.reddit.com/r/LocalLLaMA/comments/1qk9vmv/1833x_f...

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection