Now the cli need access to ports, WTF? · ggml-org llama.cpp · Discussion #25482

1 min read Original article ↗

Why is the CLI now asking for access otherwise it wont load the model?
Hope this is some sort of mistake, otherwise this one is a NO NO for us.
Edit:
Found it, what a disaster, Here the culprit:
b9927
@github-actions github-actions released this 17 hours ago
b9927
c264f65
Details
cli : move to HTTP-based implementation (#24948)

cli: move to HTTP-based implementation

wip

working

remote server ok

cli support router mode

Co-authored-by: Piotr Wilkin ilintar@gmail.com

case: router with only one model

Apply suggestions from code review

Co-authored-by: Piotr Wilkin (ilintar) piotr.wilkin@syndatis.com

remove outdated comment

use destructor instead

add ftype

cli-view --> cli-ui

pimpl

no more json in header

nits fixes

also show model aliases

image