Settings

Theme

VQA and Image Chunking for MLLMs (GPT-4V and Gemini)

joanfihu.com

1 points by joanfihu 2 years ago · 1 comment

Reader

joanfihuOP 2 years ago

Handling large images with resolutions higher than 2048x2048 remains a challenge for MLLMs.

Image chunking splits large images into multiple smaller images. Then the model processes each image and uses information from all of them to answer a question.

I managed to get it to work with a 3840px X 20294px web page screenshot. It also works with documents that have figures (tables, charts, illustrations, etc).

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection