Super AI Creativity App Run with Local GPU on Mac/Windows/Linux [Early Access]

· Medium ·

6 min read Original article ↗

HippoML Blog

Last year highlighted the limitations and challenges of centralized AI services, including the spike in demand and turmoil in AI company management. At HippoML, we are developing a next-generation GPU AI inference engine can be used with NVIDIA, Apple, and AMD GPUs. We have unified the AI inference engine to serve both data center GPUs and consumer applications with a single solution. While providing enterprise customers with the best data center GPU inference capabilities, we also developed a super AI app called PrivateCanvas. This app, powered by our inference engine, aims to decentralize AI and bring its benefits to a wider audience.

PrivateCanvas: Your Cross-Platform, Free & Private AI Creativity App Powered by Local GPU (Early Access Version)

Download Now: https://hippoml.com/product/privatecanvas

Join Our Discord: https://discord.com/invite/ZP8weNy5yQ

Supported Feature:

  • SDXL Text to Image
  • SDXL LCM Fast Text to Image
  • Long Prompt
  • Refine Images
  • Prompt LLM
  • Prompt Fusion
  • Realtime Creating
  • Automatic & Manual Removal of unwanted objects
  • Manual Editing (Inpainting)
  • Expand Image with Infinity Canvas (Outpainting)
  • 4X Upscale on Any Image

We bring state-of-the-art Large Language Model (LLMs), Stable Diffusion XL (SDXL), Stable Diffusion LCM, SDXL LCM, SDXL Inpainting, Segment Anything, and various GANs into one local app: HippoML PrivateCanvas, to help you create and edit images, entirely under your control. This is the first step towards the super AI app: our long-term goal is to allow you to process speech, video, language, images, and every AI service with your control, without depending on any single centralized online service.

High-Efficiency Optimization for GenAI

All models are compiled into a lossless low-bit format. This technology elevates GPU utilization to new heights across popular models. Moreover, an advanced model context management system enables the integration of all state-of-the-art models into as little as 8GB of GPU memory, with negligible model switching time.

Today’s generative AI applications require not just speed, but also intelligent model optimization and efficient computing to deliver breakthrough experiences. HippoML’s approach future boosts the capabilities of the NVIDIA Tensor Core GPUs while maintaining a minimal footprint, helping bring the next generation of generative AI applications to market wherever a user’s processing capabilities reside.

Ian Buck, Vice President of Hyperscale and HPC at NVIDIA

Minimal Yet Powerful Engine

No Dependencies & Portable: Our inference engine stands apart from traditional systems, requiring no dependencies on Python or other GPU libraries. They are fully portable with dynamic shape support, enabling immediate use with a simple double-click. Their compact size (~10MB — 100MB) allows for seamless integration into any application or game.

Universal Hardware Compatibility: The engine features a unified runtime and API, facilitating a single codebase to adapt effortlessly to various GPUs with optimal performance, including those from NVIDIA, AMD, and Apple.

HippoML’s Prompt LLM

Say Goodbye to Prompt Incantation

We believe that creativity should be accessible to all, without the need for “reciting a spell” to an AI model. We created a process to train Llama2 with human feedback, and created one of the best LLMs to generate prompts automatically. We enabled you to edit the LLM output to make it perfect. Leveraging our LLM technology and the standard SDXL, we’ve elevated the text-to-image experience to new heights.

Get HippoML Blog’s stories in your inbox

Join Medium for free to get updates from this writer.

Remember me for faster sign in

We demonstrate a few prompts with Prompt LLM + Standard SDXL, Standard SDXL, OpenAI DALL-E 3 and Adobe Firefly 2.

realistic photo of a victorian young woman with steampunk makeup and colorful fine feather

Universe in a fancy Franconian bottle

Transform Simple Words into Fine Art

PrivateCanvas effortlessly transforms two straightforward sentences into exquisite art. Using dual prompts allows for richer and more intricate visual storytelling compared to a singular input. By leveraging open-source models like SDXL, we’ve significantly lowered the barriers for image generation, enabling users to craft intricate artworks with ease.

Prompt 1: Crusades under armor are running with a machine gun in desert, face toward camera; Prompt 2: desert, sand dunes, sand storms in background

Press enter or click to view image in full size

Prompt 1: Mystical image of a girl e with radiant purple color strings of light weaving through their entire body like dance; Prompt 2: A color painted beautiful girl with detailed face, long hair

Press enter or click to view image in full size

Continuous Editing in Infinity Canvas

Unlike other popular text-to-image services or WebUI, we believe your creativity shouldn’t be confined to a single shot. PrivateCanvas provides an infinity canvas, combined with advanced AI models, to empower you to craft your vision step by step.

Realtime Creating

Press enter or click to view image in full size

Automatic & Manual Tools to Remove Unwanted Object

Press enter or click to view image in full size

Manual Remove Text in Generated Images

Press enter or click to view image in full size

Automatic Remove Object

Automatic Object Detection & Editing

Press enter or click to view image in full size

Manual Editing

Press enter or click to view image in full size

Expand Image with Infinity Canvas

Press enter or click to view image in full size

4X Upscale on Any Image

Press enter or click to view image in full size

Lightning Speed, Free for Everyone, Without Compromising Privacy

Utilizing HippoML’s cutting-edge GPU inference engine, PrivateCanvas accelerates SDXL processing to remarkable speeds, surpassing CoreML and other specialized acceleration packages. Every PrivateCanvas model is operating directly on your Apple or NVIDIA GPU. We pledge to never collect or access any of your prompts or images.

Press enter or click to view image in full size

Try It Today!

Download HippoML PrivateCanvas for Windows, Linux, and MacOS. Forget the complications of Python, Docker, or GPU software dependencies — simply double-click and let your creativity flow.

Download Now: https://hippoml.com/product/privatecanvas

Quick Start Tutorial: https://blog.hippoml.com/privatecanvas-quick-start-tutorial-704f39b4a421

Decentralized AI Inference Network

If you don’t have local GPU resources available, HippoML’s technology makes it possible to build a decentralized AI inference network for the following reasons:

No Python, no dependency hell, and extraordinary performance

Models compiled by HippoEngine are able to execute in a standalone way. No third party library is needed. Download, double click, and run.

Proof of Work is guaranteed

Proof of work is the hardest problem in a decentralized network. HippoEngine streamlines this by converting AI models into fixed binary code, allowing for quick integrity checks. Any change in the binary is automatically detected, ensuring that only trusted computations can continue.

Future System for Today

HippoEngine is designed for future systems with new memory hierarchy, such as NVIDIA GraceHopper. We find that it also works well on the systems of today. Even with PCI-E 4.0, the model cold start time can be up to 100X faster than today’s cloud API providers.

Pioneer in Decentralization

Lastly, as a pioneer of decentralization, we have held comprehensive intellectual properties about decentralized AI technology and we have built the prototype.

Sharing Economy & AI Inference

The decentralized network is able to assign AI inference to run in the local city, and reduce 10X of network communication latency compared to centralized cloud inference solution today. The GPU provider will directly earn money from each API call.

We are listening

If you have a strong need for decentralized AI inference networks, join our discord and talk to us. We want to listen to your needs and decide the future of decentralized AI inference.

Join Our Discord: https://discord.com/invite/ZP8weNy5yQ