Last year highlighted the limitations and challenges of centralized AI services, including the spike in demand and turmoil in AI company management. At HippoML, we are developing a next-generation GPU AI inference engine can be used with NVIDIA, Apple, and AMD GPUs. We have unified the AI inference engine to serve both data center GPUs and consumer applications with a single solution. While providing enterprise customers with the best data center GPU inference capabilities, we also developed a super AI app called PrivateCanvas. This app, powered by our inference engine, aims to decentralize AI and bring its benefits to a wider audience.
PrivateCanvas: Your Cross-Platform, Free & Private AI Creativity App Powered by Local GPU (Early Access Version)
Download Now: https://hippoml.com/product/privatecanvas
Join Our Discord: https://discord.com/invite/ZP8weNy5yQ
Supported Feature:
- SDXL Text to Image
- SDXL LCM Fast Text to Image
- Long Prompt
- Refine Images
- Prompt LLM
- Prompt Fusion
- Realtime Creating
- Automatic & Manual Removal of unwanted objects
- Manual Editing (Inpainting)
- Expand Image with Infinity Canvas (Outpainting)
- 4X Upscale on Any Image
We bring state-of-the-art Large Language Model (LLMs), Stable Diffusion XL (SDXL), Stable Diffusion LCM, SDXL LCM, SDXL Inpainting, Segment Anything, and various GANs into one local app: HippoML PrivateCanvas, to help you create and edit images, entirely under your control. This is the first step towards the super AI app: our long-term goal is to allow you to process speech, video, language, images, and every AI service with your control, without depending on any single centralized online service.
High-Efficiency Optimization for GenAI
All models are compiled into a lossless low-bit format. This technology elevates GPU utilization to new heights across popular models. Moreover, an advanced model context management system enables the integration of all state-of-the-art models into as little as 8GB of GPU memory, with negligible model switching time.
Today’s generative AI applications require not just speed, but also intelligent model optimization and efficient computing to deliver breakthrough experiences. HippoML’s approach future boosts the capabilities of the NVIDIA Tensor Core GPUs while maintaining a minimal footprint, helping bring the next generation of generative AI applications to market wherever a user’s processing capabilities reside.
Ian Buck, Vice President of Hyperscale and HPC at NVIDIA
Minimal Yet Powerful Engine
No Dependencies & Portable: Our inference engine stands apart from traditional systems, requiring no dependencies on Python or other GPU libraries. They are fully portable with dynamic shape support, enabling immediate use with a simple double-click. Their compact size (~10MB — 100MB) allows for seamless integration into any application or game.
Universal Hardware Compatibility: The engine features a unified runtime and API, facilitating a single codebase to adapt effortlessly to various GPUs with optimal performance, including those from NVIDIA, AMD, and Apple.
HippoML’s Prompt LLM
Say Goodbye to Prompt Incantation
We believe that creativity should be accessible to all, without the need for “reciting a spell” to an AI model. We created a process to train Llama2 with human feedback, and created one of the best LLMs to generate prompts automatically. We enabled you to edit the LLM output to make it perfect. Leveraging our LLM technology and the standard SDXL, we’ve elevated the text-to-image experience to new heights.
Get HippoML Blog’s stories in your inbox
Join Medium for free to get updates from this writer.
We demonstrate a few prompts with Prompt LLM + Standard SDXL, Standard SDXL, OpenAI DALL-E 3 and Adobe Firefly 2.
realistic photo of a victorian young woman with steampunk makeup and colorful fine feather
Universe in a fancy Franconian bottle
Transform Simple Words into Fine Art
PrivateCanvas effortlessly transforms two straightforward sentences into exquisite art. Using dual prompts allows for richer and more intricate visual storytelling compared to a singular input. By leveraging open-source models like SDXL, we’ve significantly lowered the barriers for image generation, enabling users to craft intricate artworks with ease.
Prompt 1: Crusades under armor are running with a machine gun in desert, face toward camera; Prompt 2: desert, sand dunes, sand storms in background
Press enter or click to view image in full size
Prompt 1: Mystical image of a girl e with radiant purple color strings of light weaving through their entire body like dance; Prompt 2: A color painted beautiful girl with detailed face, long hair
Press enter or click to view image in full size
Continuous Editing in Infinity Canvas
Unlike other popular text-to-image services or WebUI, we believe your creativity shouldn’t be confined to a single shot. PrivateCanvas provides an infinity canvas, combined with advanced AI models, to empower you to craft your vision step by step.
Realtime Creating
Press enter or click to view image in full size
Automatic & Manual Tools to Remove Unwanted Object
Press enter or click to view image in full size
Press enter or click to view image in full size
Automatic Object Detection & Editing
Press enter or click to view image in full size
Manual Editing
Press enter or click to view image in full size
Expand Image with Infinity Canvas
Press enter or click to view image in full size
4X Upscale on Any Image
Press enter or click to view image in full size
Lightning Speed, Free for Everyone, Without Compromising Privacy
Utilizing HippoML’s cutting-edge GPU inference engine, PrivateCanvas accelerates SDXL processing to remarkable speeds, surpassing CoreML and other specialized acceleration packages. Every PrivateCanvas model is operating directly on your Apple or NVIDIA GPU. We pledge to never collect or access any of your prompts or images.
Press enter or click to view image in full size
Try It Today!
Download HippoML PrivateCanvas for Windows, Linux, and MacOS. Forget the complications of Python, Docker, or GPU software dependencies — simply double-click and let your creativity flow.
Download Now: https://hippoml.com/product/privatecanvas
Quick Start Tutorial: https://blog.hippoml.com/privatecanvas-quick-start-tutorial-704f39b4a421
Decentralized AI Inference Network
If you don’t have local GPU resources available, HippoML’s technology makes it possible to build a decentralized AI inference network for the following reasons:
No Python, no dependency hell, and extraordinary performance
Models compiled by HippoEngine are able to execute in a standalone way. No third party library is needed. Download, double click, and run.
Proof of Work is guaranteed
Proof of work is the hardest problem in a decentralized network. HippoEngine streamlines this by converting AI models into fixed binary code, allowing for quick integrity checks. Any change in the binary is automatically detected, ensuring that only trusted computations can continue.
Future System for Today
HippoEngine is designed for future systems with new memory hierarchy, such as NVIDIA GraceHopper. We find that it also works well on the systems of today. Even with PCI-E 4.0, the model cold start time can be up to 100X faster than today’s cloud API providers.
Pioneer in Decentralization
Lastly, as a pioneer of decentralization, we have held comprehensive intellectual properties about decentralized AI technology and we have built the prototype.
Sharing Economy & AI Inference
The decentralized network is able to assign AI inference to run in the local city, and reduce 10X of network communication latency compared to centralized cloud inference solution today. The GPU provider will directly earn money from each API call.
We are listening
If you have a strong need for decentralized AI inference networks, join our discord and talk to us. We want to listen to your needs and decide the future of decentralized AI inference.
Join Our Discord: https://discord.com/invite/ZP8weNy5yQ