Show HN: We're building a search engine for GCP
listvms.comHi HN,
I previously wore SWE/SRE hats on GCP. Later, I was on the other side, managing thousands of machines. The friction points of onboarding and operating cloud systems are personal problems to me.
I’ve found it hard to keep track of all the random cloud resources floating around, especially as my team’s assets proliferated. Occasionally, there is a resource affecting an outage but no one remembers where it is.
I am constantly frustrated by existing tooling. APIs can work, after you’ve navigated the byzantine documentation, but I often find myself doing ad-hoc tasks which are best served by a UI. Unfortunately, the search bar in the GCP web console does not behave as you expect. For example, it only seems to search for prefixes, rather than substrings, on App Engine stuff.
The GCP web console as a whole is boatloads of JavaScripts, 90+ navigation items on the left menu, and a constant stream of UX/UI controls. I'm fond of HackerNews and Craigslists, because ultimately, we just need to list/search and maybe submit a webform.
This year I convinced my friend to quit their coding gig on Wall Street to help me make the cloud accessible. We’ve started with a small tool to this end: a search engine for the cloud. What we have demo-able for you today is the GCP component of it.
Our tech:
- Go with conservative sprinkles of VanillaJS. It allowed us to focus on the domain rather than the language.
- SSR. Right now the pages are under the magical 14kb, but we’re eyeing the
- HTMX (rendering fragments of HTML strings from the server) pattern
- We’ll dabble with Elixir, Rust, and Zig in other parts of the system
- GCP (We think GCP runs great once you get set. The problem is getting to that point, which is what we want to help others do). We also have some stuff on AWS.
- Plaintext. Our “agile process” was a TODO.org file, and Git. It’ll be super fun to do a timelapse of it.Diesnt the GCP search bar already search resources? It does seem like there are a few data fields that aren't indexed that I would like to be but it handles the cases I see in the demo.
What this is really needed for is AWS because they don't really have a cross-region search.
> It does seem like there are a few data fields that aren't indexed that I would like to be but it handles the cases I see in the demo.
For Compute VMs, yes.
Indexing is quite sparse outside of Compute. For example, App Engine is supposed to be an important product but substring searching doesn't work.
> What this is really needed for is AWS because they don't really have a cross-region search.
We're working on it :)
For the AWS case, this might be of interest to you: https://aws.amazon.com/about-aws/whats-new/2022/06/support-c...
They've just begun to do global search for VMs, but obviously that addresses just one need.
Cloud providers have been sitting on this problem for years without taking action, so we're just impatient.
We also do something they don't / won't: cross-cloud search.
That link is about ElasticSearch, not searching for AWS resources. It doesn't seem related at all.
Sorry, I intended to send this:
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/Using_Fi...
The point is that pockets of AWS are recognizing a need for global resource search.
But we are totally taking note of your request for cross-region search :) It's valuable feedback to us and why we're posting here.