Show HN: Real-Time Bluesky Post Firehose in < 256MB
turbolytics.ioHello everyone, I'm still trying to get some traction with sqlflow!
I'm completely disenchanted with the modern data stack, and am trying to create a toolchain that helps treat data as if it were software: Observability, Integrated Testing, Performance and a real UX.
The linked page uses sqlflow (the foundation of this datastack) to consume and window the bluesky post firehose, save it to postgres, then serve it back over HTTP for dashboarding.
What're you using for analytics? Do you serve lines a chart to your customers? What tech are you using? Are you happy with the JVM (flink)?
i'm very interested in learning how you tackle streaming data and analytics today! Thank you
Are you aware you have posted a valid `Authorization: Bearer ...` key on your landing page?
yes! And I appreciate you calling it out, I'll choose a different name for it. It's just a token like posthog or google analytics issues customer-facing tokens. You are welcome to hit the API directly using it. What is this type of token called (one that identifies a JS client)?
an `id`?
It's sloppy to use an auth header for a dataset index, just make it a query param, because it definitely seems like a parameter for the query
I'm not your target user, I've left Bluesky and ATProto permanently