Settings

Theme

Open-source infra for data scientists

magniv.app

57 points by sachinkesiraju · 23 comments

Reader

7 threads
FloatArtifact

It reads open source core which means it's not fully open source. So the product page isn't exactly clear to me what's being offered. Although it is possible to have a sass with a fully open source code base of course.

  • jzone3

    We will have an open-source core framework (the Python decorator part). Kind of following the DBT model. Still very early (in alpha) so will not open source until the beta development begins.

dang

"Request early access" is not a valid Show HN. Please see the rules:

https://news.ycombinator.com/showhn.html

jzone3

Hey- Jared here! I am one of the founders of Magniv. Let me know if you have any questions. We are excited to get this in the hands of beta testers in the community :)

  • eatonphil

    The site says open-source but there's no link to code, only a suggestion to sign up for early access?

    • jzone3

      Yes we are still very early! The core framework will be released to design partners first then to the community.

      • torbTurret

        So it’s not currently open-sourced?

        How did this make it to the front-page - it’s basically nothing more than an advertisement at this stage? Am I misinterpreting something?

        • jonpon

          We are looking for people to join the beta -- we are basically offering them free engineering.

          I guess there are enough people who find this relevant to vote us onto the front page.

          Would you be interested in the beta? :)

  • adolph

    It looks like Magniv is targeting Python in general. This is similar to ClearML. What are the differentiating points to Magniv compared to similar products?

    It seems like the product also integrates with SCM systems. Are you using gitea and then containers to push code and data to execution like CodeOcean?

    https://github.com/allegroai/clearml

    https://codeocean.com/

    • jonpon

      Yeah, so one of our differentiating points is that we can integrate with whatever scheduler you are already using.

      On top of that a lot of the libraries that exist are focused on ML, focusing on resources/gpu etc. We are more focused on the data science side of this problem.

      Similar though.

alexvybe

We’ve been trying to plan out building our data team at my company— been so hard finding a data scientist to do infra too. Wonder if this would help...

  • jzone3

    Yes! Please sign up on our website, would love to chat further and see if it can help. Our goal is to decrease reliance on data engineers when building data teams

keshav55

Very hyped to see where this goes. Much needed for data science teams.

maxmalkav

The “our experienced ex-Facebook engineers” sounds like a bit weird claim to me, TBH. I imagine them securing a continuous flow of ex-FB employees to guarantee this in the future.

jakrim

The two founders are two of the smartest people I know. I think Magniv will be a game-changer for data science teams

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection