Settings

Theme

Metahead – An enterprise-grade, Git-based metarepo

metahead.dev

53 points by grokx 2 years ago · 37 comments

Reader

fuddle 2 years ago

As someone who's never heard of a metarepo before, I'm still not sure exactly what it is or why I should use it after reading their landing page. I think a metarepo explainer video would helpful.

  • vlad_ivanov 2 years ago

    Vlad from metahead here. We answer this in the FAQ – metarepo is just a git repo that you can slice and dice any way you want while preserving history and having the ability to work on your part of the code. We went with "meta" because it's not exactly mono- or poly- – it's flexible enough so that you can make anything out of it. It also stores information about how your repos / projections relate – in that sense it's "meta" as well.

    • layer8 2 years ago

      “Meta” would normally mean that a metarepo relates to a repo like a repo relates to a file. That would imply an orthogonal versioning axis, similar to a bitemporal database.

      I find the term confusing here because that’s not really what it is (if my understanding is correct).

      • vlad_ivanov 2 years ago

        It does, in fact, relate to a repo like a repo relates to a file! Because every projection only contains related history and subtrees – much like if you were looking at a history of a file in a git repository

        • layer8 2 years ago

          So I can “commit” a repo containing some history as the new version of a previous repo containing a different history?

          • vlad_ivanov 2 years ago

            You can, if histories are related. They usually are - you add commits on top. Your history will be reverse-transformed in such a way so that its impact on the whole metarepo can be assessed. So if you modified a file in a library that ten other applications depend on, those applications would get this modification applied and would trigger a CI run to verify your change.

    • flir 2 years ago

      It's... a materialized view? There's a great big ur-repo back there somewhere, and your tool provides multiple views into it?

      Hoenstly, that's a neat idea. No use to me, but a neat idea.

    • remram 2 years ago

      Where is your FAQ? I couldn't find it in the first few pages of your websites. No link in the footer either. The only button in your navbar is "about" which is not it.

    • fuddle 2 years ago

      Thanks for the explanation, that helps a bit. I still think a video explainer would be helpful. :)

  • umvi 2 years ago

    "metadata" is data that describes other data.

    I would guess a "metarepo" is a repo that contains other repos.

    Why would you want this? It's an alternative to monorepos or hacky homegrown solutions for managing related repos.

iFire 2 years ago

I am still really happy with using git subrepo as my metarepo https://github.com/ingydotnet/git-subrepo

  • iFire 2 years ago

    The readme is understandable and the failure modes means it degrades to an ordinary git repo.

    > This git command "clones" an external git repo into a subdirectory of your repo. Later on, upstream changes can be pulled in, and local changes can be pushed back. Simple.

wdb 2 years ago

One of the reasons to have a mono repo is to avoid the mirroring of PRs between repos. If you have 40+ repos and each time a package gets updated and you need to raise 39 PRs to bump the package. It's getting really old to do mirroring etc.

Not sure how this is an improvement over using a mono repo

  • vlad_ivanov 2 years ago

    One thing to note is that we don't bump package versions but rather "mirror" the source code, so in that sense it works like a monorepo. But you're right that PR mirroring doesn't work beyond a certain point, and we certainly intend to scale beyond that in future

edgyquant 2 years ago

Not sure the implementation details but this

    $ git clone https://josh-project.dev/josh.git:/docs.git
Seems really neat to me
rbetts 2 years ago

> Maintaining an open-source library as part of your proprietary codebase? You can use metahead to publish and synchronise part of your code in its own public repo. Accept external contributions and check them against your internal usage of the library. You have the choice to make as much or as little as you want public, with file-granularity filters.

I've wished for this in multiple open-source oriented companies.

bananskalhalk 2 years ago

Looks cool, but I am unsure why I would use this instead of git scalar[0] with git submodule[1]?

[0]: https://git-scm.com/docs/scalar

[1]: https://git-scm.com/docs/gitsubmodules

  • vlad_ivanov 2 years ago

    We will add a FAQ entry about scalar and we have one about submodules. But in short, here's why you might want to use this instead of the existing solutions:

    * sub-repos -- projections as we call them -- are still a part of the one big history. But the history is filtered on your end and you only see relevant commits. You don't need to manually bump the version of projections * you could also get "one big history" behaviour with a traditional monorepo, but with projections you get benefits like fine-grained ACL

    • dayjaby 2 years ago

      Why invent a new word like "projection" though? Literally everyone would have understood "subrepo" just as fine.

      How does your dependency management integrate into workflows? Last month I built a monorepo with all our repositories. For workflows it was essential that if a subrepo changed, not just this subrepo but also all its dependants get rebuilt.

      I'm joining the waiting list to check for this :)

      • givel 2 years ago

        Regarding the word "projection", the thing is that you sync in multiple "sub"-repositories to the metarepo, but you can then recombine them dynamically from this repository. It's a projection as in it's a view, a slice of the metarepo that takes selected bits and combines them into an ad-hoc repository.

        The metarepo contains a description of the relationship between those components (who contains whom), such that when you push to one of the contained, depended-on repositories, all the views that include it and as such depend on it get rebuilt.

kissgyorgy 2 years ago

You lost me at "enterprise-grade".

sgammon 2 years ago

Hey Metahead. I wonder if you guys would be down to collaborate? We have a project that might plug in nicely. Let me know: sam@less.build

Or, feel free to drop a GitHub link?

da39a3ee 2 years ago

Sounds really interesting. I read the whitepaper; it was nice, but it's more like a technically-oriented setting-the-scene than a whitepaper.

opentokix 2 years ago

What the f is "Enterprise grade"?

  • vosper 2 years ago

    There's no published pricing, just "contact sales", if you want SSO.

    /s

iFire 2 years ago

MIT License

https://github.com/josh-project/josh/blob/master/LICENSE

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection