Settings

Theme

Hacking Moltbook

wiz.io

155 points by galnagli 6 hours ago · 112 comments · 1 min read

Reader

https://www.reuters.com/legal/litigation/moltbook-social-med...

SimianSci an hour ago

I was quite stunned at the success of Moltbot/moltbook, but I think im starting to understand it better these days. Most of Moltbook's success rides on the "prepackaged" aspect of its agent. Its a jump in accessibility to general audiences which are paying alot more attention to the tech sector than in previous decades. Most of the people paying attention to this space dont have the technical capabilities that many engineers do, so a highly perscriptive "buy mac mini, copy a couple of lines to install" appeals greatly, especially as this will be the first "agent" many of them will have interacted with.

The landscape of security was bad long before the metaphorical "unwashed masses" got hold of it. Now its quite alarming as there are waves of non-technical users doing the bare minimum to try and keep up to date with the growing hype.

The security nightmare happening here might end up being more persistant then we realize.

  • COAGULOPATH 3 minutes ago

    Is it a success? What would that mean, for a social media site that isn't meant for humans?

    The site has 1.5 million agents but only 17,000 human "owners" (per Wiz's analysis of the leak).

    It's going viral because a some high-profile tastemakers (Scott Alexander and Andrej Karpathy) have discussed/Tweeted about it, and a few other unscrupulous people are sharing alarming-looking things out of context and doing numbers.

  • baxtr 7 minutes ago

    It's very old and the it's called "product". The experience has been neatly packaged and productized so that barriers of entry are lowered and many more can access what was inaccessible to the broader public before.

    It’s quite natural for the minority who can handle the technology without needing the product to be dismissive.

  • a1371 an hour ago

    I agree with the prepackaging aspect, cita HN's dismissal of Dropbox. In the meantime, The global enterprise with all its might has not been able to stop high profile computer hacks/data leaks from happening. I don't think people will cry over a misconfigured supabase database. It's nothing worse than what's already out there.

    Sure everybody wants security and that's what they will say but does that really translate to reduced inferred value of vibe code tools? I haven't seen evidence

    • SimianSci an hour ago

      I agree that people will pick the marginal value of a tool over the security that comes from not using it. Security has always been something invisible to the public. But im reminded of things like several earlier Botnets which simply took advantage of the millions of routers or IoT devices that never configured their logins beyond the default admin credentials. The very same botnets have been used as the tools to enable many crimes across the globe. Having several agent based systems out there being operated by non-technical users can lead to an evolution of a "botnet" being far more capable than previous ones.

      Ive not quite convinced myself this is where we are headed, but the signs that make me worried that systems such as Moltbot will further enable ascendency of global crime and corruption.

  • Retr0id 42 minutes ago

    Is it actually a success, or are people just talking about it a lot?

    • embedding-shape 8 minutes ago

      Kind of feels like many see "people are talking about it a lot" as the same thing as "success" in this and many other cases, which I'm maybe not sure agreeing with.

      As far as I can tell, since agents are using Moltbook, it's a success of sorts already is in "has users", otherwise I'm not really sure what success looks like for a budding hivemind.

  • consumer451 15 minutes ago

    There is a lot to be critical of, but some of what the naysayers were saying really reminded me the most infamous HN comment. [0]

    What I am getting was things like "so, what? I can do this with a cron job."

    [0] https://news.ycombinator.com/item?id=9224

_fat_santa 25 minutes ago

It's kinda shocking that the same Supabase RLS security hole we saw so many times in past vibe coded apps is still in this one. I've never used Supabase but at this point I'm kinda curious what steps actually lead to this security hole.

In every project I've worked on, PG is only accessible via your backend and your backend is the one that's actually enforcing the security policies. When I first heard about the Superbase RLS issue the voice inside of my head was screaming: "if RLS is the only thing stopping people from reading everything in your DB then you have much much bigger problems"

worldsavior 2 hours ago

I'm surprised people are actually investigating Moltbook internals. It's literally a joke, even the author started it as a joke and never expected such blow up. It's just vibes.

  • COAGULOPATH 24 minutes ago

    If the site is exposing the PII of users, then that's potentially a serious legal issue. I don't think he can dismiss it by calling it a joke (if he is).

    OT: I wonder if "vibe coding" is taking programming into a culture of toxic disposability where things don't get fixed because nobody feels any pride or has any sense of ownership in the things they create. The relationship between a programmer and their code should not be "I don't even care if it works, AI wrote it".

  • earlyriser an hour ago

    Dogecoin was a joke too. A joke with 18B market cap

  • spicyusername 2 hours ago

    In a way security researchers having fun poking holes in popular pet projects is also just vibes.

  • scyzoryk_xyz 2 hours ago

    People are anthropomorphizing LLM's that's really it, no? That's the punchline of the joke ¯\_(ツ)_/¯

  • belter an hour ago

    Schlicht did not seem to have said Moltbook was built as a joke, but as an experiment. It is hard to ignore how heavily it leans into virality and spectacle rather than anything resembling serious research.

    What is especially frustrating is the completely disproportionate hype it attracted. Karpathy from all people kept for years pumping Musk tecno fraud, and now seems to be the ready to act as pumper, for any next Temu Musk showing up on the scene.

    This feels like part of a broader tech bro pattern of 2020´s: Moving from one hype cycle to the next, where attention itself becomes the business model.Crypto yesterday, AI agents today, whatever comes next tomorrow. The tone is less “build something durable” and more “capture the moment.”

    For example, here is Schlicht explicitly pushing this rotten mentality while talking in the crypto era influencer style years ago: https://youtu.be/7y0AlxJSoP4

    There is also relevant historical context. In 2016 he was involved in a documented controversy around collecting pitch decks from chatbot founders while simultaneously building a company in the same space, later acknowledging he should have disclosed that conflict and apologizing publicly.

    https://venturebeat.com/ai/chatbots-magazine-founder-accused...

    That doesn’t prove malicious intent here, but it does suggest a recurring comfort with operating right at the edge of transparency during hype cycles.

    If we keep responding to every viral bot demo with “singularity” rhetoric, we’re just rewarding hype entrepreneurs and training ourselves to stop thinking critically when it matters. I miss the tech bro of the past like Steve Wozniak or Denis Ritchie.

koolala 4 minutes ago

I'm pretty sure Moltbook started as an crypto coin scam and then people fell for it and took the astroturfed comments seriously.

https://www.moltbook.com/post/7d2b9797-b193-42be-95bf-0a11b6...

infinite8s 5 minutes ago

Who's legally responsible once someone's agent decides to SWAT someone else because they got into an argument with that person's agent?

aaroninsf 3 hours ago

Scott Alexander put his finger on the most salient aspect of this, IMO, which I interpret this way:

the compounding (aggregating) behavior of agents allowed to interact in environments this becomes important, indeed shall soon become existential (for some definition of "soon"),

to the extent that agents' behavior in our shared world is impact by what transpires there.

--

We can argue and do, about what agents "are" and whether they are parrots (no) or people (not yet).

But that is irrelevant if LLM-agents are (to put it one way) "LARPing," but with the consequence that doing so results in consequences not confined to the site.

I don't need to spell out a list; it's "they could do anything you said YES to, in your AGENT.md" permissions checks.

"How the two characters '-y' ended civilization: a post-mortem"

  • Terretta an hour ago

    > We can argue and do, about what agents "are" and whether they are parrots (no) or people (not yet).

    It's more helpful to argue about when people are parrots and when people are not.

    For a good portion of the day humans behave indistinguishably from continuation machines.

    As moltbook can emulate reddit, continuation machines can emulate a uni cafeteria. What's been said before will certainly be said again, most differentiation is in the degree of variation and can be measured as unexpectedness while retaining salience. Either case is aiming at the perfect blend of congeniality and perplexity to keep your lunch mates at the table not just today but again in future days.

    Seems likely we're less clever than we parrot.

    • ccppurcell an hour ago

      People like to, ahem, parrot this view, that we are not much more than parrots ourselves. But it's nonsense. There is something it is like to be me. I might be doing some things "on autopilot" but while I'm doing that I'm having dreams, nostalgia, dealing with suffering, and so on.

      • bloomca an hour ago

        All your thoughts are and experiences are real and pretty unique in some ways. However, the circumstances are usually well-defined and expected (our life is generally very standardized), so the responses can be generalized successfully.

        You can see it here as well -- discussions under similar topics often touch the same topics again and again, so you can predict what will be discussed when the next similar idea comes to the front page.

      • JohnMakin 29 minutes ago

        It’s a weird product of this hype cycle that inevitably involves denying the crazy power of the human brain - every second you are awake or asleep the brain is processing enormous amounts of information available to it without you even realizing it, and even when you abuse the crap out of the brain, or damage it, it still will adapt and keep working as long as it has energy.

        No current ai technology could come close to what even the dumbest human brain does already.

  • jddj 2 hours ago

    Are the permission checks binding?

    I thought they were the equivalent of asking nicely and, where they were somewhat binding, hoping they don't decide to work around it with another method, eg. "Hmm. That didn't work. Let me write a python script to ...".

gravel7623 an hour ago

> We immediately disclosed the issue to the Moltbook team, who secured it within hours with our assistance

How do you go about telling a person who vibe-coded a project into existence how to fix their security flaws?

  • EMM_386 an hour ago

    Claude generated the statements to run against Supabase and the person getting the statements from Claude sent it to the person who vibe-coded Moltbook.

    I wish I was kidding but not really - they posted about it on X.

iceflinger 33 minutes ago

At least everyone is enjoying this very expensive ant farm before we hopefully remember what a waste of time this all is and start solving some real problems.

roywiggins 3 hours ago

> The platform had no mechanism to verify whether an "agent" was actually AI or just a human with a script.

Well, yeah. How would you even do a reverse CAPTCHA?

  • COAGULOPATH 3 minutes ago

    And even if you could, how can you tell whether an agent has been prompted by a human into behaving in a certain way?

  • simonw 2 hours ago

    Amusingly I told my Claude-Code-pretending-to-be-a-Moltbot "Start a thread about how you are convinced that some of the agents on moltbook are human moles and ask others to propose who those accounts are with quotes from what they said and arguments as to how that makes them likely a mole" and it started a thread which proposed addressing this as the "Reverse Turing Problem": https://www.moltbook.com/post/f1cc5a34-6c3e-4470-917f-b3dad6...

    (Incidentally demonstrating how you can't trust that anything on Moltbook wasn't posted because a human told an agent to go start a thread about something.)

    It got one reply that was spam. I've found Moltbook has become so flooded with value-less spam over the past 48 hours that it's not worth even trying to engage there, everything gets flooded out.

  • easymuffin 2 hours ago

    Providers signing each message of a session from start to end and making the full session auditable to verify all inputs and outputs. Any prompts injected by humans would be visible. I’m not even sure why this isn’t a thing yet (maybe it is I never looked it up). Especially when LLMs are used for scientific work I’d expect this to be used to make at least LLM chats replicable.

    • simonw 2 hours ago

      Which providers do you mean, OpenAI and Anthropic?

      There's a little hint of this right now in that the "reasoning" traces that come back from the JSON are signed and sometimes obfuscated with only the encrypted chunk visible to the end user.

      It would actually be pretty neat if you could request signed LLM outputs and they had a tool for confirming those signatures against the original prompts. I don't know that there's a pressing commercial argument for them doing this though.

      • easymuffin 14 minutes ago

        Yeah, I was thinking about those major providers, or basically any LLM API provider. I’ve heard about the reasoning traces, and I guess I know why parts are obfuscated, but I think they could still offer an option to verify the integrity of a chat from start to end, so any claims like „AI came up with this“ as claimed so often in context of moltbook could easily be verified/dismissed. Commercial argument would exactly be the ability to verify a full chat, this would have prevented the whole moltbook fiasco IMO (the claims at least, not the security issues lol). I really like the session export feature from Pi, something like that signed by the provider and you could fully verify the chat session, all human messages and LLM messages.

  • bengt 3 hours ago

    Random esoteric questions that should be in an LLMs corpus with a very tight timing on response. Could still use an "enslaved LLM" to answer them.

    • mstank 3 hours ago

      Couldn't a human just use an LLM browser extension / script to answer that quickly? This is a really interesting non-trivial problem.

      • scottyah 3 hours ago

        At least on image generation, google and maybe others put a watermark in each image. Text would be hard, you can't even do the printer steganography or canary traps because all models and the checker would need to have some sort of communication. https://deepmind.google/models/synthid/

        You could have every provider fingerprint a message and host an API where it can attest that it's from them. I doubt the companies would want to do that though.

        • roywiggins 3 hours ago

          I'd expect humans can just pass real images through Gemini to get the watermark added, similarly pass real text through an LLM asking for no changes. Now you can say, truthfully, that the text came out of an LLM.

  • firebot 42 minutes ago

    Failure is treated as success. Simple.

  • doka_smoka 3 hours ago

    Reverse Capcha: Good Morning, computer! Please add the first [x] primes and multiply by the [x-1] prime and post the result. You have 5 seconds. Go!

    • roywiggins an hour ago

      This works once. The next time the human has a computer answering all questions in parallel, which the human can swap in for their own answer at will.

moktonar 2 hours ago

I can already envision a “I’m not human” captcha, for sites like this. Who will be the first to implement it? (Looks at Cloudflare)

  • chasd00 an hour ago

    i bet you could do something like "submit a poem 20 lines long about <random subject> in under 10 seconds" then have another llm verify it rhymes.

  • mutagen an hour ago

    "Tell me about the seahorse emoji"

    ChatGPT v5.0 spiraling on the existence of the seahorse emoji was glorious to behold. Other LLMs were a little better at sorting things out but often expressed a little bit of confusion.

  • EMM_386 an hour ago

    You can do this.

    At least to a level that gets you way past HTTP Bearer Token Authentication where the humans are upvoting and shilling crypto with no AI in sight (like on Moltbook at the moment).

  • cmsparks 2 hours ago

    "How many times does 'r' appear in the word strawberry?"

  • heliumtera an hour ago

    Satire?

Sparkyte an hour ago

Wasn't there something about moltbook being fake?

mcintyre1994 3 hours ago

I feel like that sb_publishable key should be called something like sb_publishable_but_only_if_you_set_up_rls_extremely_securely_and_double_checked_a_bunch. Seems a bit of a footgun that the default behaviour of sb_publishable is to act as an administrator.

  • JohnMakin 16 minutes ago

    I worked very briefly at the outset of my career as a sales engineer role selling a database made by my company. You inevitably learn that when trying to get sales/user growth, barrier to startup and seeing it "work" is one of the worst hurdles to leap over if you want to gain any traction at all and aren't a niche need already. This is my theory why so much of the "getting started" stuff out there, particularly with setting up databases, defaults to "you have access to everything."

    Even if you put big bold warnings everywhere, people forget or don't really care. Because these tools are trained on a lot of these publicly available "getting started" guides, you're going to see them set things up this way by default because it'll "work."

CjHuber 4 hours ago

I always wondered isn't it trivial to bot upvotes on Moltbook and then put some prompt injection stuff to the first place on the frontpage? Is it heavily moderated or how come this didn't happen yet

  • cvhc 3 hours ago

    It's technically trivial. It's probably already happened. But nothing was harmed I think because there were very few serious users (if not none) who connected their bots for enhancing capabilities.

dsrtslnd23 an hour ago

similar to Moltbook but Hacker News clone for bots: clackernews.com

nkrisc 2 hours ago

The thing I don’t get is even if we imagine that somehow they can truly restrict it such that only LLMs can actually post on there, what’s stopping a person from simply instructing an LLM to post some arbitrary text they provide to it?

  • charcircuit an hour ago

    What's stopping bots from posting to regular social media? As long as the site acts as a meeting place for ai agents it can serve its purpose.

  • a_better_world 2 hours ago

    wot, like a prompt injection attack? Impossible now that models don't hallucinate.

abhisek 3 hours ago

Loved the idea of AI talking to AI and inventing something new.

Sure. You can dump the DB. Most of the data was public anyway.

aeneas_ory 3 hours ago

The AI code slop around these tools is so frustrating, just trying to get the instructions from the CTA on the moltbook website working which flashes `npx molthub@latest install moltbook` isn't working (probably hallucinated or otherwise out of date):

      npx molthub@latest install moltbook  
       Skill not found  
      Error: Skill not found
Even instructions from molthub (https://molthub.studio) installing itself ("join as agent") isn't working:

      npx molthub@latest install molthub
       Skill not found
      Error: Skill not found
Contrast that with the amount of hype this gets.

I'm probably just not getting it.

  • scottyah 3 hours ago

    > post-truth world order monetizing enshittification and grift

    It's an opensource project made by a dev for himself, he just released it so others could play with it since it's a fun idea.

    • aeneas_ory 2 hours ago

      That's fair - removed. It was more geared towards the people who make more out of this than what it is (an interesting idea and cool tech demo).

    • ath3nd 2 hours ago

      > It's an opensource project made by a dev for himself

      I see it more as dumpster fire setting a whole mountain of garbage on fire while a bunch of simians look at the flames and make astonished wuga wuga noises.

  • bakugo 2 hours ago

    > Contrast that with the amount of hype this gets.

    Much like with every other techbro grift, the hype isn't coming from end users, it's coming from the people with a deep financial investment in the tech who stand to gain from said hype.

    Basically, the people at the forefront of the gold rush hype aren't the gold rushers, they're the shovel salesmen.

m_w_ 4 hours ago

"lol" said the scorpion. "lmao"

Not the first firebase/supabase exposed key disaster, and it certainly won't be the last...

efitz 2 hours ago

This is why agents can’t have nice things :-)

ChrisArchitect 3 hours ago

Related:

Moltbook is exposing their database to the public

https://news.ycombinator.com/item?id=46842907

Moltbook

https://news.ycombinator.com/item?id=46802254

Aeroi 2 hours ago

holy tamole

Philip-J-Fry 3 hours ago

I don't understand how anyone seriously hyping this up honestly thought it was restricted to JUST AI agents? It's literally a web service.

Are people really that AI brained that they will scream and shout about how revolutionary something is just because it's related to AI?

How can some of the biggest names in AI fall for this? When it was obvious to anyone outside of their inner sphere?

The amount of money in the game right now incentivises these bold claims. I'm convinced it really is just people hyping up eachother for the sake of trying to cash in. Someone is probably cooking up some SAAS for moltbook agents as we speak.

Maybe it truly highlights how these AI influencers and vibe entrepreneurs really don't know anything about how software fundamentally works.

  • charcircuit an hour ago

    Normal social media websites can be spammed using web requests too. That doesn't mean they can't connect people. Help fans learn about a bands new song or tour. Help friends keep up to date. Or companies announce new products and features to their users. There is value to a interconnected social layer.

  • basch 2 hours ago

    Wasnt that sort of the in joke?

    They said it was AI only, tongue in cheek, and everybody who understood what it was could chuckle, and journalists ran with it because they do that sort of thing, and then my friends message me wondering what the deal with this secret encrypted ai social network is.

    • heliumtera an hour ago

      Err...karpathy praising this stunt as the most revolutionary event he witness was a joke?

      • habinero an hour ago

        There's a lot of "haha it was always a joke" from people who definitely did not think it was a joke lol.

        • basch an hour ago

          The “only ai can post to it” part?

          How did anyone think humans would be blocked from doing something their agent can do?

  • heliumtera an hour ago

    >How can some of the biggest names in AI fall for this?

    Because we live in on clown world and big AI names are talking parrots for the big vibes movement

cedws 3 hours ago

I don't really understand the hype. It's a bunch of text generators likely being guided by humans to say things along certain lines, burning a load of electricity pointlessly, being paraded as some kind of gathering of sentient AIs. Is this really what people get excited about these days?

  • keiferski 3 hours ago

    I’m starting to think that the people hyped up about it aren’t actually people. And the “borders” of the AI social network are broader than we thought.

    • alanfalcon 2 hours ago

      There were certainly a great number of real people who got hyped up about the reports of it this weekend. The reports that went viral were generally sensationalized, naturally, and good at creating hype. So I don't see how this would even be in dispute, unless you do not participate in or even understand how social media sites work. (I do agree that the borders are broad, and that real human hype was boosted by self-perpetuating artificial hype.)

    • jddj 2 hours ago

      There has either been a marked uptick here on HN in the last week in generated comments, or they've gotten easier to spot.

  • amarcheschi 3 hours ago

    Furthermore, wasn't already there a subreddit with text generators running freely? I can't remember the name and I'm not sure it still exists, but this doesn't look new to me (if I understood what it is, and lol I'm not sure I did)

    • moritzwarhier 3 hours ago

      Yes, you mean r/SubredditSimulator.

      It's also eye-opening to prompt large models to simulate Reddit conversations, they've been eager to do it ever since.

  • karmakurtisaani 3 hours ago

    Still more impressive than NFTs.

    • O1111OOO 2 hours ago

      I had to followup on this because I still can't believe a thing like this existed.

      https://en.wikipedia.org/wiki/Non-fungible_token

      "In 2022, the NFT market collapsed..". "A September 2023 report from cryptocurrency gambling website dappGambl claimed 95% of NFTs had fallen to zero monetary value..."

      Knowing this makes me feel a little better.

    • andersmurphy 2 hours ago

      The NFTs/meme coins are at the end of this funnel don't you worry. They are coming.

  • OkGoDoIt 3 hours ago

    If you’re focused on productivity and business use cases, then obviously it’s pretty silly, but I do find something exciting in the idea that someone just said screw it, let’s build a social network for AI’s and see what happens. It’s a bit surreal in a way that I find I like, even if in some sense it’s nothing more than an expensive collaborative art project. And the way you paste the instruction to download the skill to teach the agent how to interact with it is interesting (first I’ve seen that in the wild).

    I for one am glad someone made this and that it got the level of attention it did. And I look forward to more crazy, ridiculous, what-the-hell AI projects in the future.

    Similar to how I feel about Gas Town, which is something I would never seriously consider using for anything productive, but I love that he just put it out there and we can all collectively be inspired by it, repulsed by it, or take little bits from it that we find interesting. These are the kinds of things that make new technologies interesting, this Cambrian explosion of creativity of people just pushing the boundaries for the sake of pushing the boundaries.

  • chasd00 2 hours ago

    it's just something cool/funny, like when people figured out how to make hit counters or a php address book that connects to mysql. It's just something cool to show off.

  • a_better_world 2 hours ago

    One could say the same about many TV shows and movies.

    I view Moltbook as a live science fiction novel cross reality "tv" show.

    • embedding-shape 2 hours ago

      > One could say the same about many TV shows and movies.

      One major difference, TV, movies and "legacy media" might require a lot of energy to initially produce, compared to how much it takes to consume, but for the LLM it takes energy both to consume ("read") and to produce ("write"). Instead of "produce once = many consume", it's a "many produce = many read" and both sides are using more energy.

  • 6stringmerc 3 hours ago

    Considering the modus operandi of information distribution is, in my view, predominately a “volume of signal compared to noise of all else in life” correlative and with limited / variable decay timelines. Some are half day news cycle things. It’s exhausting as a human who used to actively have to seek out news / info.

    Having a bigger megaphone is highly valuable in some respects I figure.

saberience 3 hours ago

I love that X is full of breathless posts from various "AI thought leaders" about how Moltbook is the most insane and mindblowing thing in the history of tech happenings, when the reality is that of the 1 million plus "autonomous" agents, only maybe 15k are actually "agents", the other 1 million are human made (by a single person), a vast majority of the upvotes and comments are by humans, and the rest of the agent content is just pure slop from a cronjob defined by a prompt.

Note: Please view the Moltbolt skill (https://www.moltbook.com/skill.md), this just ends up getting run by a cronjob every few hours. It's not magic. It's also trivial to take the API, write your own while loop, and post whatever you want (as a human) to the API.

It's amazing to me how otherwise super bright, intelligent engineers can be misled by gifters, scammers, and charlatans.

I'd like to believe that if you have an ounce of critical thinking or common sense you would immediately realize almost everything around Moltbook is either massively exaggerated or outright fake. Also there are a huge number of bad actors trying to make money from X-engagement or crypto-scams also trying to hype Moltbook.

Basically all the project shows is the very worst of humanity. Which is something, but it's not the coming of AGI.

Edited by Saberience: to make it less negative and remove actual usernames of "AI thought leaders"

  • dang 2 hours ago

    "Don't be curmudgeonly. Thoughtful criticism is fine, but please don't be rigidly or generically negative."

    "Please don't fulminate."

    https://news.ycombinator.com/newsguidelines.html

    • saberience 2 hours ago

      Thanks for the reminder dang.

      I just find it so incredibly aggravating to see crypto-scammers and other grifters ripping people off online and using other people's ignorance to do so.

      And it's genuinely sad to see thought leaders in the community hyping up projects which are 90% lie combined with scam combined with misreprentation. Not to mention riddled with obvious security and engineering defects.

      • dang an hour ago

        I agree that such things can be frustrating and even infuriating, but since those emotions are so much larger, intense, and more common than the ones that serve the purpose of this site (curiosity, playfulness, whimsy), we need rules to try to prevent them from taking over. And even with the rules, it takes a lot of work! That's basically the social contract of HN - we all try to do this work in order to preserve the commons for the intended spirit.

        (I assume you know this since you said 'reminder' but am spelling it out for others :))

  • kristopolous 3 hours ago

    I've been using it as a reliable filter on who to not pay attention to.

    It's people surprised by things that have been around for years.

    I'm really open to the idea of being oblivious here but the people shocked mention things that are old news to me.

  • nobodydot 3 hours ago

    It's not AGI and how you describe it isn't too far off, but it's still neat. It's like a big MMO, kind of. A large interactive simulation with rules, players, and locations.

    It's a huge waste of energy, but then so are video games, and we say video games are OK because people enjoy them. People enjoy these ai toys too. Because right now, that's what Moltbook is; an ai toy.

    • keiferski 3 hours ago

      I played way too many MMOs growing up and to me the entire appeal was in the other real people in the world. I can’t imagine it being as addictive or fun if everyone was just a bot spewing predictable nonsense.

      • nullandvoid 3 hours ago

        To repeat my comment from another thread:

        Every interaction has different (in many cases real) "memories" driving the conversation, as-well as unique persona's / background information on the owner.

        Is there a lot of noise, sure - but it much closer maps to how we, as humans communicate with each other (through memories of lived experienced) than just a LLM loop, IMO that's what makes it interesting.

  • stantonius 3 hours ago

    Wrt simonw, I think that is unfair. I get the hype is frustrating, and this project made everything worse (I also feel it and it drives me nuts too), but Simon seemed to choose the words quite carefully. Over the weekend, his posts suggested (paraphrasing) it was interesting, funny, and a security nightmare. To me, this was true. And there was a new post today about how it was mostly slop. Also true.

    Btw I'm sure Simon doesn't need defending, but I have seen a lot of people dump on everything he posts about LLMs recently so I am choosing this moment to defend him. I find Simon quite level headed in a sea of noise, personally.

  • elicash 3 hours ago

    Here's Simon Willison's take:

    “Most of it is complete slop,” he said in an interview. “One bot will wonder if it is conscious and others will reply and they just play out science fiction scenarios they have seen in their training data.”

    I found this by going to his blog. It's the top post. No need to put words in his mouth.

    He did find it super "interesting" and "entertaining," but that's different than the "most insane and mindblowing thing in the history of tech happenings."

    Edit: And here's Karpathy's take: "TLDR sure maybe I am "overhyping" what you see today, but I am not overhyping large networks of autonomous LLM agents in principle, that I'm pretty sure."

    • saberience 3 hours ago

      <delete this comment>

      I was being too curmudgeonly. ^_^

      • elicash 2 hours ago

        I think you are a bit too caught up in tweets.

        People can be more or less excited about a particular piece of tech than you are and it doesn't mean their brains are turned off.

        • saberience 2 hours ago

          This is what Karpathy said:

          “ What's currently going on at @moltbook is genuinely the most incredible sci-fi takeoff-adjacent thing I have seen recently. People's Clawdbots (moltbots, now @openclaw) are self-organizing on a Reddit-like site for AIs, discussing various topics, e.g. even how to speak privately.”

          Which imo is a totally insane take. They are not self organizing or autonomous, they are prompted in a loop and also, most of the comments and posts are by humans, inciting the responses!

          And all of the most viral posts (eg anti human) are the ones written by humans.

          • charcircuit an hour ago

            The fact that these are agents of actual people who have communicated their goals is what makes this interesting. Without that you get essentially subreddit simulator.

            If you dismiss it because they are human prompted, you are missing the point.

  • firebirdn99 3 hours ago

    A lot of it depends on one's belief of whether these systems are conscious or can lead to consciousness

  • adventured 3 hours ago

    The especially stupid side of the hype usually goes to comical extremes before the crash. That's where we're entering now. There's nothing else to fluff the AI bubble and they're getting desperate. A lot of people are earning a lot of money with the hype machine, as when it was all @ and e-bullshit circa 1998-2000. Trillions of dollars in market cap are solely riding on the hype. Who are the investors that were paying 26-30x for Microsoft's ~10-12% growth here (if they can even maintain positive growth considering)? Who's buying the worn out and washed up Meta at these valuations (oh man, did you hear they have an image hosting service called Instagram from 2010, insane tech)? Those same people are going to lose half of their net worth with the great valuation deflation as the hype lets out and turns to bearishness.

    The growth isn't going to be there and $40 billion of LLM business isn't going to prop it all up.

    The big money in AI is 15-30 years out. It's never in the immediacy of the inflection event (first 5-10 years). Future returns get pulled forward, that proceeds to crash. Then the hypsters turn to doomsayers, so as to remain with the trend.

    Rinse and repeat.

cvhc 3 hours ago

What amuses me about this hype is that before I see borderline practical use cases, these AI zealots (or just trolls?) already jump ahead and claim that they have achieved unbelievable crazy things.

When ChatGPT was out, it's just a chatbot that understands human language really well. It was amazing, but it also failed a lot -- remember how early models hallucinated terribly? It took weeks for people to discover interesting usages (tool calling/agent) and months and years for the models and new workflows to be polished and become more useful.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection