Settings

Theme

Working pipe operator today in pure JavaScript

github.com

261 points by urvader 10 months ago · 108 comments

Reader

Ciantic 10 months ago

First example doesn't work though:

    const greeting = pipe('hello')
       | upper
       | ex('!!!')

    await greeting.run() // → "HELLO!!!"
If you look at the tests file, it needs to be written like this to make it work:

    let greeting;
    (greeting = pipe('hello')) | upper | ex('!!!');
    await greeting.run();
Which is not anymore as ergonomic.
  • md224 10 months ago

    I suspect this was written with an LLM and the author didn't actually verify that the examples in the README worked.

    • dymk 10 months ago

      Recently, I ripped usage examples out of a rust project's README.md, and put them in doc comments. Almost all of them were broken due to small changes over time, and I never remembered to update the readme. `cargo test` runs doc comments like mini integration tests, so now the examples never rot. I wish more languages and tools had this feature.

      It means having to go to the linked docs (which are automatically pushed to the repo's github pages) to see examples, but I think this is a reasonable tradeoff.

    • urvaderOP 10 months ago

      I wrote this with an LLM but manually changed the README. Thanks for pointing this out, it is now updated.

  • nticompass 10 months ago

    I was playing with it, and you can do this, which looks a little better.

        const greeting = pipe('hello');
        greeting | upper | ex('!!!');
        await greeting.run(); // → "HELLO!!!"
    
    Since it uses the "Symbol.toPrimitive" method, you can use any operator (not just "bitwise OR" (|)).

        const greeting = pipe('hello');
        greeting / upper * ex('!!!');
        await greeting.run(); // → "HELLO!!!"
    • hinkley 10 months ago

      That’s not better because it implies these are all destructive function calls.

      Mutating your inputs is not functional programming. And pipes are effectively compact list comprehensions. Comprehensions without FP is Frankensteinian.

    • urvaderOP 10 months ago

      Thanks for pointing this out, I updated the examples now to this syntax.

  • byteknight 10 months ago

    Seems similar to the problem encountered when making the stupid idea PyNQ:

    https://github.com/IAmStoxe/PyNQ

  • hinkley 10 months ago

    That is a big enough DX problem that I would veto using this on a project.

    You’ve implied what I’ll state clearly:

    Pipes are for composing transformations, one per line, so that reading comprehension doesn’t nosedive too fast with accumulation of subsequent operations.

    Chaining on the same line is shit for readying and worst for git merges and PR reviews.

pavlov 10 months ago

Further proof that JavaScript accidentally became the new C++.

“Aren’t you surprised that this syntax works?” is not praise for a language design.

  • jonny_eh 10 months ago

    > “Aren’t you surprised that this syntax works?” is not praise for a language design.

    It's a clever hack. This is Hacker News. Let's try to appreciate clever hacks while here.

  • cluckindan 10 months ago

    It is not a surprise that overriding the implementation of an operator’s type coercion works and overrides the behavior of the operator’s type coercion.

    • pavlov 10 months ago

      Do you really think that most JavaScript users are aware that “overriding the implementation of an operator’s type coercion” is a language feature?

      Sure, you can claim that everyone should know this obscure feature when they don’t. But that’s how this language enters C++ territory.

      • catapart 10 months ago

        I actually don't think you are wrong, but I'm not backing that up with any actual data.

        I happened to know it because of how the hyperHTML micro-library works; the author went into great detail about it and a ton of other topics. But my gut would say that the average js dev doesn't know about it.

        But then... it's useful for creating component frameworks which... most js devs use. Which doesn't mean they know how they work under the hood. But... a lot of devs I've met specifically choose a framework because of how it works under the hood.

        ... so... I really have no idea how many people know this. I'm still betting it's less than average.

      • cluckindan 10 months ago

        Well, Proxy objects do allow you to override the behavior of any property, including Symbol properties. Symbol.iterator is pretty widely used to create custom iterable objects, so I would expect curious devs to have taken a look at what else can be done through the use of Symbol properties.

  • rco8786 10 months ago

    Is there a language that can’t be contorted in surprising ways that I’m unaware of?

  • ricardobeat 10 months ago

    Nothing new. This was 15 years ago:

    https://github.com/tbtlr/def.js

  • overgard 10 months ago

    No way dude, this does a disservice to the insanity that is C++'s syntax. Wake me up when you have 6 different initialization syntaxes or fun things like 4[array]

  • asah 10 months ago

    Agreed!!!!

    Serious q: but how does this sentiment change with LLMs? They can pickup new syntax pretty fast, then use fewer tokens...

    • Cthulhu_ 10 months ago

      It sounds like using less tokens (or, less output due to a more compact syntax) is like a micro-optimization; code should be written for readability, not for compactness. That said, there are some really compact programming languages out there if this is what you need to optimize for.

    • fph 10 months ago

      I imagine the error messages must be terrible to read, since this hack is based on reusing syntax that was meant for something entirely different.

    • miningape 10 months ago

      IMO it's more likely to get confused because there are less unique tokens to differentiate between syntax (e.x. pipe when we want bitwise-or or vice-versa)

    • pavlov 10 months ago

      I’ve heard it said before on HN that this is not true in general because more tokens in familiar patterns helps the model understand what it’s doing (vs. very terse and novel syntax).

      Otherwise LLMs would excel at writing APL and similar languages, but seems like that’s not the case.

      • throwawaymaths 10 months ago

        probably because there arent enough apl examples to imbue the rare weird apl tokens with sufficient semantic meaning to be useful.

sethcalebweeks 10 months ago

I love the idea! The creativity of (ab)using JavaScript type coersion is really neat. I did something similar using proxies to create a chainable API.

https://dev.to/sethcalebweeks/fluent-api-for-piping-standalo...

  const shuffle = (arr) => arr.sort(() => Math.random() - 0.5);
  const zipWith = (a, b, fn) => a.slice(0, Math.min(a.length, b.length)).map((x, i) => fn(x, b[i]));
  const log = (arr) => {
    console.log(arr);
    return arr;
  };

  const chain = chainWith({shuffle, zipWith, log});

  chain([1, 2, 3, 4, 5, 6, 7, 8, 9])
    .map((i) => i + 10)
    .log() // [ 11, 12, 13, 14, 15, 16, 17, 18, 19 ]
    .shuffle()
    .log() // e.g. [ 16, 15, 11, 19, 12, 13, 18, 14, 17 ]
    .zipWith(["a", "b", "c", "d", "e"], (a, b) => a + b)
    .log() // e.g. [ '16a', '15b', '11c', '19d', '12e' ]
    [0]; // e.g. '16a'
  • gregabbott 10 months ago

    In another comment, I mentioned a vanilla JavaScript function I published in 2024 called Chute. https://github.com/gregabbott/chute

    In a similar way to the featured project, Chute also uses proxies to work like a pipeline operator. But like in your reply, Chute uses a dot-notation style to chain and send data through a mix of functions and methods.

    You might like to see how Chute uses proxies, as it requires no `chainWith` or similar setup step before use. Without setup, Chute can send data through global or local, top-level or nested, native or custom, unary, curried or non-unary functions and methods. It gives non-unary functions the current data at a specific argument position by using a custom-nameable placeholder variable.

    The Chute page describes some more of its features: https://gregabbott.pages.dev/chute/

koito17 10 months ago

Since this library leverages Symbol.toPrimitive, you may also use operators besides bitwise-OR. Additionally, the library does not seem to dispatch on the `hint` parameter[0]. Now I want to open a JS REPL, try placing this library's pipe object into string template literals, and see what happens.

Overall, cool library.

[0] https://tc39.es/ecma262/multipage/abstract-operations.html#s...

  • bryanrasmussen 10 months ago

    what are your ideas regarding the pipe object in string template literals? I'm just looking for an overview to see if it sparks some ideas.

gregabbott 10 months ago

In case it might interest anyone, I wrote a similar vanilla JS function last year called Chute. Chute chains methods and function calls using dot-notation.

https://github.com/gregabbott/chute

MathMonkeyMan 10 months ago

Neat, but I think that functions already do what we need.

For one thing, the example isn't the most compelling, because you can:

    const greeting = 'hello'.toUpperCase() + '!!!';
or

    const greeting = 'HELLO!!!';
That said, there is already:

    function thrush(initial, ...funcs) {
        return funcs.reduce(
            (current, func) => func(current),
            initial);
    }

    const greeting = thrush('hello', s => s.toUpperCase(), s => s + '!!!');
  • nonethewiser 10 months ago

    Are any of the cases compelling? Thinking of the actual proposal. It creates some new magic with |> and % just for syntactic sugar.

    • accrual 10 months ago

      I am all for clean syntax but I feel like JS has already reached a nice middle ground between expressiveness (especially w/ map/reduce/filter) and readability. I'd personally rather not have another syntax that everyone will have to learn unless we're already moving to a new language.

      • IshKebab 10 months ago

        I think JS's map/reduce/filter design is one of the worst ones out there actually - map has footguns with its extra arguments and everything gets converted to an array at the drop of a hat. Still, pipeline syntax probably won't help fix any of that.

        • thdhhghgbhy 10 months ago

          I always thought JS map filter reduce felt quite nice, especially playing around with data in the REPL. Java maps with all the conversions back and forth to streams are clumsy.

          • Timwi 10 months ago

            Well in JS you have to convert to arrays instead. You can't do `document.querySelectorAll(...).map(...)`.

            • thdhhghgbhy 10 months ago

              That's the DOM API, it's not part of the language! They had reasons for querySelectorAll not returning an array.

        • eyelidlessness 10 months ago

          > everything gets converted to an array at the drop of a hat

          Can you name an example? IME the opposite is a more common complaint: needing to explicitly convert values to arrays from many common APIs which return eg iterables/iterators.

          • IshKebab 10 months ago

            `map` returns an array and can only be called on an array.

            • eyelidlessness 10 months ago

              Right, but I’m not clear on what gets converted to an array. Do you mean more or less what I said in my previous comment? That it requires you (your code, or calling code in general) to perform that conversion excessively?

              • recursive 10 months ago

                People write a lot of stuff like [...iterable].map(fn). They do it so much it's as if they do it each time a hat drops.

                • eyelidlessness 10 months ago

                  Thank you for clarifying. (I think?)

                  I think what confused me is the passive language: "everything gets converted" sounds (to me) like the runtime or some aspect of language semantics is converting everything, rather than developers. Whereas this is the same complaint I mentioned.

              • Timwi 10 months ago

                One gripe I have is that the result of map/filter is always an array. As a result, doing `foo.map(...).filter(...).slice(0, 3)` will run the map and the filter on the entire array even if it has hundreds of entries and I only need the first 10 to find the 3 that match the filter.

      • nonethewiser 10 months ago

        I agree but to steelman it, what about custom functions? I think just doing it naively is perfectly fine. Or if you want use some pipe utility. Or wrap the array, string, etc. with your own custom methods.

  • rco8786 10 months ago

    Whatever that thrush thing is feels 10x more gross than the pipe

bonquesha99 10 months ago

If you're interested in the Ruby language too, check out this PoC gem for an "operator-less" syntax for pipe operations using regular blocks/expressions like every other Ruby DSL.

https://github.com/lendinghome/pipe_operator#-pipe_operator

  "https://api.github.com/repos/ruby/ruby".pipe do
    URI.parse
    Net::HTTP.get
    JSON.parse.fetch("stargazers_count")
    yield_self { |n| "Ruby has #{n} stars" }
    Kernel.puts
  end
  #=> Ruby has 15120 stars

  [9, 64].map(&Math.pipe.sqrt)           #=> [3.0, 8.0]
  [9, 64].map(&Math.pipe.sqrt.to_i.to_s) #=> ["3", "8"]
  • dominicrose 10 months ago

    It's an interesting experiment but standard Ruby is expressive enough.

    [9, 64].map { Math.sqrt(_1) } #=> [3.0, 8.0]

    For the first example I would just define a method that uses local variables. They're local so it's not polluting context.

tinyspacewizard 10 months ago

Sad that the pipe operator proposal seems to have stalled.

The F# version of the proposal was probably the simplest choice.

whizzter 10 months ago

This kind of stuff is why C++ developers has an almost overly allergic reaction to operator overloading.

  • jagged-chisel 10 months ago

    C++ is the reason people have that reaction. The quintessential example in introductory texts for operator overloading is using bit-shift operators to output text. I mean, come on - if that’s your example, don’t complain when people follow suit and get it wrong.

    • whizzter 10 months ago

      C++ has std::format these days that does a far more sane thing, people are too quick to throw out the baby with the bathwater when it comes to bad things.

      Some OO is fine, just don't make your architecture or language entirely dependent on it. Same with operator overloading.

      When it comes to math heavy workloads, you really want a language that supports operator overloading (or have a language full of heavy vector primitives), doing it all without just becomes painful for other reasons.

      Yes, the early C++ _STDLIB_ was shit early on due to boneheaded architectural and syntactic decisions (and memory safety issues is another whole chapter), but that doesn't take away that the language is a damn powerful and useful one.

      • zamadatix 10 months ago

        std::format in C++20 is just for the string manipulation half but you still left shift cout by the resulting string to output text in canonical C++.

        C++23 introduced std::print(), which is more or less the modernized printf() C++ probably should have started with and also includes the functionality of std::format(). Unfortunately, it'll be another 10 years before I can actually use it outside of home projects... but at least it's there now!

    • 1718627440 10 months ago

      While that operator is also used for bit-shift, it is not the bit-shift operator. It's not that the bit-shift operator is used for stream direction, it's that the same operator is used for both stream direction and bit-shifts. And which code is operating on both high-level abstract streams and bit-shifts at the same time.

  • cluckindan 10 months ago

    This isn’t overloading the operator, it is replacing the implementation of type coercion when | is used with pipe() or asPipe() objects.

    | itself still works exactly as before.

    • whizzter 10 months ago

      Oh wait, looked at the source again, so it's some weird stateful collection thing triggered by the type coercion? By now I'm wishing that it was operator overloading.

      • cluckindan 10 months ago

        Imagine the possibilities for control flow obfuscation when this trick is used with parentheses wrapping a part of the pipeline. :-)

goobert 10 months ago

Nice! I love it when a language introduces new syntax for things that weren't remotely difficult in the first place!

jappgar 10 months ago

is this solving a problem people actually have?

other libraries like rxjs use .pipe(f,g,h) which works just fine.

  • whizzter 10 months ago

    Fully agreed, var-arg functions are well established in JS so no need to abuse operators for these kinds of things.

fergie 10 months ago

Pipes are great in environments where "everything is a string" (bash, etc), but do we really need them in javascript? I have yet to see a compelling example.

  • tinyspacewizard 10 months ago

    Pipes are great where you want to chain several operations together. Piping is very common in statically typed functional langauges, where there are lots of different types in play.

    Sequences are a common example.

    So this:

        xs.map(x => x * 2).filter(x => x > 4).sorted().take(5)
    
    In pipes this might look like:

        xs |> map(x => x * 2) |> filter(x => x > 4) |> sorted() |> take(5)
    
    In functional languages (of the ML variety), convention is to put each operation on its own line:

        xs 
        |> map(x => x * 2) 
        |> filter(x => x > 4) 
        |> sorted() 
        |> take(5)
    
    Note this makes for really nice diffs with the standard Git diff tool!

    But why is this better?

    Well, suppose the operation you want is not implemented as a method on `xs`. For a long time JavaScript did not offer `flatMap` on arrays.

    You'll need to add it somehow, such as on the prototype (nasty) or by wrapping `xs` in another type (overhead, verbose).

    With the pipe operator, each operation is just a plain-ol function.

    This:

        xs |> f
    
    Is syntactic sugar for:

        f(xs)
    
    This allows us to "extend" `xs` in a manner that can be compiled with zero run-time overhead.
    • discomrobertul8 10 months ago

      if the language or std lib already allows for chaining then pipes aren't as attractive. They're a much nicer alternative when the other answer is nested function calls.

      e.g.

      So this:

          take(sorted(filter(map(xs, x => x \* 2), x => x > 4)), 5)
      
      To your example:

          xs |> map(x => x \* 2) |> filter(x => x > 4) |> sorted() |> take(5)
      
      is a marked improvement to me. Much easier to read the order of operations and which args belong to which call.
    • nonethewiser 10 months ago

      First of all, with the actual proposal, wouldnt it actually be like this? with the %.

          xs
            |> map(%, x => x * 2)
            |> filter(%, x => x > 4)
            |> sorted(%)
            |> take(%, 5);
      
      Anything that can currently just chain functions seems like a terrible example because this is perfectly fine:

          xs.map(x => x * 2)
              .filter(x => x > 4)
              .sorted()
              .take(5)
      
      Not just fine but much better. No new operators required and less verbose. Just strictly better. This ignores the fact that sorted and take are not actually array methods, but there are equivalent.

      But besides that, I think the better steelman would use methods that dont already exist on the prototype. You can still make it work by adding it to the prototype but... meh. Not that I even liket he proposal in that case.

      • tinyspacewizard 10 months ago

        There is more than one proposal; the F#-style one doesn't have the (weird) placeholder syntax.

        > You can still make it work by adding it to the prototype

        This is exactly what we want to avoid!

        • nonethewiser 10 months ago

          wrap the object?

          Why would you want to avoid that? It's controversial syntactic sugar. Enforcing a convention locally seems ideal.

          • tinyspacewizard 10 months ago

            1. Wrapping is more code than using a built-in pipe operator

            2. There is a run-time overhead to wrapping

            IMO a design goal of programming langauges should be for the most readable code to also be the most performant.

            Language features tend to be controversial until they are mainstream.

keepamovin 10 months ago

Damn, that’s really clever. I love seeing these expressive explorations of JavaScript syntax.

flanked-evergl 10 months ago

It would be nice to have well-maintained fluent/pipe/streaming API solution for Python.

aprilnya 10 months ago

This is just different syntax for nesting function calls (i.e. c(b(a(value))) becomes value | a | b | c), right? Definitely would make code more readable if this was just something in JS or a compiler where it’s the same as normally calling functions.

xixixao 10 months ago

Won’t work in TS.

I would actually love extension of TS with operator overloading for vector maths (games, other linear algebra, ML use cases). I wouldn’t want libraries to rely on it, but in my own application code, it can sometimes be really helpful.

sproutini 10 months ago

Overengineered in my view, what is wrong with `x | f` is `f(x)`? Then `x | f | g` can be read as `g(f(x))` and you're done. I don't see any reason to make it more complicated than that.

reverseblade2 10 months ago

Alternatively just use F# and Fable

mlajtos 10 months ago

Pipe "operator" for the rest of us:

    Object.prototype.pipe = function(fn) { return fn(this) }

    'hello'.pipe(upper).pipe(ex('!!!'))
Or code golf version:

    Object.prototype.P=function(...F){return F.reduce((v,f)=>f(v),this)}
    'hello'.P(upper,ex('!!!'))
tacone 10 months ago

I know that it's wrong but I love it.

I am wondering if it could be useful for libraries:

    grid.columns.name.format(v => v | trim | truncate | bold)
    form.fields.name.validate(v => v | trim | required | email)
nymalt 10 months ago

That's clever! But I still want JS to get the actual pipeline operator.

taylorallred 10 months ago

Piping syntax is nice for reading, but it's hard to debug. There's no clear way to "step through" each stage of the pipe to see the intermediate results.

urvaderOP 10 months ago

I'm not sure this is at all a good idea but thanks to the great discussion here at Hacker News - it is now up on npm:

npm i aspipes

keepamovin 10 months ago

Damn, that’s really clever. I love seeing these expressive explorations of JavaScript syntax.

bitwize 10 months ago

It's simultaneously a miracle and deeply wrong that this worked.

don_searchcraft 10 months ago

These TC39 proposals take way too long to get approved and implemented.

rco8786 10 months ago

Very clever. Love seeing stuff like this that pushes the bounds

juliend2 10 months ago

This cargo seem to give magical superpowers.

pwdisswordfishy 10 months ago

    new Proxy(function(){}, {
      get(_, prop) {
        if (prop === Symbol.toPrimitive)
          return () => ...
As opposed to, you know, just defining a method. Proxy has apparently become the new adding custom methods to built-in prototypes.
user____name 10 months ago

Is this intended for code golf or something? This buys you literally nothing and just makes the language needlessly cryptic.

bckr 10 months ago

Very appealing.

stephenlf 10 months ago

Cool work!

ilaksh 10 months ago

See also https://livescript.net/

c249709 10 months ago

this is sick

adamddev1 10 months ago

Now we just need 'do notation' for monads! :-)

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection