Settings

Theme

Submarine cable resilience

blog.apnic.net

161 points by speckx · 73 comments

Reader

13 threads
fennecfoxy

Ever seen a crab wiggle its way down into the sand?

Now that AI + Robotics is taking off, perhaps the industry will get something in the near future that can crawl along the cable and help bury it over time (perhaps mechanically or ultrasonically), down enough that it can't be dug up by the anchors of ships going back and forth in a grid-like pattern...

andrewrn

I work on autonomous submarines that image the seafloor, and let me tell you it is very hard to engineer deep ocean systems. Just operationally, testing things in rolling waves is a brutal job. Arguably at parity with space as an engineering design environment.

  • structural

    I (briefly) worked as a test engineer on a similar kind of contract. To meet the UX requirements for the system we were building, it had to be reliably operable in sea state 7+. The customer wanted touch screen interfaces. I exited that project when they were looking for volunteers to go spend time offshore in the Gulf of Alaska in bad weather, because that was the test environment they could find that met the requirements. Insanity.

    • blobdole

      Shoulda told them to test it on roller coaster with a splash zone. Way easier to get engineers to come to work at Six Flags than brave the briny deep.

  • EuanReid

    I forget who said it, but there's a quote about how _of course_ we know more about space than the bottom of the ocean - in space we only have to deal with one atmosphere.

  • GarnetFloride

    I found that sea, space and automotive are the three most hostile environments, each with very different requirements that made it hard in different ways.

alexpotato

I worked for an L1 blockchain for a couple years and while the term "decentralized" is bandied about a bit too much, reading articles like this does underscore how vulnerable global traffic is.

e.g. some EVM chains have a majority of "stake" in either one country or several adjacent countries (particularly in Asia). A cable cut there, which the article points out has happened, can lead to the blockchain getting cut off or even halting.

  • flakes

    During an internship I worked on optical transport network equipment. Most customers were either submarine or long-haul across land. I was told that many clients would design redundantly, mainly due to people digging up the cables, chopping them in half with a shovel, and being disappointed when there was not much copper to steal.

  • scottyah

    I think people conflate decentralization with redundancy or resilience. IMO it just means you have multiple points of failure instead of one.

    • smallmancontrov

      10 years ago the talk of hackers partitioning the internet to double spend BTC all seemed a bit far fetched. But now crypto has trillions in market cap and governments involved -- governments that sometimes cut network cables just to send a message. The "means" and "motive" exploded by 100x, did anyone find a way to close the "opportunity" or did people just stop talking about it lol?

      • olalonde

        You'd also need to take down fleets of satellites in space. Double-spends aren't really easy to profit from either.

  • hylaride

    I think the issue is that centralization is more economical due to scale, but that assumes all else (geopolitics or other black swan events) don't impact things.

    We saw a similar thing with supply chains and chip suppliers.

  • olalonde

    Not sure about other blockchains but with Bitcoin, you only need one node to connect via satellite and the chain is good. In fact, there are satellites that broadcast blocks from space (no ISP required). [0]

    [0] https://blockstream.com/satellite/

    • ifwinterco

      Also BTC has a very conservative 10 minute block time that protects to some extent against a network partition (there is time to recover)

  • embedding-shape

    > reading articles like this does underscore how vulnerable global traffic is.

    Then also remember that the internet haven't seen a global outage since forever, worst parts have been when some submarine cables break and traffic has to route around it, but never has the entire thing fully went down. Considering how most of it is built with bandaids, silver-tape and WD40, it's surprising it is as resilient as it is.

pchristensen

If you care at all about this, you'll love Neal Stephenson's long article Mother Earth, Motherboard: https://www.wired.com/1996/12/ffglass/

konschubert

Ah, the “unusually unlucky” cables serving Taiwan and in the Baltics.

Like statistically impossibly unlucky.

  • emmelaich

    Yes, I admire the restraint required to not put "unlucky" in quotes.

  • mschuster91

    At least for the Baltics, there is the unique aspect of the infamous "shadow fleet". Utterly derelict ships with barely qualified crews.

    • rasz

      Ordered to swim back and forth with anchor down until they catch something.

jgrahamc

I have been trying, and failing, to buy a cross section of a submarine cable. I'd love one as an art piece for my house.

  • ssl-3

    I think it's like slices of tree trucks to build wall clocks (or whatever) kind of wall art out of: If you know a guy who knows a guy who works with trees, then it's easy to get a rough cut-off slice.

    It may even be free. If they're already there cutting the thing with an appropriate saw, then slicing off one more bit and saving it for Bill's friend jgrahamc isn't a big deal.

    But without that kind of relationship, it's hard.

    (I want one, too.)

  • jgrahamc

    Everyone in the industry I can find including people who do recycling of submarine cables. It seems that cross sections are sometimes given away as gifts as part of a project but are really hard to find.

  • JMiao

    who have you asked?

wrxd

I found https://smc.peering.tw/ fascinating. It shows an up to date status of submarine links to Taiwan and you can see many of them are having outages. Even more interesting is the historical view showing that the system operates in an always partly degraded regime

reincoder

I recently learnt about Transatlantic telegraph cable: https://en.wikipedia.org/wiki/Transatlantic_telegraph_cable

It was laid in 1858. During its brief three-week lifespan, only 732 messages (amounting to roughly 400 total telegrams) were successfully transmitted before the cable died.

hermitcrab

My son's school computing teacher was convinced that these oceanic communication cables float on the surface - to the extent they had a bit argument about it in class. I'm not sure how the teacher thought ships navigated around them.

  • WalterBright

    My history teacher in high school was wrong. He said he was right because the teachers' answer key said X. I replied that X was obviously wrong. He knew he was wrong, because he hid behind what his answer key said.

    We didn't get along.

wuliwong

Underwater cables have been one of the more awe inspiring things for me. I know nothing about them but they seem SO crazy and yet we have them running all across the oceans. .·°՞( ̑ ᗜ ̑ )՞°·.

whiterook6

This was a fascinating, well written article.

Razengan

How practical would be a mesh of satellites shooting lasers at each other, compared to undersea fiber-optic cables?

Alternatively, is there a wavelength of light to which water is completely transparent? Can we shoot lasers of that frequency through open water instead of through cables?

Maybe something that could be mounted on blue whales?

  • e12e

    Starshield (military arm of SpaceX/Starlink) does this for satellite imaging.

    Normally in imaging, you first need to get the satellite over the location you want to image, at the right time - then let it orbit over a downlink location.

    There are companies making a lot of money by having downlink capability in useful places (eg: near the poles) - combined with a fat pipe to the Internet.

    With Starshield, the satellites talk to each other over laser - so the satellite doesn't have to wait to travel to a downlink location - just relay to of that is already there.

    So for certain special cases it can help - but I think you'll find a cable stuffed with multimodal fiber had vastly more bandwidth.

  • toast0

    Depends on a lot of things, but most undersea cables have several fibers (typically around 10 fibers), and each fiber runs many wavelengths (typically 40 or 80). Whatever your bandwidth is per wavelength (there are lots of options, at different costs, up to maybe 400gbps) that's a huge amount of bandwidth to replace.

    Space lasers probably don't do multiple wavelengths, and aiming a lot of laser transceivers is going to be challenging.

    > Alternatively, is there a wavelength of light to which water is completely transparent? Can we shoot lasers of that frequency through open water instead of through cables?

    Even if you could, that's only going to work for short hops, long distance fiber includes repeaters every so often (50-100 km) to deal with loss, it would be tricky to build those under the sea ... and you need to power them, which means a cable, might as well include fiber with your power cable.

  • generuso

    Modern satellites, in particular Starlink, use optical transceivers that are identical to the ones used for the fiber optic links, with an addition of all the required parts to make them work across free space. So a link between a pair of satellites is very comparable to a single pair of optic fibers.

    The cables can go the entire distance between the data centers. The satellites probably connect to their closest neighbors, and any long distance transmission would have to make multiple hops, and share the bandwidth with everything else in the system going through the same nodes.

    Since there are hundreds of undersea cables, with a dozen fiber pairs or so each, the cable system has several orders of magnitude greater throughput compared to the current constellation of satellites.

  • wcfields

    Someone else with more experience could chime in but I would put it at less practical due to latency (sats are very high up), bandwidth (one laser vs a bundle of 1000s of fiber optic cables), cost (to overcome latency you need a closer orbit which requires more sats), single point of failure, lifespan, intercepted communications, solar flares… and that’s just off the top of my head.

    • joha4270

      I don't actually think latency would be that much worse.

      Of course, it depends on the altitude of the satellite but speed of light in a fiber optic is only ~2/3rds of speed of light in a vacuum so you can afford some detour

      • christina97

        You probably can’t get under 500 km orbit, so 2000 km round trip is the shortest you can do between you and a ground based server. That’s 150 ms minimum round trip latency.

        • p1mrx

          Light travels 2000 km in 7 ms. Maybe you took the inverse and got 150 Hz?

      • Razengan

        > speed of light in a fiber optic is only ~2/3rds of speed of light in a vacuum

        That made me wonder: Why can't we use vacuum cables?

        (the sort of questions I should probably be bothering an LLM with.. someone should make a LMGPTTFY)

    • skippyboxedhero

      latency lower for satellites, trading firms have looked at this already, no idea if anyone has actually done it

      bandwidth would indeed be worse

    • auspiv

      starlink sats are some of the lowest orbiting satellites in space - 330-370km for v3. this helps latency as well as easy deorbit at end of life. the v3 sats have multiple 400 gbps lasers for meshing... I can't decide if your comment is sarcasm or not actually because starlink is fully functional and doesn't have any of those issues

  • joha4270

    A submarine cable is a bundle of hundreds of strands, so you need quite a few satellites to replace one cable.

    • walrus01

      Typical submarine cables at at absolute most 24 strands, more commonly 4, 6, 10 or 12 for modern ones. Terrestrial cables can easily be hundreds and that's quite mundane.

      The high capacity in submarine fiber is achieved through DWDM and coherent modulation 100Gbps+ transceivers, not massive parallelism in fiber use.

      • cowlevel

        Why? compared to the laying cost, an extra 10000 fibers should be pocket change

        • generuso

          The cable contains not only the fibers, but also optical amplifiers to compensate for the losses. Even for 24 fibers, the amplifier is a substantial and expensive piece of equipment. It also requires electric power, which is not trivial to provide along the entire span between continents.

ortusdux

Reminds me of the Tom Scott video on the cable singe that leverages the moiré effect:

https://www.youtube.com/watch?v=d99_h30swtM

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection