Settings

Theme

Why Dropbox decided to build its own infrastructure and network

techcrunch.com

317 points by zachperret 8 years ago · 157 comments

Reader

antoncohen 8 years ago

Dropbox hasn't dropped AWS, they moved things off AWS as it made sense to. The article is talking about two things, the move of file storage and a network backbone. Neither of which were done recently.

The file storage move from S3 to Magic Pocket is detailed in these blog posts:

https://blogs.dropbox.com/tech/2016/03/magic-pocket-infrastr...

https://blogs.dropbox.com/tech/2016/05/inside-the-magic-pock...

https://blogs.dropbox.com/tech/2016/07/pocket-watch/

The network backbone is talked about here:

https://blogs.dropbox.com/tech/2017/09/infrastructure-update...

  • codehusker 8 years ago

    From the last link, in 2016 "Proxy-Stack deployed at our edge PoPs to terminate SSL connections closer to our users".

    Reminds me of the infamous "SSL added and removed here! :^)".

    Does anyone know if there are any additional protections from snooping on their internal network?

    edit: phrasing

    • lwf 8 years ago

      Early SSL/TLS termination is to reduce latency; the longer-lived connections from PoPs to Dropbox datacenters is over a TLS 1.2 connection with PFS. See an earlier blog post[1]:

      > We use TLS 1.2 and a PFS cipher suite at both our origin data centers and proxies. Additionally, we’ve enabled upstream certificate validation and certificate pinning on our proxy servers. This helps ensure that the edge proxy server knows it’s talking to our upstream server, and not someone attempting a man-in-the-middle attack.

      (N.B.: I work on security at Dropbox, and consulted on this design)

      [1]: https://blogs.dropbox.com/tech/2016/11/infrastructure-update...

      • codehusker 8 years ago

        Much appreciated. Lots of great, technical blog posts I need to catch up on.

        I have to admit, part of the reason I use Dropbox is that I know I can get answers directly from employees on HN.

      • walterbell 8 years ago

        Does this change the legal/geo jurisdiction of the SSL/TLS handshake?

        • lwf 8 years ago

          I'm not a lawyer, but I did work on one of the previous Transparency Reports[1]. From our most recent one:

          > Between July and December 2016, Dropbox did not comply with any non-US government legal process unless issued by a US court as a result of the Mutual Legal Assistance Treaty process.

          ... if that helps answer what you're getting at :)

          [1]: https://www.dropbox.com/transparency/reports

          • audiometry 8 years ago

            Ironically, people are probably more worried about US Court actions these days than those of foreign governments.

        • justinjlynn 8 years ago

          One would assume so, since the data is being unwrapped/rewrapped at another jurisdiction - thereby proving/providing the ability to do so there.

    • antoncohen 8 years ago

      I believe they mean bringing the SSL/TLS handshake closer to the user is beneficial, it doesn't mean the proxy doesn't use SSL/TLS to its upstreams.

      In this post they say specifically it is about the handshake:

      https://blogs.dropbox.com/tech/2017/06/evolution-of-dropboxs...

      I don't know if they use SSL/TLS to their upstreams, I'm just saying terminating in at the edge doesn't mean that is the end of all SSL/TLS. It is totally normal to terminate SSL/TLS at the edge, pretty much anyone using an HTTPS load balancer or CDN does it, but the LB or CDN can still use SSL/TLS to the upstreams and verify certificates of upstreams.

  • elmar 8 years ago

    The epic story of dropbox exodus from the amazon cloud empire

    https://www.wired.com/2016/03/epic-story-dropboxs-exodus-ama...

  • shevy 8 years ago

    They moved most of their stuff away from AWS.

  • bsenftner 8 years ago

    The 'value' cloud services provide is purely for experimental services an organization does not want to commit physical assets. Those deluded to believing cloud services provide any value beyond test service deployments are propaganda poster boys for today's tech sucker awards.

    • mseebach 8 years ago

      Surely, there are people out there who overpay for AWS resources. But the truly deluded are those who purport to understand the sheer width and breadth of organisations and their wildly different requirements and priorities well enough to to brand them suckers.

    • luckydata 8 years ago

      You are extremely wrong. The Dropbox story shows that if the bulk of your value comes from selling a commodity (storage) then you need to improve your margins by moving away from a provider that also makes the bulk of their money selling the same commodity.

      For companies where the value lies in the utility of a service that can't be easily replicated, you have pricing power to make the convenience of AWS worth the expense.

      • user5994461 8 years ago

        Pretty sure that the value of Dropbox doesn't come from the storage. It comes from their software. The magic thing that allows to replicate all your data seamlessly between as many computers and phones as you want, without the need to click any button or understand what the word storage even means.

    • snovv_crash 8 years ago

      While I mostly agree with you, there is some benefit to economies of scale and time to deployment.

    • KyeRussell 8 years ago

      Have you not worked in smaller companies? Economies of scale apply in myriad situations.

epa 8 years ago

This means their EBITDA now probably shows profitability (servers they own are amortizable [the A in EBITDA], where are AWS is expensed.)

Edit: Amortization/Depreciation can <i>generally</i> be used interchangeably.

  • btown 8 years ago

    Actually, since the servers themselves are physical assets with a useful life, and indeed could be leased independently from the business model during that useful life, they'd be modeled as depreciation not amortization. But yes, EBITDA would be increased either way.

    Realistically, the valuation multiples on EBITDA for mature SaaS businesses are different from those for datacenter operators, and someone building a financial model for Dropbox would now likely take a blend of these this into consideration. So EBITDA is by no means the end-all be-all here.

    EDIT: And taxation is a different story altogether, as in either the cloud or own-hardware case, Dropbox can write off expenses or depreciation respectively.

  • gordon_freeman 8 years ago

    Good point. I always wonder how such accounting changes truly reflect the financial performance of the company. On one hand it's a lot of upfront cost to Dropbox with high risk too but all that won't show up completely if this cost is amortizable over the long run.

  • bernardlunn 8 years ago

    This could have been the decision driver. It is also why investors increasingly look past ebitda to free cash flow which is harder to game.

  • lobsterloga 8 years ago

    Maybe but OpEx is tax deductible. CapEx is not.

    • mbesto 8 years ago

      Huh? You deduct CapEx cost over the depreciation period (server hardware is usually 3-5 years). Not sure what you mean by "CapEx is not".

    • CodeWriter23 8 years ago

      CapEx is deductible over the amortization period.

    • qaq 8 years ago

      I am pretty sure if they desire they can convert CapEx into OpEx.

      • toomuchtodo 8 years ago

        Sure, if they sell the storage system to someone and arrange a leaseback.

        • 0xbear 8 years ago

          That's how Microsoft manages its campus real estate. :-)

          • dx034 8 years ago

            Nearly every company does that. It's amazing how little many companies actually own. I've worked in offices where everything from building over furniture to even the plants was leased. The company ran with close to zero assets (services business). Pretty sure that this wouldn't make any sense if it wasn't for tax purposes.

        • qaq 8 years ago

          and that someone can be their own subsidiary in a jurisdiction with dif. tax treatment

          • toomuchtodo 8 years ago

            Can be within the same taxing authority. I've facilitated facility transfers and leaseback agreements in the US.

            Edit: Yes, you can't seize what isn't owned.

            • tw04 8 years ago

              You also can't silently seize what is owned. Which is, generally speaking, the bigger issue.

            • qaq 8 years ago

              I would also guess you could also shield assets this way from lawsuits etc

swampthinker 8 years ago

I'll be 100% honest, I didn't realize Dropbox was still on AWS. You figure at a certain scale it makes more sense to run your own solution.

  • praneshp 8 years ago

    (Dropbox employee)

    I don't think this article is news. The editorialized title in HN is unfortunate and I wish a mod can change it. The article talks about the reasons Dropbox decided to move 500PB storage into our own data centers. Also like the article mentions, "They still use AWS for some workloads".

    Edit: Here is another HN submission of the same piece with the correct headline. https://news.ycombinator.com/item?id=15257331

  • xbmcuser 8 years ago

    Yeah and that's why it amazes me that Netflix uses Amazon a straight competitor that uses the money it makes from Netflix to compete with Amazon prime.

    • StreamBright 8 years ago

      Netflix probably in a better position to do the math than random people on HN. I think they have done their homework and decided that it is overall cheaper to keep ___some___ of their infra on AWS.

    • kabes 8 years ago

      But this happens all the time. Like Apple buying iPhone components from Samsung. The best deal is the best deal

    • mulmen 8 years ago

      I hear this line of thinking a lot but I don't really buy it.

      You could just as easily say it's amazing that Amazon allows a competitor like Netflix to run on it's platform. The reality is that relationship is more complex than that.

      • kinkrtyavimoodh 8 years ago

        Netflix is going to exist regardless of whether Amazon lets them run on AWS.

        Amazon letting them run on AWS is brilliant as they get a piece of Netflix's pie. So even if Netflix beats Amazon Prime, Amazon gets to dip into their pot via revenues from AWS. It's a great hedging of bets.

        • peanutgallery27 8 years ago

          They're totally separate businesses. The people that treat Netflix like their customer aren't the same people making strategic decisions about Amazon Prime. Amazon is a ridiculously large company.

          • siculars 8 years ago

            They are not totally separate when the P&L roll up on the same spreadsheet.

            • user5994461 8 years ago

              That depends on how the Amazon business is organized. It's possible that the P&L never join on the same spreadsheet.

      • ryacko 8 years ago

        The really amazing thing is that Nestle licensing production of Kit Kats to Hershey.

        • dec0dedab0de 8 years ago

          I think that deal was done before nestle bought kitkat. Kind of like spiderman movies being with sony instead of disney

    • user5994461 8 years ago

      Migrations and self hosted infrastructure don't do themselves. Netflix can get quite a lot of stuff done on AWS for the $200k+ dollars it would take to hire one single employee.

    • amorphid 8 years ago

      What's the largest cloud provider that does NOT offer a Netflix-like streaming video service? Amazon/AWS, Microsoft/Azure, and Google Cloud all have offer premium streaming content of some type. IBM Cloud?

    • xbmcuser 8 years ago

      My point was that Netflix uses AWS services exclusively instead of dividing it between multiple services at least though now days they probably get really deep discounts from Amazon to stay on AWS because of competition and it probably is lot cheaper for them then building and maintaining it's their own servers.

      • lstyls 8 years ago

        Netflix built their own CDN ages ago. Given that their core business logic is basically static content delivery whats left to AWS probably is a lot less than commenters in this thread seem to think.

    • notyourday 8 years ago

      CAF

  • dandr01d 8 years ago

    This article isn't an announcement - it's a "Why we did it". They started transitioning years ago.

  • rizjoj 8 years ago

    and Netflix?

    • kyledrake 8 years ago

      They run BGP and do an enormous amount of IX peering. https://www.peeringdb.com/asn/2906

      AWS doesn't even let you do BGP. If you want to use them for a CDN, you're monopolized into their network and their blend of ridiculously overpriced bandwidth.

      They might be using AWS for the canonical store of data, but the sanity of using "the cloud" goes out the window the second you need to ship a lot of traffic to the public internet.

      • jimktrains2 8 years ago

        > heir blend of ridiculously overpriced bandwidth.

        For someone not at netflix's level, can you recommend somewhere with significantly cheaper bandwidth.

        • NightlyDev 8 years ago

          While I don't know what pricing AWS has for high bandwidth customers since it's not public, I do know that the public prices are really high.

          The thing is, even for smaller companies it's easy to get way better deals on bandwidth. I'm currently using a provider that runs openstack and I'm paying less than $0.009/GB, from the first byte(no commitment). I'd say that is very cheap compared to AWS pricing at $0.05/GB above 350 TB.

          With colocation or renting dedicated servers and IP-transit you can get way lower prices. A dedicated 1 Gbps is about 300 USD/month with my provider, and the prices drops hard for dedicated 10, 40 and 100 Gbps uplinks.

          Never used OVH myself, but they are providing 2 Gbps at £340/month for their highest quality bandwidth, and £64/month for bandwidth they think would be good for downloads.

          I think using cloud providers for somewhat high bandwidth services are basically throwing money out the window. Until prices really drops(if they ever will) I'll continue thinking that clouds are for temporary workloads or prototyping with the ability to easily scale at a high cost.

          • CharlesW 8 years ago

            > I'm currently using a provider that runs openstack and I'm paying less than $0.009/GB, from the first byte(no commitment).

            Would you mind sharing who that is?

            • NightlyDev 8 years ago

              I'm not allowed to say, but I think OVH also runs openstack with the "public cloud" offering, and I think bandwidth are even cheaper with them.

          • user5994461 8 years ago

            It's interesting that what you consider a great provider is only doing 6 times cheaper than AWS. That's not much of a discount.

        • notyourday 8 years ago

          Below $10k/mo bandwidth plays are irrelevant - the cost of the support infrastructure is just too high.

          At $10k/mo what you do is plop a rack in one of the well connected buildings in NYC, VA, SF, SJC, CHI and get either flat rate 10Gs or 1G commits over 10Gs. You should be paying between 0.55 and 0.75 per Mbit/sec on 95th percentile on 1G commit. You put into the same cabinet your edge nodes that actually would be pushing the traffic out and use AWS or GCP for your compute workloads.

        • corford 8 years ago

          Pretty much anyone... Hetzner, Linode, Choopa

          • jimktrains2 8 years ago

            For those I need to run a VPS, which also costs money and has fewer PoP and more mangment overhead.

            EDIT: I guess I was talking about CloudFront specifically, not EC2. EC2 is pretty pricey.

        • dasil003 8 years ago

          I built a global video CDN using SoftLayer a couple years ago and ended up paying around $0.01/GB.

        • toomuchtodo 8 years ago

          Any colo or dedicated server provider.

          • jimktrains2 8 years ago

            At a CoLo I have the rack, managment, and hardware overhead too, though? Also fewer PoP.

            EDIT: I guess I was talking about CloudFront specifically, not EC2. EC2 is pretty pricey.

            • toomuchtodo 8 years ago

              Price compare various CDNs. It's a commodity business. Fastly comes to mind, but we had quite a few outages with them at my last org.

        • thezilch 8 years ago

          Pretty much anywhere.

        • shaklee3 8 years ago

          Packet.net

      • _pmf_ 8 years ago

        > you're monopolized into their network and their blend of ridiculously overpriced bandwidth.

        Wouldn't a customer the size of Netflix be granted more liberty in this regard?

      • pravinva 8 years ago

        What are you on about? AWS practically requires BGP. Static routing is rarely the best choice when you set up DX.

        Netflix rolls its own CDNs because Cloudfront can't meet all their demands, yet.

    • andyfleming 8 years ago

      To be fair, Netflix only runs some of their infrastructure on AWS. Basically, if I understand correctly, their applications run on AWS and their delivery is through their own CDN built on top of various ISPs[1].

      [1] https://media.netflix.com/en/company-blog/how-netflix-works-...

      • yeukhon 8 years ago

        Correct, but some is probably an understatment. They are pretty much run everyting on AWS except what you cited (e.g video processing and content delivery). Netflix is the biggest AWS user.

    • eikenberry 8 years ago

      They have a completely different use case that benefits from being able to scale up and down quickly. I don't see them moving away from AWS anytime soon.

  • bsenftner 8 years ago

    Please, how fucking stupid. Of course they moved as much as possible off AWS, and only use AWS for new and experimental services. The markup of cloud servers is immoral, and the brainwashing that cloud services are a value at all is a testimony to how many people simply do not do the math.

    • StreamBright 8 years ago

      I am not sure what you are talking about. They moved out the 500PB data storage because ______at that scale______ it is cheaper to run it on your own hardware. This implies few things like having engineers with skills that are really not easy to find for starting and a bunch of other challenges that you need to solve.

mc32 8 years ago

What does AWS do when someone moves 500PB of storage off of their systems? Do they sit idle till some other big customer comes along or is their growth so phenomenal that a 500PB move off doesn't even slow new (storage) deployments at all and just keep up their pace?

  • late2part 8 years ago

    with no actual facts, i'll speculate.

    let's assume they have 12 buildings at each region with 500 racks in each. 6k racks

    Let's assume that S3 is 1/4 of their infrastructure.

    Let's assume you can put 60 * 12TB disks in 4U and they use 52 racks. That's 136012TB per cabinet or 9.4PB per rack.

    1500 racks at 9.4PB raw capacity with RF=2.1 so best case that's that's 1500 * 9.4 / 2.1 = 6700PB at a site.

    So 500PB would be 7% of the space.

    They're probably growing 5-15% per month like most hot companies now, so that's 1-2 month's growth.

    Of course these numbers are certainly off. But probably in the magnitudinal ballpark.

    • mc32 8 years ago

      My guess (and it's a terrible guess) is this may be about 4mo growth... and they might take the opp to retire older lower capacity drives and just keeping up the build-out.

      But who knows...

      • chis 8 years ago

        If you're ordering 500 petabytes you probably sign a contract with Amazon, and have to let them know in advance if you want out.

        • mc32 8 years ago

          That's a good point --but they didn't start with 500PB, when they first went to AWS they probably only used a few PB to begin with and grew "organically" over the years. But likely still had some contractual stuff for this kind of scenario.

    • ramshanker 8 years ago

      12 TB Disks are pretty recent phenomenon, not 3 to 4 years ago when Dropbox did this exercise. Backblaze numbers are a good source. So adjusting your calculation, that should be 3 Month No-Storage-Buyout scenario.

  • user5994461 8 years ago

    There are hard quota enforced on storage. You will have to fill a truckload of forms to get your quota raised to 500PB.

    I personally never asked for that much but I'd speculate that they won't give you that in any single region.

  • qaq 8 years ago

    Directly moving out 500PB of data of AWS would cost 20+ million dollars depending on usage patterns might be cheaper to gradually shift usage.

ChicagoDave 8 years ago

I had a chance to compare all of the file services a few years ago in a large corporation and I thought out of all of them, the DropBox engineers were the strongest. Microsoft second.

qaq 8 years ago

People making sane choice very refreshing. I wish my company would make same decision.

  • mrb 8 years ago

    Make the sane choice of applying to work for Dropbox =:)

raides 8 years ago

I am curious on the hardware build out used for the storage nodes. Some of the major issues I have seen with all the appliances out there for storage are the following:

1. Network throughput on the appliance is fast but for an Enterprise level the 10gigE cards used become a bottleneck for transactions because of how the software hypervisor scales the data. 2. Power consumption of the appliances in a rack mount environment are too high and leave needed space that has to stay empty because of the facility power per rack limitations. 3. The software hypervisor scales the stack vertically and relies on the software to load balance horizontally. The performance in a high transactional environment becomes dependent on the software to scale instead of the natural horizontal distribution that can be setup on the hardware out of the box. Standard multi-purpose storage arrays scale horizontal with very little over head from traditional software storage management. I only found one company whose software does not force the stack to be vertical but they fail to meet a reasonable performance in network/power.

Streaming petabytes of data to keep a dynamic constant (static overall storage requirement that changes it's data life cycle via retention rules) becomes very hard with premade hardware.

Does anyone have any recommendations or has attempted a similar exodus from S3 that they can share?

justonepost 8 years ago

Is 500 petabytes really that epic? 1500 tapes? I could probably stuff that in the back of my minivan.

  • Johnny555 8 years ago

    To fit 500 petabytes on 1500 tapes, you'd need to put 333TB on a tape. Do any currently available tape formats support that much data on a single tape?

    Granted, I stopped paying attention to tape drive capacities a while ago, but the upcoming LTO-8 standard will "only" support 13TB/tape, so you'd need 38,000 of them to hold 500 PB.

    I've seen some higher density announcements in the 200 - 300TB/tape range, but couldn't find any products available.

    AWS does offer a "Snowmobile" [1] product, that can hold 100PB on disks in a tractor trailer.

    [1] https://aws.amazon.com/blogs/aws/aws-snowmobile-move-exabyte...

  • zuzun 8 years ago

    "I have a few qualms with building storage data centers. For a Linux user, you can already build such a system yourself quite trivially by putting 1500 tapes into the back of your minivan and then mounting them locally via curlminivantapefs."

  • jsemrau 8 years ago

    Great comment for 2017. I would like to see the 1987 version and the 2037 version of it.

    • jerf 8 years ago

      I recently misplaced one of my 32GB SD Micro cards I was using to have an alternate image for my Raspberry Pi. So I just bought another one for the price of a half-decent lunch.

      And I did have a flashback to my first hard drive, all 220 glorious megabytes of it, and a great deal more expensive than "a decent lunch", and get a sweet hit of that yeah... I am in the future, aren't I? feeling.

  • jason_pomerleau 8 years ago

    What will you tell your customers, exactly, while you go on a road trip with their data? And what happened to the data between the time you load Tape 0001 and Tape 1500?

    Moving 500PB on a live application is not a trivial task.

  • ransom1538 8 years ago

    Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway. –Andrew Tanenbaum, 1981

iUsedToCode 8 years ago

Dropbox is cool and all, but i hate their pricing model. I just want to keep about 50-100 GB there (i don't hoard stuff). I don't wanna pay $10 / month for that. At backblaze i pay less than $0.5 / month. I could pay quadruple, since Dropbox is a lot better service (and quite a different one, too). But not 20 times as much.

I know that Dropbox doesn't care about my tiny dollars and all. But why not let customers pay for what they use? This "constant growth" bullshit is probably the reason they don't care.

  • mgkimsal 8 years ago

    what bugged me about their pricing model (perhaps it's changed?) is that things people share with me count to my cap. I had a client share stuff with me via dropbox. So I signed up. I get "2 gig free!" Yay. Another client shares stuff with me. Then another. Then another. Then I'm at my 2gig cap with just other peoples' stuff. They all think it's great, because none of them are paying for it. I needed to pay money to support their free use of the service, and I declined. Just one more $x/month service I didn't need to get hooked to. Maybe the pricing model has changed what they count now?

    • kungito 8 years ago

      How do you have "clients" and you can't afford 10$ a month to not have to think about it?

      • mgkimsal 8 years ago

        It was largely the principal of the thing. It's yet another $x/month, on top of other services being paid for to help service/manage those clients. Example - PM tools. I'm already paying for project management tools - put the files there, damnit. "oh, but I like dragging to my dropbox!". Oh, and someone else uses box.com, and so on.

        Again, what gets my goat is partially the payment, but mostly the "it's free for them, but I end up needing to pay to accommodate their use of the service" angle. If they - other parties - were paying for it first, it would bother me less. But raving about how 'free' a tool is which I have to pay for to work with them (and they're using it precisely because it's free) bugs me.

        Getting sucked in to a few more $x/month things here and there 1) dilutes where stuff is supposed to live (wrt files) and 2) just becomes a drag on finances. A handful of services can end up going from several hundred dollars in to the thousands if you don't keep tabs on things.

        Maybe I'm an HN failure because saving several hundred dollars per year matters to me? I guess my skills must suck - most people can apparently rustle up $300/hr Rust/Go/Elixir project work simply by starting to formulate the idea that they're considering taking project work. I'm not that skilled.

shevy 8 years ago

> While cost is always something that we consider, our > goal with our network expansion was to improve > performance, reliability, flexibility and control > for our users — which we have succeeded in doing,” > a company spokesperson told TechCrunch.

Who believes this?

It was, easily noticable by everyone, wanting to reduce the cost. Which is fine, everyone does so, so why not admit that it was the primary impetus?

I would not want to outsource control over any larger company that I were to run to other, even bigger companies.

  • maccam94 8 years ago

    Performance and reliability definitely affect subscription rates. Revenue growth is actually more important than decreasing costs (as long as your costs don't start increasing disproportionately).

  • late2part 8 years ago

    I can see how you would think it is only about cost.

    However, then you've had Amazon tell you "no" when you try to get more resources, and when you've had your business go offline for hours while you wait for news from Amazon, you may want more control.

sandworm101 8 years ago

Three data centers "biult" by only the dozen people on the infrastructure team? Not possible. I wish articles like this wouldnt hype small teams where it is obvious that most all of the work was outsourced. It would seem that dropbox here was still operating as customer: ordering rather than physically biulding much of anything. Those dozen dropbox people were not running cables.

  • iscoelho 8 years ago

    The article is unfortunately not very specific and I can not find much information with a quick search, but:

    It's very possible that they did this all on their own provided they rented cabinets/cages in an existing facility like Equinix, which is extremely common. Then they do not need to manage power/generators, fiber into the building, or any other data center necessities.

    It does not take very many people to do the wiring inside a cage, especially considering Dropbox has been doing this over the span of a few years. If you've ever been physically in a data center (personally visited a few Equinix facilities myself), it's mostly one person from a company working in a cage that is wiring everything. I've rarely seen multiple people do wiring, and that same person will come back every day thereafter to continue working until the job is done.

    What they are doing sounds entirely feasible. If money is no object in regards to equipment, with 3 data centers, I'd honestly say you only need 4 competent people to get the job done.

    3 on-site. 1 remote/office.

    From there, the more the merrier. A guy to lift the equipment up as well is nice sometimes - can be pretty heavy!

kibwen 8 years ago

The article is dated today, but isn't this news from a few years ago? https://www.wired.com/2016/03/epic-story-dropboxs-exodus-ama...

paxy 8 years ago

They did this a while ago.

Here's an article from last year with a lot more detail - https://www.wired.com/2016/03/epic-story-dropboxs-exodus-ama...

notyourday 8 years ago

(a) CAF ran out

(b) Without CAF, GC and AWS pricing is ridiculous - somewhat akin to paying $9.99/lb for a Purdue chicken a day before the expiration

(c) Without the scale of AWS and GC one can get vendor prices at Google/Amazon MFN + 10% any day or +5% after schmoozing.

knodi 8 years ago

I'll save you a click. Cost savings.

goptimize 8 years ago

"We’re talking about a company that had 1500 employees, with just around a dozen on the infrastructure team" - what the rest 99% of the company is doing, marketing?

  • siddboots 8 years ago

    Yes, marketing. Also software development, web development, design, customer services, corporate services, support, sales, PR/comms, human resources, finance & accounting, legal, and so on.

    1500 sounds like a lot, but keep in mind how many customers they have, and in how many countries they sell their services.

  • maccam94 8 years ago

    The wording got mixed up a bit. "Infrastructure" was a much larger organization, but there was an infrastructure team of about 12 people who worked on Magic Pocket at the time.

    https://blogs.dropbox.com/tech/2016/05/inside-the-magic-pock...

  • vacri 8 years ago

    I was also thinking that those numbers are really weird, for a company which does infrastructure(fileservers)-in-the-cloud. Obviously some devs doing software for various platforms, business-side folks and so forth. But 1500:12 is a really weird ratio, given the core function of the business. If they're not spending on infra staff... what staff are they spending on?

    • zaroth 8 years ago

      Seriously, 12 people controlling all of that sounds like a liability. Are they allowed to meet all together?

    • paulie_a 8 years ago

      I expect that 1300 of those people are in sales.

flamedoge 8 years ago

did Dropbox really only have 12 people in the infra team at the time?

uiri 8 years ago

Can we remove /amp/ from the end of the URL? Some people still use HN on a laptop or a desktop.

Also, as mentioned elsewhere in the comments here, it should be retitled to "Why Dropbox decided to drop AWS"

  • crisnoble 8 years ago

    I am reading it from a desktop and I had to do a double take when I instantly noticed how it was techcruch but didn't have the epically annoying fixed sidebars and delayed loading ads messing with my scroll bar. I came here to suggest we add /amp to the end of all techcrunch submissions. Title, content and a single static ad at the end, if all news sites were like this I would not complain.

  • driverdan 8 years ago

    I'm against Google hosted amp but what's the issue with self hosted? This page is so much nicer than the overly busy normal TC site.

    • interfixus 8 years ago

      Separate URLs for separate devices? Talk about regression!

    • mulmen 8 years ago

      The problem is you making that decision for me.

      • rev_bird 8 years ago

        Wait, but using the non-AMP version is a decision too. Why do you get to make that one instead? Shouldn't the person posting the link get some discretion?

        • mulmen 8 years ago

          Principle of least surprise. techcrunch.com has a default experience, amp is secondary. Since we can't all read each others minds the default behavior should be to use the ...default.

        • shevy 8 years ago

          But we did not have AMP until recently.

          So OTHERS made a new decision for YOU - as the visitor.

  • hcurtiss 8 years ago

    Why is there always so much hate for amp on HN? I'm on a PC and I vastly prefer these pages to the huge/bloated default pages offered by so many publishers. Using the TC page linked in the original post as an example, if I turn on Ghostery it blocks 22 trackers! https://imgur.com/a/iTnlT

    On the Amp page, it only catches one: https://imgur.com/a/P7mww

    • SXX 8 years ago

      It's not all about privacy and trackers, but about search monopoly that well might abuse it's power to become content provider monopoly as well using the fact they have fastest CDN.

      Though it's less of a problem with self-hosted AMP, but still a problem because it's still tech from company that might choose to improve web and can very well do it with Chrome market share, but instead decide to replace it with own thing.

      I have good reasons to not trust Google because over years they provided worse experience for Firefox on their own services and it's still annoyingly true on Android.

    • tanilama 8 years ago

      It is all about ideology. People hate google for doing anything because it is too big.

  • SilverSlash 8 years ago

    What exactly is /amp/?

  • shevy 8 years ago

    Oh wow, I did not even notice this until you pointed it out.

    So the solution is SO bad that the "amp" tag even becomes part of the URL?!

    Now THAT is really weird ... well aside from me disliking AMP anyway, that ... hmmm. We can send people to the moon, probably soon elswhere but ... we have to denote that ... we use AMP by ... a appended string called 'amp'.

    Google should be ashamed of this "engineering".

mr_tristan 8 years ago

Um, what is this crap? When did they actually move? How long did it take?

The title of this HN link leads you to believe this is recent, but the article makes it seem like a multi-year effort, that in fact, could have finished a long time ago.

  • jetru 8 years ago

    They were off of it quite a while ago from what I remember. Perhaps they are completely off of it, as in, "we deleted our account" off of it.

  • dandr01d 8 years ago

    I agree. The title is misleading and should be changed.

    • mr_tristan 8 years ago

      But the blog itself lacks a lot of information.

      The timeline is really, really significant here. Did they initiate this back in 2013? 2015?

      My company has seen a remarkable shift in trust for online services change the last two years. Was Dropbox ahead of this curve? Were they someone who brought this change in mentality around?

      This blog article is crap because without a basic sense of _when_ it could be that they were riding the coattails of other industry leaders. Or they were leading the charge.

  • mr_tristan 8 years ago

    This article sounds like a PR puff piece. If you downvote me, please explain why this blog article actually means anything to you.

tcptraceroute 8 years ago

The title here isn't quite accurate.

Dropbox has moved user data from S3 to its own colocated data centers over the past few years, and is also doing compute in those data centers too. The compute actually existed for quite a long time - in the past you'd be talking to a Dropbox run server which would connect back to S3 to retrieve data.

Dropbox is definitely still an AWS customer, just not a major S3 or EC2 customer anymore. For example, all transactional email uses SES, and DNS is hosted on Route 53.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection