Reddit Status
redditstatus.comI am convinced that Reddit's status page underreports outages, there are a lot of times I can't access the site for 15min but it never shows up on here. (And I don't even visit it that often.)
I think they're the major company with the fewest 9s of uptime.
> I think they're the major company with the fewest 9s of uptime.
I think this possibly shows that they have a good understanding of what's most important to their users. If they were to ensure the application was highly available (think six 9s), then they would be sacrificing resources elsewhere in order to achieve this. They could recognize that an outage will not be a "life or death" event for their users and have decided the trade-off was worth it.
Counterpoint: Or, they could just be lazy (or incapable) and haven't tried to solve for higher availability. This is not likely.
If their time was instead spent on the redesign, it was completely wasted.
I don't know one way or the other, but I visit/use the site a lot (more than I should) and I rarely if ever see outages. For what it's worth.
Do you use the actual site or do you use Reddit with an app?
I think the actual site, Reddit.com, is the one with more outages.
I agree with the parent poster (rarely any outage), but I use old.reddit.com.
Yeah, I use old.reddit.com as well.
> I am convinced that Reddit's status page underreports outages
If they are like every other major company out there, status page reports are a function of a manager or PM judgement call, not the output of a monitoring system.
Does anyone know why Reddit seems to be alone among the world’s most popular sites in having so many outages and frequent periods of slowness? I’ve been on it for more than a decade and its unreliability has been fairly constant. Is the engineering team more resource constrained than others or held back by unusual amounts of legacy code, or is it simply confirmation bias resulting from earlier experiences?
From AMA (ask [Reddit sysadmins] anything) announcement 2019/09/19 https://old.reddit.com/r/sysadmin/comments/9ver7h/14nov_redd...
"I can answer this! According to various sources (mainly, complaints on the redesign subreddit), the new.reddit interface is a lot less tolerant of timeouts and delays. Old.reddit was much more relaxed and would wait longer before throwing up errors (like logouts and such), but new.reddit is RESPONSIVE!, and the backend isn't playing nice with the new, tighter tolerances."
Full AMA https://old.reddit.com/r/sysadmin/comments/9x577m/were_reddi...
Also a 2018 AMA summaryhttps://github.com/yanhan/notes/blob/master/reddit-sysadmins...
Wow, I didn't know there was actually more to dislike about "new" reddit.
Even if it were truely the reason (it's just someone uninvolved who saw a lot of complaints about the new interface) it doesn't explain the rest of the decade where there was no "new interface" and it was still a meme that Reddit was constantly down.
"Responsive" is not a word that comes to mind when thinking about reddit's new interface.
In my world (UX Designer) "responsive" means it responds to browser window size and accommodates all sizes from phone to desktop.
Compare Old reddit and New reddit by shrinking your browser window in the x-axis on desktop.
Is that the way 'responsive' is being used in this particular context? What does reflowing a webpage when the browser's window changes size have to do with these timeouts and delays in the backend?
theres some ironic use of the word in the post above. they are mocking that the new and improved "responsive web" site isnt responsive in a speed context.
To me, it feels like outages are much less frequent than they were 7-10 years ago. It used to be a couple times a month. I don't remember the last time I saw one of their snoo error pages.
Outages are definitely less common than they used to be. But I would guess that reddit is one of the most popular sites on the internet because it's basically like an anonymous(ish) facebook with content guaranteed to be popular with the majority (by design).
They've also made major efforts to keep the site socially sane for the majority of users (for better or worse, IMO generally better) with their moderation model.
Whether or not it's a great site technically is irrelevant. It's something people want and something I keep coming back to because there's no equivalent when it comes to niche communities.
>keep coming back to because there's no equivalent when it comes to niche communities.
Niche specific forums are better at everything niche communities want/need in a discussion space except bringing on new users. Considering the kinds of users you get when you're in close proximity to a colossus of internet riff-raff I don't think this is a big tradeoff.
There was a AMA from the engineering team. I don't remember the technical details but in the picture there was like max 10 persons, That seem a little understaffed for a website a this scale
Anecdotal, but old.reddit.com (besides search) seems to always work during these outages. I'm guessing they're always knocking out the AJAX and search machines for some reason
>besides search
Surely you're not attempting to imply that the search on old reddit worked in the first place?
Reddit’s search was and still is terrible. Using “site:reddit.com <query>” with google search is pretty much the only way to get meaningful results.
I gave it some thought. I’ve distilled the reddit value proposition for me at least.
Imagine having to manage a separate login for a different forum for every topic you’re interested in. And having to check 10+ forums a day for responses to your comments.
With reddit it’s a common interface to every topic I’m interested in. I’m subscribed to about 60 subreddits now, from off grid cabins to deep learning to Spacex.
Lots of people still don't want a single account which crosses all topics.
I personally maintain three - A professional one mainly used on technology forums, another for politics only and then a final one for... Other stuff.
I know lots of people who do similar.
Sure, but reddit makes it easy to do that too, and it's still all in one place.
You can get email updates to your forum posts
>Imagine having to manage a separate login for a different forum for every topic you’re interested in. And having to check 10+ forums a day for responses to your comments.
Bookmarks folder + Browser password manager + email notifications solves this for N forums where N is less than ~20.
Sure, it's harder to have a really shallow level of engagement in a community if it's not all algorithmicly curated on one page (you actually have to go to the forums and check what's up vs seeing just the popular stuff in front of you) but I think for most interests that's probably a good thing for the community around that interest.
Anyone willing to put a price on 1 hour and 14 minutes of Reddit downtime? I would guess this cost less than a $1,000,000 USD but more than $100,000.
According to [], they had $119M revenue in 2019. That's about $14k/h.
[] https://techcrunch.com/2019/12/04/reddits-monthly-active-use...
Good find, although that would assume that every hour of the year is equally contributing to revenue. In reality I would think that an hour-long outage in the morning as everyone in N. America (still the largest percentage of reddit users) is reading reddit while waking up/drinking coffee is probably more costly than an hour-long outage while most of those users are asleep.
My first exposure to empty set citations
{} would at least be consistent with python string substitution, but [] doesn't make much sense to me
Certainly negative cost for society, given all the freed up time.
Oh, an actual status report.
I expected this to be a page that just said:
"Mostly upset about stuff, but still quite witty, completely random, and - this is a re-post."
I really wish all the websites my company worked with had a status page as good as this.
This is the tool they're using and it can be used for any website.
Looking forward to this postmortem! Looks like their request rate has dropped by like 80%-90%!! Don't know if that include CDN requests or what, assuming it's just the reddit.com domain.
old.reddit.com still works!
Reddit is hosted on AWS. Are they using Fastly as their CDN because it's cheaper than AWS CloudFront CDN?
no, because its better.
"vote backlog" is an interesting metric. Does anybody know how the vote counting system works?
I believe comments, posts, and votes are placed into a queue and later (seconds usually) committed to the database. They're not visible to the public until they're committed (but they make the UI act like it's already there for the poster themselves). Just a guess from my observations though.
Pretty standard pattern. Facebook does it as well.
> Monitoring - A fix has been implemented and we are monitoring the results. Feb 19, 05:24 PST
CDN was unable to reach servers.Happens again