Wikimedia chair, lawyer at Creative Commons, tech policy geek, FLOSS advocate, bassoonist, violist, nerd.
144 stories

Why the White House daily briefing is in such trouble.

1 Share

First, read this update that CNN’s Brian Stelter included in his nightly newsletter this week:

In the past 24 hours…

 — President Trump went after two of the nation’s biggest newspapers, The New York Times and the Washington Post, with “fake news” tweets.

— The White House told reporters they could cover Trump’s first re-election fundraiser, but then made an abrupt change, “closing the event to media in a break from past precedent.”

— The W.H. prohibited TV cameras at the daily press briefing again.

— The president posted James O’Keefe‘s anti-CNN videos on his official @realDonaldTrump Instagram page, promoting the videos to millions of followers.

— Trump allies in the media continued to attack. O’Keefe’s videos were a top story again on Fox News, with Tucker Carlson at 8pm, “The Five” at 9pm, and Sean Hannity at 10pm all leading with it

— The W.H. confirmed that Trump and South Korean president Moon Jae-in aren’t planning to hold a joint news conference when Moon is here on Friday. Joint pressers are customary when heads of state are visiting. But the W.H. didn’t schedule one when Indian prime minister Narendra Modi visited on Monday, either.

The Pentagon gave a non-answer when asked why Secretary of Defense James Mattis decided to travel this week without the usual contingent of TV journalists.

— Journalists were told to leave a Justice Department event marking Pride month, which was taking place in an area normally open to press.

Now add to Stelter’s list these items…

* The damaging retraction by CNN of a wayward report about the Russia investigation that led to the resignation of three top journalists at the network. We still don’t know what was wrong with it; we just know that it did not pass through CNN’s checks and balances.

* Politico’s report that “Donald Trump and his allies believe he’s gained a tactical advantage in his war with the media… Some Trump allies suggested that the recent misstep at CNN is enough to justify drastic changes to how the White House deals with the press, including moving reporters out of the West Wing entirely.”

* Trump’s spectacularly hateful and misogynist tweets about MSNBC’s Mika Brzezinski, “the latest of a string of escalating attacks by the president on the national news media.”

* The recommendation by Mike Allen of — the most insidery of all Washington journalists — to “stop going to the White House press briefings.”

* Josh Marshall’s analysis that, though the press has shown courage and enterprise in standing up to Trump, “trying to shame the President or demand he change his behavior” is a futile game. Marshall points to “Trump’s need not only for dominance but unending public displays of dominance.”

Trump’s treatment of the press is really a version of the same game, a set of actions meant to produce the public spectacle of ‘Trump acts; reporters beg.’ ‘Reporters beg and Trump says no.’ Demanding, shaming all amount to trying to force actions which reporters have no ability to compel. That signals weakness. And that’s the point.

With all that as provocation, I want to pull the camera back a bit, and offer these thoughts: Why is this happening?

We are used to candidates who, when they win the nomination, try to bring the party together by embracing those who supported the losers. We are used to nominees who, when they win the White House, try to bring the country together by speaking to voters who did not support them in November. This is normal behavior. This is what we expect from presidents of both parties.

Trump rejects all that. His idea is to deepen the attachment between himself and his core supporters so that nothing can disturb that bond. The substitution of depth (of attachment) for breadth (of appeal) is confusing and disorienting to those who believe in consensus politics. This includes many of our most prominent journalists. They are stunned and confused by this exchange.

Among the consequences is that persuasion drops out of the calculus of success, meaning: Trump is not trying to win the support of anyone who is not naturally allied with him. This is abnormal behavior in an American president. Common expectations for the occupant of the White House simply assume that a case will be made for why the country as a whole should support the person in power. Sitting on high, the press is accustomed to judging how strong or weak that case for support is. Opinion polls provide the proof, especially the president’s approval rating. But if strength of attachment matters more than breadth of appeal, then approval ratings are a misleading metric.

But it’s worse than that. Once you remove persuasion from the equation many things tumble out of place. Plausibility itself becomes superfluous. Adjusting the claims of the White House to any common measure of reality breaks down as a discipline. What matters is the strength of the bond with core supporters, not the ability of the Administration to answer questions, parry doubts, or mount a convincing case for its program. This is one reason that lying has become a White House routine.

And this is why the daily briefing is in such trouble. The whole premise of that event is that the White House ought to make a credible show before reporters because reporters are a rough proxy for the unconvinced. But what if the people in power don’t care to convince the unconvinced? And what if reporters are seen, not as any sort of proxy for the voting public, but as avatars of an elite that has already been put down by the prior year’s election returns?

The field of possibilities widens. Once persuasion drops out of the calculus, journalists seem less threatening as judges and more useful as foils. Peering out over the assembled press corps, the White House briefer has a choice of convenient hate objects. Shall it be Glenn Thrush or Jon Karl today… April Ryan or Hallie Jackson? Those called upon may think themselves empowered to put tough questions to the people in charge, but if the people in charge care only about the reactions of core supporters their task is all too simple: put down the liberal media. An easy win. And the one campaign promise the president seems able to keep.

The whole premise of the daily briefing is that the White House has to grapple with tough questions. That is the test. But what if the White House cares not if it fails this test? More access, more toughness, and more on-camera briefings are no answer to that. This is where we stand today. The Trump government isn’t trying to persuade its doubters. There is no form of toughness that can redress this fact. Forget the briefing. It is already gone. A dead form, killed by the president’s approach to politics. It doesn’t even go out to the country in the way a normal White House communique would. It runs through the press to the president’s core supporters in a kind of closed loop.

Time to start planning for unforeseen events. When all forms of access and all avenues for questioning are choked off, journalism can still thrive. But it needs to become smarter. This is why I have been saying since January: send the interns. Redirect your most experienced people to outside-in reporting. They cannot visit culture war upon you if they don’t know where you are. The press has to become less predictable. And it has to stop volunteering as a hate object.

UPDATE July 1: A reporter in the current White House briefing room responds to what I wrote here, saying he respects the argument but disagrees. He defends the briefing and the importance of being there in the White House. Read what Hunter Walker of Yahoo News has to say. Bonus: The CBC in Canada covers this post.

The post Why the White House daily briefing is in such trouble. appeared first on PressThink.

Read the whole story
4 days ago
Mountain View, California
Share this story

A collection of free coloring books from libraries and museums


Library Coloring Books

Library Coloring Books

Library Coloring Books

Library Coloring Books

A bunch of libraries and museums have banded together for the Color Our Collections campaign, offering up free coloring books that let you color artworks from their collections. Participating institutions include the NYPL, the Biodiversity Heritage Library, the Smithsonian, the New York Botanical Garden, and the Bodleian Libraries at Oxford.

Tags: books   libraries   museums
Read the whole story
10 days ago
Mountain View, California
10 days ago
Share this story

LinkArchiver, a new bot to back up tweeted links


Twitter users who want to ensure that the Wayback Machine has stored a copy of the pages they link to can now sign up with @LinkArchiver to make it happen automatically. @LinkArchiver is the first project I’ve worked on in my 12-week stay at Recurse Center, where I’m learning to be a better programmer.

The idea for @LinkArchiver was suggested by my friend Jacob. I liked it because it was useful, relatively simple, and combined things I knew (Python wrappers for the Twitter API) with things I didn’t (event-based programming, making a process run constantly in the background, and more). I did not expect it to get as enthusiastic a reaction as it has, but that’s also nice.

The entire bot is one short Python script that uses the Twython library to listen to the Twitter User stream API. This is the first of my Twitter bots that is at all “interactive”—every previous bot used the REST APIs to post, but can not engage with things in their timeline or tweeted at them.

That change meant I had to use a slightly different architecture than I’ve used before. Each of my previous bots were small and self-contained scripts that produced a tweet or two each time they run. That design means I can trigger them with a cron job that runs at regular intervals. By contrast, @LinkArchiver runs all the time, listening to its timeline and acting when it needs to. It doesn’t have much interactive behavior—when you tweet at it directly, it can reply with a Wayback link, but that’s it—but learning this kind of structure will enable me to do much more interactive bots in the future.

It also required that I figure out how to “daemonize” the script, so that it could run in the background when I wasn’t connected and restart in case it crashed (or when I restart the computer). I found this aspect surprisingly difficult; it seems like a really basic need, but the documentation for how to do this was not especially easy to find. I host my bots on a Digital Ocean box running Ubuntu, so this script is running as a systemd service. The Digital Ocean documentation and this Reddit tutorial were both very helpful for my figuring it out.

Since launching the bot, I’ve gotten in touch with the folks at the Wayback Machine, and at their request added a custom user-agent. I was worried that the bot would get on their nerves, but they seem to really appreciate it—what a relief. After its first four days online, it’s tracking some 3,400 users and has sent about 25,000 links to the Internet Archive.

Read the whole story
15 days ago
Melbourne, Australia
15 days ago
Mountain View, California
Share this story

prokopetz: thesparkofrevolution: blacktyranitar: thesparkofrev...









Babylonian era problems. (photo via tbc34)

old school hate mail

Imagine how pissed you have to be to engrave a rock

Ok but there was this guy called Ea-nasir who was a total crook and would actually cheat people ought of good copper and sell them shit instead.
The amount of correspondences complaining to and about this guy are HILARIOUS.

Are you telling me we know about a specific guy who lived 5000 years ago, by name, because he was a huge asshole

More like 4000 years ago but yes. Ea-nasir and his dodgy business deals.

And we haven’t even touched on the true hilarity of the situation yet. Consider two additional facts:

  • He wasn’t just into copper trading. There are letters complaining about Ea-nasir’s business practices with respect to everything from kitchenwares to real estate speculation to second-hand clothing. The guy was everywhere.
  • The majority of the surviving correspondences regarding Ea-nasir were recovered from one particular room in a building that is believed to have been Ea-nasir’s own house.

Like, these are clay tablets. They’re bulky, fragile, and difficult to store. They typically weren’t kept long-term unless they contained financial records or other vital information (which is why we have huge reams of financial data about ancient Babylon in spite of how little we know about the actual culture: most of the surviving tablets are commercial inventories, bills of sale, etc.).

But this guy, this Ea-nasir, he kept all of his angry letters - hundreds of them - and meticulously filed and preserved them in a dedicated room in his house. What kind of guy does that?

[ source ]

Okay, but imagine from the other guy’s point of view. You send angry letters about how Ea-nasir shipped you half a ton of subpar copper, and then 3800 years later—

Read the whole story
55 days ago
Melbourne, Australia
56 days ago
Mountain View, California
Share this story

Voting Systems

2 Comments and 8 Shares
Kenneth Arrow hated me because the ordering of my preferences changes based on which voting systems have what level of support. But it tells me a lot about the people I'm going to be voting with!
Read the whole story
57 days ago
Mountain View, California
Share this story
2 public comments
57 days ago
It me
Brooklyn, NY
57 days ago
Kenneth Arrow hated me because the ordering of my preferences changes based on which voting systems have what level of support. But it tells me a lot about the people I'm going to be voting with!

Against Facebook

1 Share

Leads to: Against Facebook: Comparison to Alternatives and Call to ActionHelp Us Find Your Blog (and others)

Note: WordPress seems to be eating line breaks. I hope I have them all fixed at this point.

Epistemic Status: Eliezer Yudkowsky writing the sequences. They sentenced me to twenty years of boredom. Galileo. This army. Chris Christie to Marco Rubio at the debate. OF COURSE! A woman scorned. For great justice. The Fire of a Thousand Suns. Expelling the moneylenders from the Temple. My Name is Susan Ivanova and/or Inigo Montoyo. You killed my father. Prepare to die. Indeed. It’s a trap. Tomfidence. I swear on my honor. End this. I know Kung Fu. Buckle up, Rupert. May the Gods strike me down to Bayes Hell. Compass Rose. A Lannister paying his debts. The line must be drawn here. This far, no farther. They may take our lives, but they will never take our freedom. Those who oppose me likely belong to the other political party. Ball don’t lie. Because someone has to, and no one else will. I’ve always wanted to slay a dragon. Persona!


This post is divided into sections:
1. A model breaking down how Facebook actually works.
2. An experiment with my News Feed.
3. Living with the Algorithm.

4. See First, Facebook’s most friendly feature.
5. Facebook is an evil monopolistic pariah Moloch.
6. Facebook is bad for you and Facebook is ruining your life.
7. Facebook is destroying discourse and the public record.

8. Facebook is out to get you.
A second shorter post will then lay out what I believe is the right allocation of online communication. Some readers will want to skip ahead to that one, and I will understand.
I felt I had to document my explorations and lay out my case, but I trust that most of you already know Facebook is terrible and don’t need to read 7000 words explaining why. If that is you, skip to the comparison to alternatives or the call to action at the end. I won’t blame you.

A Model Breaking Down How Facebook Actually Works


Facebook can be divided into its component features. Some of these features add value to the world. I will start with those, because they form the foundation of the trap. These are the friendly parts of the system, that are your friends. They are not out to get you. If the rest of the system was also not out to get us, or we had it under control, I would use the good and mixed parts more.
The good:


Contact Information


Facebook’s best reason to exist is as a repository of contact information. If you know someone’s name, you have a simple way to request access to their email and their phone number. If you are already friends with them, that information is already waiting for you without having to ask. Effectively we have a phone book that only works at the right times. This is a very good thing.


Event Planner

The Event Planner is quite handy. Note the structure that it uses, because it will contrast with other sections. If you are invited to an event, it is easy to find under events or your notifications, as it should be. If you go to the event page, it prominently contains the key things you need most, allowing you to easily see name, time, location, who is going and details in that order (I would swap details and who is going, but this is a quibble). There is a quick button to show a map. If you want to search for events with similar descriptions, or at the same location, that’s a click away, but it is not forced upon you. Related events are quietly and politely listed on the right side.




The only downside is that there are people who feel it is appropriate to invite hundreds or thousands of people to their event without checking to see if they even live within a few hundred miles or might plausibly be interested. Facebook seems to lower the psychological and logistical barriers to doing this, but also makes it easier to turn an invitation down, without asking people to use an additional similar planning system.
Overall, good stuff, and I wish I felt comfortable using it more.
The bad:


Messenger Service


Facebook’s messenger service is perfectly serviceable in a pinch. I strongly prefer to use other services, because they are not associated with the evil machine, but that is the only real reason (other than Signal’s encryption, or wanting to move to video) this is effectively any different from chatting over text, Skype, Google, WhatsApp, Signal or anything else. On my phone, I use Trillian to unify a whole bunch of such services, which I used to use a lot, but I no longer find this worth bothering with on desktop.




Groups are a good idea. Who doesn’t like groups?


The first problem is that literally anyone on your friends list can add you to any group at any time unless you explicitly block them group by group. This is our first (mild) hint that Facebook might be out to get us. A system that was not out to get us would simply ask us, do you want to join? There would be a button marked “Yes” and a button marked “No.” Instead, the system presumes you want in, so there will be more content to throw at you.


The second problem digs deeper, and is a less-bad version of the problems of the News Feed: The groups are horribly unorganized. All you have is a series of posts you can try to endlessly scroll through. If people want to comment on something, there are unthreaded comments on the posts where it is not obvious what is and isn’t new.


If your goal is something like have the discussions of a Magic team, you’re screwed. You have to constantly go check for new things. Even if you do, you have little confidence that any new thing will be noticed. If there are types of things you care about, you have to scroll through pick them out of the scroll of fully expanded items like this is the Library of Alexandria, scanning for new comments.


Except wait. Even then, you are still screwed. See this thread. 

This means:
You cannot count on the posts being in chronological order.
You cannot count on the posts being in the same order as last time.
There is no depth of search that assures you that you have seen all the posts.
There is no depth of search that assures you that you have seen all the new comments.
Each post you see needs to be carefully scanned for new comments, since the order does not tell you if any comments are new. If you don’t remember every comment on every post, good luck not wasting tons of time.
There is no way to know that your friends have seen a post or comment you make, no matter what procedure your friends commit to doing.
Because Facebook is willing to silently change such rules, other than maybe carefully scanning the entire archive of the group, you cannot count on anything at all, EVER. Even if you did find a solution, you could not assume the solution still worked.


This may sound like a quibble. It is not. When my Magic team Mad Apple teamed up with some youngsters, we agreed to try their method of using a Facebook group for discussion instead of using e-mail. This was a complete and utter disaster. I spent a stupid amount of time checking for new comments, trying to read the comments, trying to see answers to my comments. When I posted things, often I would refer to them and it was obvious others did not know what I was talking about. Eventually I gave up and went back to using email, effectively cutting discussion off with half of my team, because at least I could talk to the other half at all. I did not do well in that tournament.


I even heard the following anecdote this week: “When browsing a group looking for a post, I have even seen the same post multiple times because there was enough time while scrolling for Facebook to change its algorithm.”


How did things get so bad? I have a theory. It goes something like this:


Facebook uses machine learning in an attempt to maximize the number of posts people will view, because they think that ‘number of posts viewed’ is the best way to measure engagement, and determines the number of advertisements they can display. At first glance, this seems reasonable.

They then run an experiment where they compare groups that are in a logical order that stays the same and is predictable, to groups that are not in a logical order and are constantly changing.


Some people respond to this second group by silently missing posts, or by only viewing a subset of posts anyway; those people barely notice any difference. Other people are using groups to actually communicate with other people, and notice. They then feel the need to scroll a lot more, to make sure the chance of missing anything is minimized. They might want to change group platforms, but groups are large and coordination is hard, so by the time some of them actually leave, the algorithm doesn’t think to link it back to the changes that randomized the order of the posts – by now it’s changed things ten more times.


The more the algorithm makes it hard to find things, the more posts people look at. Thus, the algorithm makes finding posts harder and harder to find, intentionally (in a sense) scrambling its system periodically to prevent people from knowing what is going on. If people knew what was going on, they would be able to do something reasonable, and that would be terrible.


To be fair to Facebook, this is not automatically a problem. It is only a problem if you want to reliably communicate with other people. If you do not care to do that, it does not really matter. Thus, if your selected group is “Dank EA Memes” then you could argue that this particular problem does not apply.
The high ad ratio applies.
The problem of ‘you have to look at entire posts and can never look at summarizes’ applies.
The problem of ‘your discussions have no threading’ applies.
The problem of ‘tons of optimization pressure towards distorted metrics that destroy value’ applies.
The problem of ‘Facebook is evil’ still, of course, applies.
The problem of ‘They have made efficient navigation impossible’ though, is one that this type of group can tolerate. I will give them that.
We’ll talk about those other problems in other sections, since they all apply to the News Feed.
Games and Other Side Apps
Technically Facebook still offers games and other side apps, but my understanding is that people have learned not to use them, because they are the actual worst, and for the most part Facebook has learned that everyone has learned this, and quit bothering people on this front. I will at least give the site credit for learning in this case.



The News Feed
The News Feed is the heart of Facebook. When we talk about Facebook, mostly we are talking about the News Feed, because the News Feed is where everything goes. You post something, and then Facebook uses a machine learning based black box algorithm to determine when to show the post and who to show the post to. When composing, you think about the box. When deciding whether to respond, you think about the box. You click boxes all over the place trying to train the algorithm to give you the information and engagement you want, but the box does not care what you think. The box has decided what is best for you, and while it is willing to let you set a few ground rules it has to live by, it is going to do what it thinks is going to addict you to the site and keep you scrolling.


There is one feature that actually kind of works, which is the “See First” option you can select for some people. Facebook will respect that and put their content first, allowing you to (I think) be reasonably confident that if they post, you will have seen it the first time, and see it before other things. That does not give you any reasonable way to keep tabs on ongoing discussions, but it does at least mean you won’t miss anything terribly important right off the bat.


Beyond that, the system does not respond well to training, or at least to my attempts to train it, as this will illustrate.


This is a random sample of my news feed. Before I write the rest of this I pre-commit to cataloging the next 30 things that appear after the ad I just saw (to start at the beginning of a cycle). I will censure anything that seems plausibly sensitive.


1. Nathanial Mark Price was tagged in a photo.
Facebook thinks that when Ben Baker, who I have never heard of, posts a photo containing one of my thousand friends, that I should see this. My attempts to teach Facebook that I could not possibly care less (e.g. actively clicking to hide the last X of these where X is large) do not seem to work. It thinks the problem is Ben Baker, or the problem is Nathanial Mark Price. Neither of them are the problem. Is this pattern really that hard?
Seriously, if anyone understands why a machine learning algorithm can’t figure out that some people generally don’t like to see photos of their friends that are posted by people who are not their friends, when those people are explicitly labeling examples for it, then I can only conclude that the algorithm does not want to figure this out. If there is an actual reason why this might be hard, please comment.

2. Diablo: In case you missed it: Patch 2.5.0 is live!
Useless, since I finished playing a long time ago, but I did follow them at one point when I was trying to use the site. Or at least, I’m assuming that this is true. All right, my bad, I’ll unfollow. Oh wait, there is no unfollow button? So that means either I wasn’t following and they put this here anyway, in which case either this was an ad and pretended not to be, it actively thinks I would want to know about a patch to a game I bought several years ago (I’ll give it credit for knowing I own Diablo III), or I was following and they didn’t give me an unfollow option. Instead I chose to hide all posts from Diablo, so if they announce Diablo IV, I’ll just have to figure that out one of twenty other ways I’d learn about it. I can live with that.

3. John Stolzmann was tagged in this. (This is a photo and video by Beryl Cahapay, who I have never heard of, called ‘Day at the races’).
Facebook seems to believe that being tagged in a photo is an example of a post being overqualified to be shown to me. All you really need is that one of my friends was tagged. That friend being John Stolzmann. Who? Since I did not actually remember who he was before I Googled, I unfollowed John Stolzmann, although normally I prefer to wait until the person actually posts something before doing that.

4. Nicole Patrice was tagged in a photo.
Note that the photo does not, in fact, contain Nicole Patrice. The photo was posted by Nora Maccoby Hathaway, who is not even listed as having mutual friends with me when I hover over her name. Great filtering, guys.

5. An actual post by a friend! Giego Calerio says: “Given cost 3.5 G-happy-mo’s…what’s the Exp life gain of freezing bone marrow now?”
I decline to click on the link because if I do that, Facebook’s algorithm might get the wrong idea, but I’m not sure how it could get much worse, so maybe I worry too much. Giego is at least asking a valid question. He does seem to be making some bad calculations (e.g. he is treating all hours of life as equal, when youthful hours should be treated as more valuable than later hours, from a fun perspective) and is considering a surgical procedure where his expected ROI is 3.6 months of life in exchange for 3.5 months lost, which to him says “obvious yes” and to me says “obvious no” because you don’t do things like let someone do a costly surgical procedure unless you think you are getting massive, massive gains due to model error, risk/reward of being right/wrong, precautionary principle and other similar concerns. It is certainly not a ‘no brainer.’ But I don’t want to signal boost when someone is being Wrong On The Internet, and also I don’t comment on Facebook, so I say nothing. Except here.

6. Hearthstone Ad
All right, I basically never play anymore, but good choice. Points.

7. Tomoharu Saito says in Japanese, according to the translation: “There’s an American GP in the next camp.”
I think something was lost in translation.

8. Tomoharu Saito says in Japanese, according to the translation: “Rishi, I’m too tired, w. I’m tired, w. I got a barista from RI.”
Either the man is a poet and doesn’t even know it, or more likely Facebook needs to make a deal with Google Translate. Either way, looks like I can’t follow people posting in Japanese.

9. Adrian Sullivan posts he “is now contemplating a new Busta song featuring a zen-like feel, “Haiko ‘couplets’”, with Russiagate and Michael Flynn as its subject!
Go for it?

10. Ferret Steinmetz notes that “It is now officially impossible to preorder Mass Effect Andromeda”
Which makes sense since it was released last Tuesday.


11. Arthur Brietman posts something about shipping apps I saw on Twitter and I don’t know enough technical details to grok.
I’m sure it is thought out, though.
12. Kamikoto Ad for a stainless steel knife at about 85% off!
Swing and a miss.
13. Michael Blume asks: “I think I’m starting to be out of touch – can anyone tell me why people keep photoshopping the same crying person onto Paul Ryan?”
Can’t help you, sorry.
14. Tudor Boloni links to a Twitter post that links to a paper, saying “it’s hard to interpret.”
Oh yeah, that guy. I really should unfollow him. Done. Paper could in theory have been interesting I guess.
15. Robin Hanson posts: Ancient Hebrews didn’t believe in immortal soul, nor do most Christian theologians/philosophers today.
Saw that earlier on Twitter, which makes sense, he likely cross-posts everything. I put him in the See First category anyway just in case since his Twitter posts on average are very good and perhaps the discussions are good here, or some posts are not cross-posted. I guess Points.
16. Mandy Souza posted two updates. One is ‘lingerie model reveals truth about photoshoots by taking ‘real’ photos at home.’ The second is from Thug Life Videos.
I admit that the video was mildly amusing. The article is obvious clickbait. Hid them both.
17. Ferrett Steinmetz posts “Perfect for all your Vegan Chewbacca” needs and a picture.
OK then. Told it to show less from Twitter.
18. Nate Heiss shared The Verge’s video. It seems Elon Musk’s solar glass roofs can be ordered next month.
So, congrats, Elon?
19. Mack Weldon Ad for airflow enhanced underwear.
I’ll get right on that. One for three.


20. Brian-David Marshall thinks he has found the best ice cream scoop for hand to hand combat.
You can always count on Brian for news you can use.


21. Michael Blume retweeting Sam Bowman saying: My politics in a tweet: Use free markets to create as much wealth as possible and redistribute some of it afterwards to help unlucky people.
That idea sounds great. Glad he’s endorsing it, I suppose.



22. Phil Robinson wishes Happy 113th Birthday to Joseph Campbell.
And a very happy unbirthday to you, sir.



23. Teddy Morrow started a tournament on [some poker app]
How obnoxious. Hide all posts from the app, please.



24. Jelger Wiegersma is 6-3 at GP Orlando, shares his deck.
Points. I’m guessing David Williams gave him a B+ on the photo?


25. Teddy Morrow spun the Mega Bonus wheel on [same poker app as #23]
That’s even more obnoxious.



26. “Remarkable” add of a tablet you can write on like paper.
I guess if you gotta give me ads that’s not obnoxious.



27. Rob Zahra posts a link to “People Are Really Conflicted About This Nude Claymation Video” and says “it’s not sketchy…”
I choose to remain unconflicted.



28. Mike Turian posts: At the Father Daughter dance! Stopping for a quick arts and crafts break!
This one made me smile. Points.



29. Adrian Sullivan is suddenly craving grilled cheese…
He’s in Wisconsin, so I think this will work itself out.



30. Ron Foster posts photo and says “Sculpture seen in downtown Kirkland. Look familiar, Brian David-Marshall?”



The good news is I do remember who Ron Foster is. That’s all of the good news.
So let’s add that up:
Number of posts that got ‘points’: 3, or 10%. I could argue that this should be as high as 4 or 13.3%.
Number of posts I would have regretted missing or provided meaningful news about someone: 0
Number of posts that attempted to provide intellectual value: 4 if you want to be really generous.
Number of posts that provided intellectual value: 0 or 1 depending on if you count duplication
Number of ads: 3 or 4, hard to tell. Not too bad?
Number of posts that 100% I should never see but can’t figure out how to stop: 7 out of 27 non-ads (so 1/3 of posts are this or ads).


That went… better than I would have expected given my other experiences, but I am attempting to be a good and objective scientist, and will accept the sample.
Now think about whether you see that list and think “I want to take something like that, and hide our community discourse inside a list like that, and leave what to display up to a black box algorithm that is maximizing ‘interactions’!”

Great idea, everyone.


Living with the Algorithm


Now that we have seen the algorithm in detail a bit, it is time to ask how the algorithm actually works and what it does. Since it is constantly changing this is not an easy problem. One can do this by observing the results, by theorizing, or by reading up on the problem. My strategy here will be a mix of all three. I’ve already done some theorizing with respect to groups. Similar logic will apply here. I have also taken a sample of the feed and analyzed it, and generally looked through a large number of posts looking for other patterns. This is also where I stopped writing in order to Google up some articles on how the algorithm works, in the hopes of getting a more complete picture that way.
First principles say, and both reading and casual observation confirm, that Facebook’s primary tool will be to use interactions. If you interact with a post, that is good. That means engagement. If you do not interact with a post, that is bad, it means you did not engage. Thus, posts are rewarded if they create interaction, punished if they do not.



Time for another experiment! Let’s see how big this effect is. For the next 20 posts, excluding advertisements since those are paid for, let’s record the number of interactions (likes/reactions plus comments) and then compare those 30 posts to the 6th-10th posts in the same person’s timeline (excluding the original post, and only by the person in question, that second requirement added after I realized other people’s stuff appears in timelines a bunch); the delay is so that people have time to react and new posts are not overly punished by comparison. Note that in the first experiment, the feed was close to ‘looping around’ to the start of another session, which is why it turned out to ‘improve’ somewhat in the later half, and this is unlikely to be the case here.
While running the experiment, let’s also rate posts by how happy I am to have seen them (on an arbitrary scale of 0 means I would not have missed at all but I am not actively unhappy to have seen it, -5 means OMG my eyes or fake news, +10 means big win, +20 means they got married or something. System 1 has final say.


Our prediction is that the interaction numbers will be higher, but with large uncertainty as to how much higher, and that a similar thing will happen for ratings. Note that whose posts are shown is also not random, and we are intentionally taking that out of the equation for now, so sorting is much stronger than this would suggest on its own.



Since I will be evaluating entire timelines, I will not include names. If two posts come from the same person, the second will be skipped.
Also excluding what I consider ‘Facebook spam’ stuff like ‘reacted to a post.’ Note that the average post in the timeline (even without ads) is lower than the average rating this system will generate, but it is not hugely lower.


Post 1: 15 interactions. Rating 0. Mildly amusing tweet. Was #8 in timeline.
Timeline posts 6-10: 6 (-3), 1 (-3), 24 (+2), 9 (0), 5 (-3). Negatives here come from person’s need to do constant political commentary.
Post 2: 2 interactions. Rating +1. Mildly amusing video. Was #9 in timeline.
Timeline posts 6-10: 5 (-1), 1 (1), 4 (0), 22 (+2), 2 (-1). Person mostly posts little things intended to mildly amuse.
Post 3: 161 Interactions. Rating +3. Personal message related to actual life event. Was after #10 in timeline.
Timeline posts 6-10: 50 (-2), 34 (+1), 40 (0), 15 (0), 15 (0). Someone figured out how to get people engaged!
Post 4: 9 Interactions. Rating -5. Fake Magic spoiler.
Edit: Well, it is April 1 as I write this. But still. Not cool.
Timeline posts 6-10: 11 (+2), 78 (0), 34 (+1), 39 (0), 9 (-1). Mostly Magic content.
Post 5: 0 interactions. Rating 0. Wikipedia link. Was beyond #10.
Timeline posts 6-10: 0 (0), 5 (+5 for actual intellectual interest), 3 (+1), 1 (+4 again!), 18 (+2).
He posts links to science and philosophy stuff I would otherwise miss and seem worth investigating! No way I would have known if I hadn’t looked at the timeline. Promoted him to See First.
Post 6: 101 interactions. Rating +2. Important life PSA (for others who need it, I did not need it). Was beyond #10.
Timeline posts 6-10: 25 (0), 110 (+1), 28 (0), 70 (+3), 85 (0).
Person lives in The Bay, uses Facebook largely to coordinate events. If I was local and looking to hang out, this would be very good, but I am more of a thousands-of-miles-away person who has met her once.
Post 7: 95 Interactions. Rating +1. Magic preview card. Was before #6.
Posts 6-10. 14 (0), 61 (0), 66 (0), 24 (+3), 42 (+1).
Posts links to his Magic articles and activities.
Post 8: 48 Interactions. Rating -1. Was beyond #10.
3 (-1), 24 (0), 215 (+2), 159 (+1), 30 (+2).
Has interests that do not overlap with mine, also some that do.
Post 9: 14 Interactions. Rating -1. Was #10.
Posts 6-10: 4 (1), 3 (1), 13 (0), 4 (0), 2 (0).
Shares AI-related articles. They do not seem like they are worth reading.
Post 10: 12 Interactions. Rating +1. Was beyond #10.
Posts 6-10: 21 (0), 10 (+3 because F*** California), 21 (+1), 17 (+2), 39 (+3).
Post 11: 51 Interactions. Rating +1. Was #5.
Posts 6-10: 6 (+1), 7 (0), 9 (+1), 19 (+3), 12 (-1).
Placing bets!
Post 12: 15 Interactions. Rating +1. Was beyond #10.
Posts 6-10: 38 (+3), 51 (0), 30 (+1), 12 (0), 10 (0).
Always the jokester.
Post 13: 38 Interactions. Rating -1. Was beyond #10.
Posts 6-10: 9 (0), 44 (-3), 8 (-1), 15 (0), 21 (+1).
Confident opinions, confidently held. Negative is for political echo chambering.
Post 14: 4 Interactions. 0 Rating. Was after #10.
0 (-1), 5 (0), 11 (0), 2 (0), 2 (0).
No interest overlap. Got an unfollow.
Post 15: 6 Interactions. 0 Rating. Was after #10.
14 (-1), 10 (0), 2 (-3), 2 (-3), 10 (-1).
Political screaming.
Post 16: 3 Interactions. 0 Rating. Was #7.
1 (-5), 6 (0), 1 (-3), 2 (-3), 2 (-1).
Video guy.
Post 17: 7 Interactions. 0 Rating. Was #4.
9 (-1), 12 (0), 18 (0), 8 (0), 1 (-2).
A friend who is a lot smarter in person than they appear online, including about politics. Sometimes in these situations I wonder which one is real…
Post 18: 15 Interactions. 0 Rating. Was beyond #10.
4 (0), 8 (+2), 23 (0), 26 (0), 20 (0).
Magic related.
Post 19: 1 Interaction. -1 Rating. Was beyond #10.
2 (-1), 1 (-1), 0 (0), 0 (-1), 0 (-5).
I’ll just say this one is basically on me.
Post 20: 16 Interactions. +1 Rating. Was #6.
10 (+1), 0 (0), 2 (0), 4 (0), 2 (0).



Before examining the data statistically, it seems like the algorithm is not adding much value. It certainly was not adding as much value as some simple heuristics would have, depending on how easy it would be to determine post types. If you wanted to predict interactions, that too seems pretty easy, although I wasn’t studying this so it didn’t show up in the data: The big numbers all revolve around a few types of posts.
If nothing else, the algorithm of “choose all the posts of the top X people” seems like it would crush the algorithm if combined with the right amount of exploration, even if you did nothing else to improve it.


The obvious counter-argument is that my refusal to interact with Facebook, other than to tell it what I do not want to see, is preventing the algorithm from getting the data it needs to operate correctly. This seems like a reasonable objection to why the system isn’t better in my case, but it should still be better than random or better than blindly obvious heuristic rules. It certainly does not take away my curiosity as to what the system does in this situation. In addition, Facebook is known to gather information like how long one takes to read a post, so the data available should still be rather rich.


Some Basic Statistics


The average rating of a post was 0.07 if it was not selected by the algorithm, or 0.1 if it was. That’s not a zero effect, but it is a damn small one. The standard deviation of all scores was 1.67 and the difference in average rating here was 0.03, also known as 3% of the difference between “my life is identical to not seeing this post except for the loss of time” (score of 0) and “I found this slightly amusing/annoying” (score of 1 or -1).
The number of interactions was different: 30.65 for selected stories versus 20.33 for non-selected, versus a standard deviation of 33.65. If we use a log scale, we find 2.66 vs. 2.34, with a standard deviation of 1.25, so this effect is not concentrated too much in very large or very small numbers.


What happens if we use the algorithm “show the 20 posts with the most interactions, from anyone”? We see 20 posts with a mean of 80 interactions versus 10 for unselected, and we see a much more dramatic rating differential: 0.6 average rating for selected posts, -0.03 for unselected! At first glance, it looks like not only is the algorithm not doing much work, if you control for number of interactions, it is doing negative work! Even if you need to take half your posts from the non-interaction section in order to figure out what posts people interact with, that’s still a much better plan.


What about if we use “show the top interaction-count post from each of the 20 people”? Now the posts shown will average 51 interactions (vs. 16 for other posts), and still have an 0.6 average rating. That is an even stronger result, and it makes sense, because different people have different friend groups and tendency for people to interact with their posts.


It is also worth noting that within-person ratings were highly correlated, which implies that some combination of the system and my own filters on top of the system needs to get rid of more people who do not provide value, and put more focus on the ones that do. This is a slow process, as like many of us, I have a lot of Facebook friends and they need to be tuned one by one.


Whenever you have a complex multi-factor algorithm, the first step should be to test it against simple baselines and see if it can at least beat those. Here, the system has failed to do that.


Reading Up


I started my reading with this story. It confirms the basic elements of the system, and includes such gems as:


The news feed algorithm had blind spots that Facebook’s data scientists couldn’t have identified on their own. It took a different kind of data—qualitative human feedback—to begin to fill them in.


Really. You don’t say! What is worth noting is not that the algorithm had blind spots in the absence of qualitative human feedback. What is worth noting is that this is something that had to be realized by Facebook as some sort of insight. How could one have presumed this to be false?



This may prove to be part of the problem:

Facebook’s data scientists were aware that a small proportion of users—5 percent—were doing 85 percent of the hiding. When Facebook dug deeper, it found that a small subset of those 5 percent were hiding almost every story they saw—even ones they had liked and commented on. For these “superhiders,” it turned out, hiding a story didn’t mean they disliked it; it was simply their way of marking the post “read,” like archiving a message in Gmail.

Thus, even though hiding is usually a strong negative signal, if you cross a certain threshold, the system now thinks you are no longer expressing an opinion. Or maybe it is this gem that follows soon thereafter:

Intricate as it is, the news feed algorithm does not attempt to individually model each user’s behavior. It treats your likes as identical in value to mine, and the same is true of our hides.

Dude. You. Had. One. Job.
They also do not understand how impact works:

Even then, Facebook can’t be sure that the change won’t have some subtle, longer-term effect that it had failed to anticipate. To guard against this, it maintains a “holdout group”—a small proportion of users who don’t see the change for weeks or months after the rest of us.

Facebook is an integrated system. Keeping a small number of people on the old system isn’t quite worthless, but if the changes you make lead to long term effects that destroy the Facebook ecosystem, or damage the world at large, a reserve will not prevent this.
Thus we get ‘insights’ like this:

The algorithm is still the driving force behind the ranking of posts in your feed. But Facebook is increasingly giving users the ability to fine-tune their own feeds—a level of control it had long resisted as onerous and unnecessary. Facebook has spent seven years working on improving its ranking algorithm, Mosseri says. It has machine-learning wizards developing logistic regressions to interpret how users’ past behavior predicts what posts they’re likely to engage with in the future. “We could spend 10 more years—and we will—trying to improve those [machine-learning techniques],” Mosseri says. “But you can get a lot of value right now just by simply asking someone: ‘What do you want to see? What do you not want to see? Which friends do you always want to see at the top of your feed?’ ”

Yes, it turns out that people actually want to see posts by some friends more than other friends, and it only took years for them to figure out that this might be a good idea. People have strong, simple preferences if you let them express those preferences. The stupidity here is mind boggling enough that it seems hard for it to be unintentional. The reason why they do not let you fine-tune the news feed is not because doing so would not make the feed better. The reason why is because it would make the feed better for you, and they are invested in making it worse for you instead. Everyone knows that a proper Skinner Box needs to avoid giving away too many rewards if you want to keep people pressing the buttons and viewing the advertisements.



Facebook’s case is that this is not what they are up to, because they understand that in the long term people realize they are wasting their lives if they don’t have good experiences doing so:

There’s a potential downside, however, to giving users this sort of control: What if they’re mistaken, as humans often are, about what they really want to see? What if Facebook’s database of our online behaviors really did know us better, at least in some ways, than we knew ourselves? Could giving people the news feed they say they want actually make it less addictive than it was before?
Mosseri tells me he’s not particularly worried about that. The data so far, he explains, suggest that placing more weight on surveys and giving users more options have led to an increase in overall engagement and time spent on the site. While the two goals may seem to be in tension in the short term, “We find that qualitative improvements to the news feed look like they correlate with long-term engagement.”

The author notes that “That may be a happy coincidence if it continues to hold true” which I think is not nearly cynical enough. There is the issue of whether the long-term goals are indeed aligned, but there is the bigger problem that even if Facebook wants in some sense to focus on the long term, the tools it has been given push all parties away from doing so.


What the Algorithm Effectively Does


The algorithm attempts to find those things that promote interaction. It then rewards them with a signal boost, allowing the best to go viral. In response, people got to work optimizing their posts so that Facebook would predict people would want to interact with them, and so that people would in fact interact with them, so that others would see their posts. Professional and amateur alike started caring about approximations of metrics and got to work creating de facto clickbait and invoking Goodheart’s Law.


There is some attempt by Facebook to define interaction in good ways, such as measuring how long you spend off site on articles you click on, and there is some attempt to crack down on the worst offenders. Links to spam sites filled with advertising are being kept down as best they can. Obvious fake news gets struck down some of the time, and so on.

However, there is still a double amplification effect going on here. I choose who I want to follow based on what I think I will like, and then Facebook subfilters that based on what it thinks I will like. No matter how much Facebook wants to stay in control of things, at a minimum I can choose who my friends/follows are on the site. I will attempt to create a mix that balances short term payoff with long term payoff, safe with risky, light with dark. Facebook will then take that mix, and do its best to return the most addictive stuff it can find. I can observe this and ideally adjust, creating a pool of potential posts that is full of deep stuff with only a small number of cute videos, and perhaps that will work, but no one is going to make it easy for me.


Everything anyone write gets warped by worrying about this. Those who rely on Facebook then get triply filtered. They choose who to follow, those people choose what to share based on what is likely to get traction (as Josh says on Crazy Ex-Girlfriend, got to keep up the LPPs, or likes per post), and then Facebook filters with the algorithm.

See First, Facebook’s Most Friendly Feature

If you must use Facebook to follow certain close friends and family, and chances are that you feel that you do need to do this, there is a solution: See First. See First is a recently introduced feature that turns the news feed from something that is out to get you into something that is not out to get you. This is because

Facebook is an Evil Monopolistic Pariah Moloch


When I think about posting anything, anywhere on the internet, such as here on this blog, I have to worry about what the algorithm will say. If someone shares my post on Facebook, will anyone see it? Will then comment about it?


Then, people comment on Facebook instead of commenting on your post, in order to help ‘signal boost’ the share, which then leads to more comments being on the share. The majority of all discussion of this blog takes place on Facebook right now. The conversation becomes fractured, impossible to find and hard to follow, and often in a place the author does not even know about. We are forced into this ecosystem of constantly checking Facebook in order to have a normal conversation even if we never post anything to Facebook in any way at all.


In the long term, this means that Facebook ends up effectively hosting all the content, controlling what we post, how we discuss it, who sees what information, what memes spread and which ones die. It does this in the service of Moloch rather than trying to make life better for anyone, slowly warping us to value only what it values. Meanwhile, we are then forced to endure endless piles of junk in order to have any hopes of seeing what is going to or what any of our friends are doing or talking about.
Well played Facebook, I guess? Very bad for the rest of us. We cannot permit this to continue.


Facebook is Bad for You and Is Ruining Your Life


I could rattle off a bunch of links, but there is no need. I was going to say that this is the most recent study I have seen and it in turn links back to previous research. Then today I saw this one. I have not examined any of them for rigor, but would welcome others to share their findings if they do examine them. Either way, my opinion here is not due to research. My opinion is due to witnessing myself and others interact with Facebook, and also the opinion all of those people have about those interactions.


Without exception, everyone who uses Facebook regularly, who I have asked, admits that they spend too much time on Facebook. They admit that time is unproductive and they really should be doing something else, but Facebook is addictive and a way to kill time. They agree that it is making their friendships lower quality, their social interactions and discourse worse, but they feel trapped by the equilibrium that everyone else uses Facebook, and that it is there and always available. If anything is on Facebook and they do not see it, they are blameworthy. People still assume I have seen things that were on Facebook until I remind them that I don’t use it. Facebook then hides those morsels of usefulness inside a giant shell of wastes-of-time that you are forced to wade through, creating a Skinner Box. Fundamentally, Facebook is out to get you.


Facebook warps our social lives around its parameters rather than what we actually care about, and wastes time better spent on other things. That is not to discount its value as a way to organize events, share contact information, as a messenger service, or the advantages of being able to stay in touch. That is to point out that the cost of using that last one is that it does a bad job of it and will incidentally ruin your life.

Facebook is Destroying Discourse and the Public Record


Most things I read on the internet are public. When something is public, others can repost it, extend off it, comment upon it and refer back to it. The post becomes part of our collective knowledge and wisdom, and we can make progress. The best thing about many blogs is that they have laid the foundations of the author’s world view, so Scott Alexander can pepper his work with links back to old works without having to repeat himself, and if someone wants to soak up his writing there is an archive to read. When something is especially interesting, I can link or respond to that interesting thing, and see the responses and links from others.


I can’t deny that most words posted to the internet are not great discourse, but some of them are, and those are a worldwide treasure that grows by the day. When we take our conversations to the semi-private realm of Facebook, we deny the world and even our friends that privilege. I have seen a number of high quality posts to Facebook that I would like to link to or build upon, but I cannot, because that is not how Facebook works, and their implementation of comments is rather bad for extensive discussions.


When we look back a few years from now, we will not remember what was posted to Facebook. It will be as if such things never existed. That is fine for posting what you ate for lunch or coordinating a weekend trip to the ballgame, but we need to keep important things where they can be shared and preserved. It is the internet version of The Gift We Give Tomorrow.



Facebook is Out To Get You



Some things in the world are fundamentally out to get you. They are defecting, seeking to extract resources at your expense. Fees are hidden. Extra options you do not want are foisted upon you unless you fight back. The service is made intentionally worse, forcing you to pay to make it less worse. Often you must search carefully to get the least bad deals. The product is not what they claim it is, or is only the same in a technical sense. The things you want are buried underneath lots of stuff you don’t want. Everything you do is used as data and an opportunity to sell you something, rather than an opportunity to help you.



When you deal with something that is out to get you, you know it in your gut. Your brain cannot relax, for you must constantly be on the look out for tricks and traps both obvious and subtle. You can’t help but notice that everything is part of some sort of scheme. You wish you could simply walk away, but either you are already bought in or there is something here that you can’t get elsewhere, and you are stuck.



Their goal is for you not to notice they are out to get you, to blind you from the truth. You can feel it when you go to work. When you go to church. When you pay your taxes. It is the face of both bad government and bad capitalism. When you listen to a political speech, you feel it. When you deal with your wireless or cable company, you feel it. When you go to the car dealership, you feel it. It’s a trap.



Most things that are out to get you are only out to get you for a limited amount. If you are all right with being got for that amount, you can lower your defenses and relax, and you will be in a cooperative world, because they have what they came for. The restaurant wants you to overpay for wine and dessert but it is not trying to take your house. Sometimes that is the right choice, as the price can be small and one must enjoy life.



The art of deciding when to act as if someone or something is out to get you, and when to sit back and relax, is both more complex and much more important than people realize. Most people are too reluctant to enter this mode, but others are too eager, and everyone makes mistakes. I intend to address this in more depth in a future post, and ideally that one would go first, but I want to get this one out there without further delay.



If you remember one thing from this post, remember this: Facebook is out to get you. Big time.



Facebook wants your entire life. It wants you to spend every spare moment scrolling through your feed and your groups, liking posts and checking for comments, until it controls the entire internet. This is the future Facebook wants.



Fight back.

Read the whole story
67 days ago
Mountain View, California
Share this story
Next Page of Stories