Feed readers
Automated content aggregation for an internet designed to inform you rather than distract you
June 29, 2016 — April 26, 2024
Upon the efficient consumption and summarising of news from around the world.
Remember feeds? From when we thought the internet would provide us timely, pertinent information from around the world on our topics of interest? When our information streams were not about your aunt’s conspiracy theory memes on a social media feed, but curated lists of expert opinion?
No? Did you miss that bit of internet discussion? Perhaps a picture best explains it in that case.
I have been told to do this through Twitter or Facebook, but… no. Those are systems designed to waste time with stupid distractions in order to benefit someone else. Facebook is informative in the same way that thumb sucking is nourishing. Telling me to use someone’s social website to gain information is like telling me to play poker machines to fix my financial troubles. Stop that.
Contrarily, I would like to find ways to summarize and condense information to save time for myself. That is what feeds were designed for. New to this game? You know what podcasts are? Podcasts are a type of feed. An audio feed. If I care about news articles and Tumblr posts and whatever, not just audio, then I can still use feeds, albeit feeds of text instead of feeds of audio. Any website can have a feed. Many do.
Remember when we thought the web would be a useful tool for researching and learning, and that automated research assistants would trawl the web for us? RSS Feeds were often discussed as a piece of that machine: Little updates dripped from the web, to be sliced, diced, prioritised and analysed by our software to keep us aware of… whatever.
Feeds in their current form, as useful and time-saving as they are, are not the apotheosis of information retrieval. AFAICT they were always intended to be a part of a larger infrastructure of automated knowledge classification and discovery and analysis, possibly of community sharing and curating.
This higher level, the analysis, has not eventuated, at least not as any kind of technical standard. Most feed readers don’t do much fancy analysis or triage, they just give you a list of new items ordered by date. Many people make a living sifting feed wheat from feed chaff. This is what we called “journalism”. Services like Canopy or Pinterest or keen which do automatic moderation might be useful, but it is not so common.
Still, whatever. As they are, feed readers work and they are better than browsing to the same page and pressing “refresh” constantly.
Feeds are mourned and missing from certain fancy modern blogs. Read Anil Dash on The lost infrastructure of social media.
Pace Anil, feeds are alive. Feeds are available for, for example, Medium, much as that site tries to distance itself from the normal web. Anil Dash’s Medium feed, for example, is https://medium.com/feed/@anildash.
Moreover, in my field, feeds are more useful than ever. In academia we occupy different slopes of the hype curve. Academics have belatedly caught up on the existence of feeds to the point that specialist blogs are having, IMO, a golden age. Perhaps because getting a PhD is a giant PITA, the barrier for entry to a blog seems trivial by comparison, so a lot of PhD people produce a lot of high-quality content. I think academics are enjoying the people in the machine phase.
Want to get started? Why not try the sources that I use in my feed reader? They are all available on my blogroll.
Bonus reading:
- What is a feed? (a.k.a. RSS)
- Yair Rosenberg, It’s time to take back control of what we read on the internet — beginner’s guide to feeds as DIY internet
- see also indyweb
1 Feed discovery
- FeedLand: “The idea is to create a small creative community of people who love to share what they learn. We are not aiming to replace feed readers.”
- feedle—It’s a world of feeds!
2 Feed readers
How to get those feeds? Why, an app! Either a web app, or an app like your grandaddy used to use.
2.1 Fraidycat
fraidycat is a desktop app or browser extension for Firefox or Chrome, with a remit to be an unapologetic passion project in an area depressingly dominated by SEO types. Has a novel UX design, by a novel piece of internet, Kicks Condor.
I use it to follow people (hundreds) on whatever platform they choose - Twitter, a blog, YouTube, even on a public TiddlyWiki.
Open source.
On that UX thing,
There is no news feed. Rather than showing you a massive inbox of new posts to sort through, you see a list of recently active individuals. No one can noisily take over this page, since every follow has a summary that takes up a mere two lines.
2.2 Feedly
feedly is the current boss, and the one that I use. Targets commercial users, like web “community managers” or marketing types, but it mostly usable despite that. Probably works for humans too. This is how you would subscribe to my site in Feedly. Point of friction: the internal feedback mechanism has the tic that it is constantly asking me if an article is about “leadership” or not. The thought of who would comb the internet all day long and desperately try to optimise the efficiency with which they can find articles about leadership, this fills me with gnawing dread.
2.3 Newsblur
Newsblur is a quirky option that I used for a while before the interface annoyed me. For me, its user interface is in the uncanny valley between radical UI redesign, and poor reimplementation of the corporate standard, but this is by no means a universal opinion.
The UI defies the last 10 years of user interface conventions, which is confusing, but it works and is cheap (and in fact has an open source app you can self-host). This is how you would subscribe to my site in Newsblur
2.4 yarr
nkanaev/yarr: yet another rss reader
yarr (yet another rss reader) is a web-based feed aggregator which can be used both as a desktop application and a personal self-hosted server.
It is written in Go with the frontend in Vue.js. The storage is backed by SQLite.
2.5 Inoreader
Inoreader seems popular amongst readers of this blog. I have not used it myself, but thanks for all your custom, Inoreader users. Care to share why you like it?
2.6 Feeder
Feeder is a browser extension/site/app that reads feeds that I have not used but also produces a lot of the traffic of this blog. (Feeder fans: speak up!)
2.7 The Old Reader
The old reader reads feeds and this includes activity updates for people you follow on social media. Not sure if that is the worst or best of all worlds. I presume the name is a tribute to the fact that this technology is pretty good despite the hype curve moving on to coil about other things?
2.8 Feedbin
feedbin is also a thing. Matt Webb recommends it because it has an easy email-to-feed gateway. USD5/month.
2.9 Bazqux
BazQux Reader (USD30/year) specialises in “no bullshit” branding and professional usage efficiency marketing.
2.10 Netnewswire
NetNewsWire: Free and Open Source RSS Reader for Mac and iOS
A feed reader client, which synchronises feed state via iCloud or feedbin, feedly, inoreader, newsblur, the old reader, bazqux, and freshrss and possibly other services.
Most people can stop reading here.
3 Doing things with feeds
3.1 RSS Bridge
A feed utility script that does lots of processing of feeds.
3.2 Generic web services
IFTTT, Zapier etc can do things with feeds.
4 Plugging in to the Fediverse
Very popular. e.g. mastofeeder plugs RSSeeds into the Fediverse ecosystem.
This is a simple Mastodon/ActivityPub server that has a virtual
@website@mastofeeder.comuser for every RSS feed in the Internet. Just search for your favourite RSS-enabled website from Mastodon’s search and follow the user! All RSS items will be posted as toots.
The other direction works too apparently see here
4.1 Creating feeds from sites that don’t have them
fraidycat does this for Twitter, Instagram, Reddit, SoundCloud and Twitch. So does rssbox for a slightly different selection of sites.
Feedity generates feeds from sites that don’t understand content aggregators.
More generally, web scraping tools can do this. For example, Scrapy whose companion project scrapy-rss converts weird sites into RSS.
Newsletter/RSS gateway NewsletterHunt, e.g. here is, e.g. Matt Levin’s Money Stuff
5 Bonus time: DIY feed reader servers
If you want to get more indy/private or have a distaste for the pre-packaged, you can run your own feed reader server. I will run my own server software if the application is compelling enough, but let us consider the costs. Let’s say between backups, security issues, confusing DNS failures etc, that’s 8 hours per year of miscellaneous computer wrangling, best case, and more hours if you have complicated things like running some multi-user enterprisey database to store data. It is hard to imagine that cost being worth it for internet distracting.1
- FreshRSS, a free, self-hostable feeds aggregator is a long-lived and popular one, required no database. Dockerized or tarball install.
- miniflux is open-source/DIY, but also offers a hosted version for $15/year.
- stringer looks like a nice little ruby app but needs postgresql. Bloat. ⚠️
- selfoss is a PHP/SQLite self-hosted feed reader
- tinytinyrss is the original “minimalist” RSS reader; it still needs more databases than is sensible.
- fever is a weird commercial (USD30) application that you host on your own server. It claims to learn your information preferences, which could be cool. But I cannot be arsed installing some database-wanting app with suspiciously antique language requirements (PHP3) that also costs money to try, so I will never know.
Footnotes
Why people insist on running enterprise databases run apps such as this is an ongoing mystery to me. The capacity to scale to many users is nice, I suppose, but by that logic everyone should drive everywhere in a school bus.↩︎