I revamped the design of my website a bit over the last weeks. I’m quite happy with it, so you may want to read this issue on the web.
Also, pardon my French German in the title, but I don’t know a translation that captures the essence of the word Denkzwerge quite like the original.
Before we start with our regular programming, here are
Updates from the Department of Facepalms
First, Marc Andreessen published the world’s worst meta bad take.
It’s long. It’s badly written. It feels like Andreessen dictated it into ChatGPT while being trapped at Burning Man. It makes some absolutely wild statements without any efforts to back them up. It quotes Filippo Marinetti, notable proto-fascist and OG techno-optimist. Basically, it is the 30,000 word version of the «This is fine» meme.
In Why can’t our tech billionaires learn anything new? Dave Karpf pointedly analyses what feels so off about the richest persons in the world crying that the rest of us don’t applaud everything they do anymore.
The most powerful people in the world (people like Andreessen!) are optimists. And therein lies the problem: Look around. Their optimism has not helped matters much. The sort of technological optimism that Andreessen is asking for is a shield. He is insisting that we judge the tech barons based on their lofty ambitions, instead of their track records.
In an interview with the German newspaper Der SPIEGEL, Theodor W. Adorno called out those «who frantically cry over objective despair with the ‹hurrah› optimism of immediate action to make it psychologically easier for themselves». Andreessen’s manifesto is the epitome of this «hurrah» optimism.
He openly illustrates the limits of imaginations of him and those in the Valley in a way no critic ever could. AI as the force that will destroy but also save the world, capitalism as the only form of economy that can work and if it doesn’t work, we need more more more more more until if fcuking works. The destruction of society will continue until morale improves.
If that’s his future, I’m happy to fight for another one.
In a rare display of decency, his successor, Giorgia Meloni, split from her partner after he made sexist remarks. I wonder if, one day, she finds out about the rest of her party. Just kidding, she didn’t become their leader by accident.
Rest of World generated thousands of images using Midjourney, analysing the output for racial stereotypes. They conclude that AI reduces the world to stereotypes. Make sure to read the whole story over at Rest of World. It includes visual representations of the output, which makes the point even more convincing than some text about it.
Focusing on complex systems leads to several perspectives (incentive shaping, non-deployment, self-regulation, and limited aims) that are uncommon in traditional engineering, and also highlights ideas (diversification and feedback loops) that are common in engineering but not yet widely utilized in machine learning. I expect these approaches to be collectively important for controlling powerful ML systems, as well as intellectually fruitful to explore.
Facebook announced some new celebrity chatbots, which manage to feel outdated while using the hot technology of the moment. Tom Brady’s chatbot incarnation quickly insulted Colin Kaepernick. Facebook said the usual thing, that these high-profile, highly expensive features are «experimental».
The Grift Shift is a new paradigm of debating technologies within a society that is based a lot less on the actual realistic use cases or properties of a certain technology but a surface level fascination with technologies but even more their narratives of future deliverance. Within the Grift Shift paradigm the topics and technologies addressed are mere material for public personalities to continuously claim expertise and “thought leadership” in every cycle of the shift regardless of what specific technologies are being talked about.
Building cutting-edge models requires an immense amount of data and computing power, making it basically impossible to do it without the backing of one of the larger players in the space. How Big Tech is co-opting the rising stars of artificial intelligence explains these dynamics in more detail.
But it’s not just the public imagination and electricity consumption that are taken over by the race for powerful AI models. Open Philantophy, flagship of the Effective Altruism movement, sponsored the salary of multiple advisors in the US Congress.
You might have heard about Reinforcement Learning in connection with machine learning models, maybe seen the abbreviation «RLHF» turning up. RLHF stands for Reinforcement Learning from Human Feedback. But what is this, how is it applied in the training process, and are there alternatives? Sebastian Raschka explains.
In an interesting bit of research, Anthropic managed to build a (small) model and were able to analyse features instead of individual neurons activating in generating output. This might lead to better interpretability and control of models, if the approach can scale to the size of Large Language Models.
Social Mediargh
Truth, they say, is the first victim of war. While that’s technically untrue, truth dies pretty fast, as all parties of a war have a story to tell which might or might not align with what is actually happening.
In the ongoing Israel–Hamas war, an explosion occurred near to the Al-Ahli in the Gaza Strip. Hamas was quick to denounce Israel, saying that 500 people died in the attack.
The message spread like wildfire through social media and engagement-driven news organisations (which basically means all news orgs). Open-Source Intelligence (OSINT) researchers, like Bellingcat, and teams such as BBC Verify painstakingly constructed are more nuanced picture, and as morning dawned the supposedly bomb attack turned out to be a smaller crater and some burnt-out cars.
Users posting about the war, are – as with other topics – resorting increasingly to Algospeak, the use of a language that uses symbols, abstractions, or neologisms to evade the algorithms of the social media platforms. Side note: Facebook trains their Language Model on the posts in its platform, so it will be interesting to see wether «‘P*les+in1ans» shows up in its future generations.
I won’t comment on the larger conflict here. John Ganz’s The Trap manages to formulate my feelings pretty conclusively:
Strategy and tactics are not what’s really at issue here. At core of the worldviews in question is a belief in sheer murderousness. What both Hamas and the far right in Israel want this is to become is a war of annihilation and extermination. This is the fundamental vision of their nationalism of despair: races and peoples pitted against each other in interminable conflicts that can only be concluded with “final solutions.” Of course, a similar vision of permanent racial war underpinned Nazism and the Holocaust. I categorically refuse to be recruited to this conception of the world. And I will not be manipulated by emotional appeals and propaganda—by one side or the other—to participate in it.
I enjoyed reading Farmers only, a look at algorithmic amplification in the age of enshittification.
Looking around at the overharvested fields of digital shit, it’s hard not to ask: is the personality quiz the ouroboros of the algorithm? Is all of social media just a personality test? AITA, the Twitter hypotheticals, the personality type tutorials invite us to project ourselves into a handful of predetermined choices. To pick one of seven essences. To choose between Jay Z or $500,000. It gives the illusion of randomization, customization and personalization, but ultimately all it does is produce a quantization of who we are. It turns the mass of the self into a collective of discrete and finite individual components.
Do you have what it takes to lead a Trust & Safety team at a fast-growing social media site? Trust & Safety Tycoon lets you find out about the intricacies policy decisions entail.
Still trying to solve the trolley dilemma? Maybe learn a new language first, researchers at the University of Chicago claim that our moral decisions are dependent on wether we think in our native or a foreign language.