Tag: Surveillance culture
It’s almost as if the manufacturers of smart speakers want everyone to get used to accidental activations:
Voice assistants in smart speakers analyze every sound in their environment for their wake word, e.g., «Alexa» or «Hey Siri», before uploading the audio stream to the cloud. This supports users’ privacy by only capturing the necessary audio and not recording anything else. The sensitivity of the wake word detection tries to strike a balance between data protection and technical optimization, but can be tricked using similar words or sounds that result in an accidental trigger.
[Executive Summary: Facebook-style Social Media needs to die now, before it gets a chance to grow into this monstrosity.]
Given the distinctly Big Brother-flavoured response to the notion of China introducing a highly automated social credit system, an academic who has spent 16 months in China exploring attitudes to the idea of an automated social credit system gives us the perspective from folks who would be affected by the system once China finishes rolling it out:
During my time there, I found that positive perceptions of the social credit system among ordinary Chinese people were more prevalent than negative ones. Some welcomed the introduction of the shehui xinyong system while others were indifferent, and a significant number could see its benefits.
The thing is, western eyes looking at social credit and worrying about how badly it could turn out might indeed be looking at the system while lacking a Chinese cultural perspective on the reasons why the Chinese state standing in for the ancient Chinese concept of ‘tian’1, but that’s not the really important issue here.
First, what’s being reported here from China is a view formed before the social credit system is anywhere close to being rolled out. By the time it’s been fully operational for half a decade who knows whether the system will in fact have a reputation with the Chinese populace as being good at delivering judgement on the behaviour of the populace?
Second, given the extent to which the Chinese state leans on those who do not conform to the ideals of the state even using low-tech means, isn’t the real issue less that Westerners fail to understand tian and more that the prospect of the Chinese state turning into Facebook-on-steroids-and-run-by-a-government-free-of-pesky-independent-media-providing-information-about-all-those-messy-edge-cases might just be the start of our problems.
Imagine social credit being pointed to by future populist politicians in the West, keen to divert attention from the way they screwed up their response to COVID-19. That’s a very scary concept. Consider how forty years ago – back when many people didn’t even have a credit card – most people didn’t worry too much about their credit rating, and how far that situation has changed now. Who’s to say that politicians eager for the state to step back and for the populace to behave themselves won’t find the concept behind social credit very appealing one day? Nobody’s saying out loud right now that maybe the Chinese have the right idea, but that doesn’t mean that the same concepts couldn’t be repackaged and a decade down the line it’ll seem like common sense to build on what’s already out there?
- The author describes Tian as an entity that “resembles the sky in that it is distant to the point that it has given up on the task of reconciling the human world with itself, but nevertheless knows about everyone’s deeds and thoughts.” ↩
One day Mark Zuckerberg probably is going to roll out a Facebook update that makes Futurebook a reality.
Australia’s ABC News on China’s plans to leave no dark corner when it comes to monitoring the populace’s lives online:
Dandan doesn’t object to the prospect of life under the state’s all-seeing surveillance network. […] The 36-year-old knows social credit is not a perfect system but believes it’s the best way to manage a complex country with the world’s biggest population. […]
Under an existing financial credit scheme called Sesame Credit, Dandan has a very high score of 770 out of 800 – she is very much the loyal Chinese citizen.
Just for the record, I hated the visual style of this piece – way too much scrolling over images to get to the next piece of the text – but the content is decent. The really worrying prospect of this stuff is how easy a sell a European edition of the Social Credit software is going to be to a certain type of centrist politician.1
The term ‘social credit’ should be as despised as the term ‘meritocracy’, properly understood, deserves to be, but give it a decade or so and – barring a backlash against the level of surveillance and the consequences for ordinary citizens having brought down the Chinese government in the meantime – you’re going to see a huge bunfight as every careerist with half an eye on Number 10 decides that this is exactly what the UK needs to get the populace to shape up. We can but hope that they get the successors of the Government Digital Service to try to implement a UK version, so that with any luck it’ll show up years late and barely functional and the world will have moved on to the next big idea.
Having caught up with Kashmir Hill‘s Gizmodo piece ‘People You May Know:’ A Controversial Facebook Feature’s 10-Year History, I’m both supremely glad that I’m not on Facebook 1 and creeped out by how little difference that makes to Facebook’s determination to shadow profile me whether I like it or not.
In other words, People You May Know is an invaluable product because it helps connect Facebook users, whether they want to be connected or not. It seems clear that for some users, People You May Know is a problem. It’s not a feature they want and not a feature they want to be part of. When the feature debuted in 2008, Facebook said that if you didn’t like it, you could “x” out the people who appeared there repeatedly and eventually it would disappear. (If you don’t see the feature on your own Facebook page, that may be the reason why.) But that wouldn’t stop you from continuing to be recommended to other users.
Facebook needs to give people a hard out for the feature, because scourging phone address books and email inboxes to connect you with other Facebook users, while welcome to some people, is offensive and harmful to others. Through its aggressive data-mining this huge corporation is gaining unwanted insight into our medical privacy, past heartaches, family dramas, sensitive work associations, and random one-time encounters.
[Via Pixel Envy]