In 2014, the central government of the People's Republic of China announced a "social credit" system, which will monitor the behavior of the nation's population and rank each person based on his or her social credit, i.e., how well each person behaves as a citizen. The term social credit dates to 2002, when the central government was looking at establishing a system to measure the creditworthiness of its citizens, but ultimately wanted the system to be compatible with the social services system.1 Forty-three municipalities are currently testing versions of the system, and the program is scheduled to be operational nationwide by 2020.2 To track citizens, the municipalities' systems rely on huge amounts of personal data from a wide variety of sources, including social networks, smart phone apps, and video cameras already installed by the central government. Those cameras are part of "Skynet," the Chinese government's video surveillance system, the public purpose of which is to track criminal behavior, but which has more than 20 million cameras in public spaces across the country.3 The end goal is to rely on sophisticated artificial intelligence ("AI") to review all of this data and add and deduct points from citizens based on how well they engage in lawful behavior.4

The Future with AI

Not surprisingly, this has prompted a great deal of criticism.5 However, I can't help but wonder if this is the natural development of the future with AI.

speaking about AI is what laws and regulations should do in response to fundamental changes in society introduced by

in the wake of the American Industrial Revolution is a useful (albeit slow) example of what government can do to spread widely the benefits of massive technological advancements.7 The intro-duction of the factory system moved unprecedented numbers of people from rural communities to urban communities and shifted their work from farming to manufacturing, from work hours based on the seasons and the sun to work hours based on the company clock. In response, Congress and state legislatures enacted legislation that instituted a minimum wage, limited how many hours a person could work in a week, mandated workplace and environmental standards, and prohibited children from working.8 Essentially, elected representatives recognized that the Industrial Revolution had changed America and used laws and regulations to shape the new country into a version that was better for their constituents.

If AI is going to introduce as much change as many experts predict, as much as the Industrial Revolution,9 then we should wonder what that changed world will look like. In the same way that it would have been hard but not impossible for leaders at the beginning of the Industrial Revolution to predict how the world was going to change, it is difficult but not impossible for us to predict how AI is going to change the world. Systems like China's social credit system might be what it looks like.

That should not be too surprising. There are other versions of it in place already. In the United States, credit-rating agencies score and rank individuals based on their creditworthiness, a system that the Chinese central government relied on when it created its social credit system.10 In the United Kingdom, there are systems in place to score individuals using data from a vari¬ety of sources, like credit score, phone usage, and rent payments; based on those scores, individuals are ranked by preference for job applications, access to social services, etc.11 Similarly, in Germany there are systems in place to track data and rank indi¬viduals based on creditworthiness and healthy lifestyle.12 China's proposal is therefore not unique because of the theory it relies on, but because of its scope.13 That suggests that the world we live in is already marching toward national governments accept¬ing that AI systems should analyze the vast amounts of personal data available to them and score citizens based on that analysis.

To view the full article, click here.

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.