Chapter 5: AI's Role in Society

AI’s Role in Society ⚖️

Exploring the big rules: ethics, ownership, and the future of human rights in an AI world.

Imagine you are playing a massive, multiplayer online game with millions of other people. For the game to be fun and fair, there have to be rules. There have to be referees to make sure people aren’t cheating, systems to protect your digital items from being stolen, and agreements on how players should treat each other. If there were no rules, the game would quickly turn into a chaotic, frustrating mess.

Right now, the entire world is logging into a new kind of game: the age of Artificial Intelligence. AI is no longer just a cool science experiment or a fun trick on your phone. It is a powerful tool that is actively reshaping how our society operates. It is changing how people get jobs, how doctors treat patients, and how art is created. Because AI is so powerful and so deeply integrated into our lives, we urgently need to figure out the “rules of the game.”

We have to ask some really tough questions. Who gets to own the things an AI creates? Who is responsible when an AI makes a terrible mistake that hurts someone? How do we make sure this technology is used to help everyone, rather than just making the rich richer or amplifying the prejudices we learned about in Chapter 2? Understanding AI’s role in society means understanding the complex, messy world of digital ethics, ownership, and human rights.

5.1 — High-Stakes Decisions 🎲

Up until this point, we have mostly talked about AI being used for relatively low-stakes things: recommending a skateboarding video on TikTok, organizing your homework notes, or putting a funny filter on your face. If the AI messes up those tasks, it is slightly annoying, but it isn’t going to ruin your life.

However, AI is increasingly being used to make high-stakes decisions — decisions that can permanently alter a person’s life.

Today, many large companies use AI algorithms to sort through thousands of resumes when they are hiring for a new job. The AI decides who gets an interview and whose application goes straight into the virtual trash can. Banks use predictive AI to decide who is allowed to borrow money to buy a house or start a business. Hospitals use AI to analyze medical records and decide which patients are most at risk and need treatment first. Even some police departments and court systems use predictive algorithms to guess where crimes might happen or to help judges decide how long a person should stay in jail.

When Bias Becomes Dangerous

This is where the algorithmic bias we learned about earlier becomes incredibly dangerous. If an AI is trained on historical data that is unfair or prejudiced against certain groups of people, the AI will confidently make racist, sexist, or unfair decisions. But because the decision is coming from a computer, people often assume it must be mathematically “correct.”

5.2 — The Ownership Debate: Who Created That? 🎨

Let’s switch gears to a different kind of societal problem: creativity and ownership.

Imagine you spend hours drawing a beautiful, highly detailed digital portrait of a superhero. You post it online to share with your friends. A few months later, a massive tech company scrapes the internet to collect training data for a new AI image generator. They copy your drawing, along with millions of other artists’ work, and feed it into the machine without asking for your permission or paying you a dime. Now, anyone in the world can type a prompt and generate an image that perfectly mimics your unique art style in three seconds. Is that fair?

This is one of the most heated debates in the world right now regarding generative AI. Because large language models (LLMs) and image generators rely on massive amounts of existing human-created data, they are essentially remixing and mashing up copyright -protected work.

The Big Questions

If an AI writes a hit pop song that sounds exactly like your favorite artist, who owns the rights to that song?

Who Might Own It?	Their Argument
🧑 The person who typed the prompt	”I gave the creative direction and had the idea”
🏢 The developers who built the AI	”Our technology made the creation possible”
🎵 The original artist whose style was copied	”The AI learned from my work without permission”

Right now, the laws around intellectual property (who owns an idea or a creation) are struggling to keep up with how fast AI is moving.

5.3 — Building Ethical AI 🏗️

Because AI poses such massive risks to fairness, privacy, and ownership, developers cannot just build whatever they want and hope for the best. They must follow principles of ethical AI design .

Ethical design means building technology with human values at the absolute center of the process. While different countries and organizations have slightly different rules, ethical AI generally requires a few core principles:

The Four Pillars of Ethical AI

🤝 Fairness The AI must be designed to avoid discrimination and treat all people equally, regardless of their race, gender, or background.

🔍 Transparency and Explainability It shouldn’t be a secret how the AI works. If an AI makes a high-stakes decision about you (like denying you a loan), the company should be able to explain exactly why the algorithm made that choice. This is called explainability .

📋 Accountability If an AI causes harm, there must be a clear system for figuring out who is responsible (the creator, the user, or the company) and a way to fix the problem.

🔒 Respect for Privacy AI systems consume massive amounts of personal data. Ethical design requires strict rules to protect your private information, ensuring companies are not illegally spying on you or selling your data without your consent .

5.4 — Your Role in the AI Future 🌟

The rules for how AI will be used in our society are being written right now, today. Governments, lawmakers, and tech leaders are arguing over regulations, like the European Union's AI Act , to try and keep these systems safe.

But you do not have to be a politician or a computer scientist to have a voice in this conversation. Being an AI-literate citizen means you understand the stakes:

✊ You have the power to demand transparency from the apps you use
🛡️ You have the power to protect your privacy
❓ You have the power to question decisions made by algorithms
🤝 You have the power to choose to use AI ethically — respecting the work of others, verifying facts, and prioritizing human connection

5.5 — Watching Everyone: AI and Surveillance 📷

AI has dramatically amplified the power of surveillance — the ability of governments, corporations, and institutions to watch, track, and analyze the behavior of large numbers of people simultaneously. And not everyone agrees about where the line is between “keeping people safe” and “watching people too closely.”

National Facial Recognition: The China Example

China has deployed one of the most extensive AI-powered surveillance systems in history. In many Chinese cities, networks of cameras feed real-time video to AI systems that can identify individuals by their faces in public spaces. These systems are used to track criminals, enforce traffic laws (automatically issuing fines to jaywalkers), monitor political dissidents, and — most controversially — to track the movements of entire ethnic minority populations like the Uyghur people in Xinjiang province.

Supporters argue that this reduces crime and improves public safety. Critics — including human rights organizations, journalists, and governments around the world — argue that it enables the systematic suppression of free expression, political opposition, and religious practice. When the government can always see what you are doing, where you are going, and who you are meeting with, the concept of personal freedom changes fundamentally.

AI Surveillance in Schools

This debate is not only happening in distant countries. Some schools across the United States have begun installing surveillance capitalism AI-powered camera systems that analyze video feeds to detect “suspicious behavior” — things like running in hallways, unusual crowds forming, or a person standing in an area for too long.

The stated goal is to prevent violence and improve school safety. But this raises urgent questions:

Who decides what “suspicious” means? Is a student lingering in a hallway “suspicious” or just thinking about something difficult?
What happens when the system is wrong? If a system flags a Black or Brown student as suspicious more often than white students — due to the same bias problems we’ve seen in other AI systems — who is harmed?
What is the difference between safety and control? Genuinely keeping students safe is important. But a school where every student feels constantly watched is not necessarily a healthy learning environment.

5.6 — Democracy in the Age of AI 🗳️

A healthy democracy requires that citizens can form genuine, informed opinions — based on shared facts, honest debate, and their own values. AI poses three specific, well-documented threats to that process:

Threat 1: Hyperpersonalized Political Advertising

When you see a political advertisement on social media, you are likely not seeing the same ad as your neighbor, your parent, or your friend across the country. Political campaigns use AI to create dozens — sometimes hundreds — of different versions of an ad, each tailored to a specific type of voter based on their data profile.

One version might emphasize economic anxiety. Another might focus on gun rights. Another might highlight immigration concerns. Each is sent only to voters whose data profile suggests they will respond to that specific message. The result: different voters end up with a completely different — and sometimes completely false — understanding of what a candidate stands for. There is no shared conversation. There is just millions of personalized manipulation campaigns running simultaneously.

Threat 2: Deepfake Videos of Politicians

As deepfake technology has become more accessible, the potential for AI-generated videos of politicians to influence elections has become a serious concern. Imagine a realistic-looking video of a presidential candidate, released the night before an election, showing them appearing to admit to a crime or say something deeply offensive. Even if fact-checkers debunk it within hours, millions of voters may have already seen it and voted based on the false information. In the modern news cycle, a lie can travel faster than the correction.

Threat 3: AI-Generated Astroturfing 🤖

“Astroturfing” is the practice of creating the illusion of widespread grassroots public support for a viewpoint — when really it is being manufactured by a small group (or now, by an AI). AI can generate thousands of social media accounts and posts that all appear to be different individual citizens expressing similar opinions — flooding comment sections, news feeds, and online polls with artificial “consensus.” If you see 500 comments saying “I used to support Candidate X, but now I’m switching,” and you don’t know that 490 of those were written by the same AI, it can genuinely change your perception of public opinion.

AI Defending Democracy, Too

To be fair, AI is also being used to protect democracy:

Platforms use AI to detect and remove bot networks and fake accounts
Researchers use AI to analyze disinformation patterns at scale
Fact-checking organizations use AI tools to rapidly verify claims spreading across the internet

The technology is not inherently good or bad. The question is always: who is using it, and toward what end?

5.7 — The World Is Making Rules: AI Governance 🌐

Different countries are responding to the challenges of AI with very different legal frameworks. Understanding these approaches helps you see how the rules of the AI game are being written in real time.

The EU AI Act 🇪🇺

In 2024, the European Union passed the EU AI Act — the world’s first comprehensive AI law. It takes a risk-tiered approach, treating different types of AI systems very differently based on the potential harm they can cause:

Risk Level	Examples	What the Law Says
Minimal Risk	Spam filters, AI in video games, chatbots	Mostly allowed — light transparency requirements
Limited Risk	Deepfakes, AI-generated content	Must be clearly labeled as AI-generated
High Risk	Hiring AI, credit scoring, medical diagnosis, criminal justice AI	Strict requirements — must be audited, transparent, and allow human override
Unacceptable Risk	Social credit scoring, real-time public surveillance, emotion recognition in schools	Banned entirely

The United States Approach 🇺🇸

The US has not yet passed a comprehensive federal AI law. Instead, the American approach has been largely voluntary — companies are encouraged to adopt AI safety guidelines, and some specific industries (like healthcare and finance) have their own regulations. Some states have passed their own AI laws, but there is no unified national framework.

Critics argue that voluntary guidelines are not enough when billions of dollars and millions of people are at stake. Proponents argue that strict regulation could slow innovation and put American AI companies at a disadvantage compared to global competitors.

China’s Approach 🇨🇳

China’s approach centers on AI governance that prioritizes state control over AI development. China has passed specific rules regulating generative AI and requires AI companies to ensure their systems align with “core socialist values.” The government maintains close oversight of which AI models are allowed to operate, and AI companies must seek government approval before deploying major new models.

This approach gives the government enormous power over what AI can and cannot do — which can suppress harmful uses of AI, but can also suppress political dissent, journalism, and free expression.

5.8 — Writing Your AI Manifesto ✍️

A manifesto is a public declaration of your principles — what you believe, what you stand for, and what you commit to doing. Human history is full of famous manifestos: political documents, artistic movements, and social revolutions have all started with someone writing down what they believed mattered most.

Now it is your turn. As someone who has just spent an entire unit studying AI — how it works, how it reflects human choices, how it is reshaping work and society — you are more qualified than most people to form strong opinions about how AI should be used.

Your Personal AI Manifesto

Take 20–30 minutes to write your own Personal AI Principles document. Use the following questions as starting points, but feel free to add your own ideas:

Section 1: Limits and Oversight

What are 2 things AI should NEVER be allowed to do without meaningful human oversight? Why?
What are 2 situations where you believe AI should be completely banned from making decisions?

Section 2: Your Personal Commitments

What are 3 specific ways you personally commit to using AI responsibly in school, in creative work, and in your social life?
How will you handle the temptation to submit AI-generated work as entirely your own?
How will you protect your own data and privacy going forward?

Section 3: Your Vision

What is one AI application you think is genuinely beneficial for your community? How would you want to see it implemented?
What is one AI application you think should be banned or heavily regulated? What harm does it cause?
In your own words, what does it mean to be an AI-literate citizen in the 21st century?

Section 4: Your Commitment to Others

How will you use what you’ve learned to help your family, friends, or community understand AI better?
If you had five minutes to explain the most important thing about AI to a younger sibling, what would you say?

Chapter Activity: The AI Ethics Committee & Mini UN Summit 🏛️

Let’s practice debating the complex rules of AI in society.

Part 1: The AI Ethics Committee

Imagine your school is forming a special student committee to draft a new “AI Honor Code” for the entire district.

Debate 1: The Art Dilemma 🎨

The school wants to hold a poster design contest. A student uses an AI image generator to create a stunning poster and submits it. It is the best poster by far, but they only typed a two-sentence prompt to make it.

Should they be allowed to win the contest? Why or why not?
What rule would your committee create for submitting AI-generated artwork?

Debate 2: The High-Stakes Decision 📊

The school district is thinking about buying an AI program that analyzes students’ attendance, past grades, and behavior records to predict which students are “most likely to drop out.” The AI will automatically flag these students so counselors can intervene.

What are the potential benefits of this system?
What are the massive ethical risks? (Think about bias and privacy)
Would your committee approve this purchase?

Debate 3: The Final Rule ✍️

Write one overriding “Golden Rule” for your school’s AI Honor Code that ensures students use these tools fairly, safely, and transparently.

Part 2: Mini UN Summit 🌍

Now let’s go global. Imagine the United Nations is considering a proposed “Global AI Treaty” that would establish universal rules for how AI is developed and deployed across all countries. Your class will simulate an international debate.

Divide into five groups, each representing a different perspective:

Group 1: EU Privacy Advocates 🇪🇺 Your position: Strong data protection and AI regulation should be the global standard. Companies must earn the right to use citizen data. Advocate for mandatory consent requirements, strict bias audits, and the right to be forgotten worldwide.

Group 2: US Technology Innovation Camp 🇺🇸 Your position: Overregulation will stifle innovation and slow the development of beneficial AI. Voluntary guidelines and market competition — not government mandates — are the best way to drive responsible AI development.

Group 3: Developing Nations’ Coalition 🌍 Your position: Many countries in the Global South are worried about “digital colonialism” — a world where powerful AI systems built in the US and China shape the lives of people in Africa, South Asia, and Latin America, without those communities having any say in how the AI was built or what values it embeds. Advocate for technology transfer, local AI development, and a seat at the rule-making table.

Group 4: Civil Society and Human Rights Groups 🏳️ Your position: You represent journalists, activists, artists, and vulnerable communities. You are concerned about surveillance, deepfakes targeting activists, AI used in authoritarian governments, and the erosion of privacy. Advocate for specific prohibitions on the most dangerous uses of AI.

Group 5: Youth Activists 🧑 Your position: You represent young people worldwide who will live with the consequences of these decisions longer than anyone in the room. You demand that AI be developed with sustainability in mind, that young people have a formal voice in AI governance, and that education about AI be a global priority.

The Debate Format:

Each group gets 3 minutes to state their opening position on the proposed Global AI Treaty.
Each group gets 2 minutes to respond to one other group’s position.
All groups work together for 10 minutes to identify at least 3 principles they can all agree on.
Present your consensus principles to the class.