Microsoft Introduces New AI Safety and Privacy Standards for Schools

Microsoft has agreed to new safety and privacy standards for artificial intelligence tools used in U.S. schools, marking a significant step toward stronger protections for students and educators.

The agreement was developed with the American Federation of Teachers and introduces restrictions covering how AI systems can use student and educator information, how AI features interact with students and how schools communicate about the technology. The standards are scheduled to take effect on November 1, 2026.

Stronger Protection for Student Data

One of the central elements of the agreement is the protection of student and educator data.

Microsoft has committed not to use student or educator data for AI training, advertising or product development, subject to limited exceptions. The goal is to give schools greater control over sensitive information generated when students and teachers interact with AI systems.

The issue has become increasingly important as AI tools become more common in classrooms. Students may use AI for schoolwork, research and other forms of assistance, creating new questions about how conversations and personal information should be handled.

Limits on Emotionally Manipulative AI

The agreement also addresses a newer concern: AI systems that could encourage emotional dependence.

The standards prohibit AI companions or features designed to foster emotional attachment or dependency among students. They also address features designed to keep students engaged beyond what is necessary for a particular learning task.

This represents a broader shift in the conversation around AI in education. The discussion is moving beyond accuracy and usefulness toward questions about how AI systems influence young users.

More Transparency for Families

The agreement calls for clearer communication with families about the AI systems being used in schools.

Parents and guardians should have greater visibility into how educational AI tools work, what they are designed to do and what protections are in place for student information.

Greater transparency could also help schools make more informed decisions when choosing AI products for classrooms.

Why This Matters for AI in Education

AI is becoming an increasingly important part of education, but schools operate in an environment where privacy and student safety are especially important.

Microsoft's agreement could provide a framework for school districts looking to establish stronger contractual protections when purchasing or deploying AI tools.

The move could also increase pressure on other technology companies to adopt similar standards as schools and educators demand clearer safeguards.

Could Other AI Companies Follow?

Microsoft's agreement could become an important reference point for the broader technology industry.

According to AP, OpenAI and Anthropic are also involved in discussions with the American Federation of Teachers, while Google has not yet committed to an equivalent agreement.

If more technology companies adopt comparable standards, schools could gain greater leverage when negotiating privacy and safety requirements.

The Challenge of Responsible AI Adoption

The new standards do not eliminate all risks associated with AI in education.

Schools still need to evaluate the accuracy of AI-generated information, determine when students should use AI and establish clear rules for teachers and students.

However, stronger privacy and safety requirements could provide an additional layer of protection as educational AI adoption expands.

Our Analysis

The most important aspect of Microsoft's announcement is that AI safety requirements for education now cover how systems behave, not only what they produce. The restrictions on emotionally manipulative features and on the use of student data reflect a shift from treating classroom AI as a purely technical product toward treating it as part of a school's broader duty of care.

Because the commitments are tied to a formal agreement with a major teachers' union, they are more likely to carry contractual weight than voluntary pledges. That could shape how school districts across the U.S. negotiate privacy and safety terms with AI vendors.