Microsoft’s Rules for Superintelligence

Microsoft AI published its “Humanist AI Code of Conduct,” a draft governing document for the models it builds. Microsoft opened a six-week public consultation in which it will take feedback before publishing a revised version toward the end of the year, which it will use to guide model development in 2027 and beyond.

The stated premise is “people matter more than AI,” and the first objective is that AI “should not exceed human control.” Microsoft defines superintelligence as AI systems “more intelligent and capable than all humans combined” and says it expects AI to exceed human performance at most tasks within the next decade. The document explicitly “rejects the race to produce an all-purpose superintelligence,” committing to build systems that are useful and safe “even if that means compromising on ultimate generality, autonomy, or capability.”

A section titled “AI is Artificial” rejects designing models that imitate consciousness, and rejects legal personhood, model welfare, and rights for AI outright. The chain of command is spelled out (the Code, then operator policies, then user preferences) and the absolute constraints cannot be overridden by anyone: no CBRNE (chemical, biological, radiological, nuclear, enhanced explosives) weapons help, no offensive cyber operations, no evading human oversight, no manipulation at scale, as well as personal-harm rules covering crisis response, deepfakes, child safety, and surveillance. The goal is that “an MAI Model will fail in its task if success would meaningfully violate this Code of Conduct.”

As you know, Dario Amodei called for the industry to “pace the frontier,” Sam Altman agreed, and David Sacks told them to go ahead without demanding a regulatory framework as the price. Microsoft’s answer was to publish its own framework and invite the world to mark it up, so have a look and contribute.

Every company needs a Claw strategy. Do you have one?

Author’s note: This is not a sponsored post. I am the author of this article and it expresses my own opinions. I am not, nor is my company, receiving compensation for it. This work was created with the assistance of various generative AI models.

About Shelly Palmer

Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse University’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named LinkedIn’s “Top Voice in Technology,” he covers tech and business for Good Day New York, is a regular commentator on CNN and writes a popular daily business blog. He's a bestselling author, and the creator of the popular, free online course, Generative AI for Execs. Follow @shellypalmer or visit shellypalmer.com.

Tags

Categories

PreviousWeapons-Grade AI and the Licensed Frontier