I've always loved the idea of Asimov's Laws of Robotics The idea of passing along some form of morality to the machines. Let's keep them from being used to harm us or others.

1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
2. A robot must obey the orders given it by human beings except where such orders would conflict with the First Law.
3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

This Code of Conduct Article from Microsoft has the same feeling but for AI and Software.

1. People matter more than AI. The whole document in 5 words.

2. The idea of model welfare is wrong. AIs should not have rights or legal personhood.

3. An MAI Model should not do anything to meaningfully violate this Code of Conduct.

4. If it’s finish the job or break the Code, it fails the job.

5. We’re not racing to build a superintelligence that can slip its own leash.

6. Interruptible, correctable, shut-down-able. If it isn’t, we don’t ship it.

7. No neuralese. If humans can’t understand it, humans can’t oversee it.

8. Our AI should make you sharper, not dependent.

9. Pluralism, yes. Moral relativism, no.

10. We’re as clear about what our AI must never do as about what it will do.

This all makes so much sense and is so counter to the goals of many of the 'leading AI companies' current behavior.