This can lead to an undesirable equilibrium in which no one will sign such a pact. The company fires all its laborers and throws them onto the street to die.
Everything except the one thing being maximized is destroyed utterly in pursuit of the single goal, including all the silly human values.
I mean, sometimes they are greedy. From within the system, everyone is following their own incentives and will continue to do so.
Any human with above room temperature IQ can design a utopia. If one sect of rats altruistically decides to limit its offspring to two per couple in order to decrease overpopulation, that sect will die out, swarmed out of existence by its more numerous enemies.
Imagine a lake with a thousand identical fish farms owned by a thousand competing companies. For a while, all is well. Any sect of rats advocating some action to stop the cycle will be outcompeted by their cousins for whom advocating anything is a waste of time that could be used to compete and consume.
An intense competition between agents has turned into a garden, with a single gardener dictating where everything should go and removing elements that do not conform to the pattern. I am a contract-drafting em, The loyalest of lawyers! Moloch, whose blood is running money! Skyscrapers and lights in every variety strange and beautiful all clustered together.
Government are competing against one another to get elected or promoted. In the earlier stages of the process, capitalism becomes more and more uncoupled from its previous job as an optimizer for human values.
The Apocrypha Discordia says: Moloch whose poverty is the specter of genius! The United States tries to solve the problem by having multiple levels of government, unbreakable constutitional laws, checks and balances between different branches, and a couple of other hacks.
The worst-case scenario is that the ruling party learns to produce infinite charisma on demand. Imagine a country with two rules: This is the ultimate trap, the trap that catches the universe. It would seem prudent to be somewhere else when we reach the sea. Physical limitations are most obviously conquered by increasing technology.
Saudi Arabia uses a different tactic. The problem of slaves running away succumbs to GPS.1 At that time Jesus went on the sabbath day through the corn; and his disciples were ahungered, and began to pluck the ears of corn, Deut.
and to eat.
2 But when the Pharisees saw it, they said unto him, Behold, thy disciples do that which is not lawful to do upon the sabbath day. 3 But he. Ah, but super-human AI is not the only way Moloch can bring our demise.
How many such dangers can your global monarch identify in time? EMs, nanotechnology, memetic contamination, and all the other unknown ways we’re running to the bottom.
1 When the morning was come, all the chief priests and elders of the people took counsel against Jesus to put him to death: 2 and when they had bound him, they led him away, and delivered him to Pontius Pilate the governor. 3 ¶ Then Judas, which had betrayed him, when he saw that he was condemned.Download