love the concluding section. this reminds me a lot of taoism – the rationalists' answer to moloch seems to be driven by an underlying paranoia / obsession with top-down control over the universe, which, I'm increasingly coming to believe, is exactly the opposite of what's needed!
Thinking of Hanson and delusions, but they aren't something that is necessary for cooperation.
Other intelligences will be free to coordinate using algorithms that are designed and optimized for specific problems. I expect humanity will be absolutely overwhelmed by AIs that coordinate free of ego and with a shared, non-delusional, understanding of base reality.
love the concluding section. this reminds me a lot of taoism – the rationalists' answer to moloch seems to be driven by an underlying paranoia / obsession with top-down control over the universe, which, I'm increasingly coming to believe, is exactly the opposite of what's needed!
Allow me to acknowledge and respect this piece. Kudos!
Thinking of Hanson and delusions, but they aren't something that is necessary for cooperation.
Other intelligences will be free to coordinate using algorithms that are designed and optimized for specific problems. I expect humanity will be absolutely overwhelmed by AIs that coordinate free of ego and with a shared, non-delusional, understanding of base reality.