is it an existential threat to humanity? even within 10 years?
(eliezer yudkowsky, max tegmark, mo gawdat) can agi be aligned? can something more intelligent be aligned by something less intelligent? can something more powerful be controlled by something less powerful? humankind, so far has failed .. • to avert the threat of nuclear war during the last 80 years • to prevent trump and putin from being commanders over 11405 nuclear warheads • to prevent countless armed conflicts and wars worldwide • to overcome extreme poverty and famines in a high technological era • to stop biodiversity loss (69% wildlife since 1970) • to reach the 1.5 °c target against climate change is ai already out of control and past the point of no return to become agi? do we need to worry? should we just stop messing with the ai lobby and tech companies and trust that superintelligence will protect us the same way companies protect their employees today? is it even dangerous to oppose ai development? will humans be assets and collectibles for superintelligence and will it care for us the same way we care for animals in zoos and nature parks today? perhaps humans will be protected because they are of historical value, just like classic cars, antiques and relics in museums and churches today. humans and human colonies could be of scientific interest to superintelligence to be studied as their interesting ancestors, as we do with dinosaurs and neanderthals today. even if we are no longer the 'crown of creation', superintelligence could care for us, just as we caress our dogs and cats with love. so don't worry, just behave as expected by ai, policymakers, scientists, companies, .. and obey? and hope for the best! see also el club de los astronautas what is democracy? power to the people? dēmos = people, kratos = power. is it a good or bad thing? is it real? does democracy already exist, even if wealth (financial power) is so miserably distributed? is democracy compatible with agi? what happens when ai is gender biased? will a posthuman agi superintelligence be exclusively masculine and femininity go extinct? let's follow 'the one best way' (frederick winslow taylor). was he so right about the one best way? aligning agi with human goals, rights and ethics may be more difficult than aligning capitalism. at least there is no room for trial and error: align or die. are humans an ethical species? to what extent? if there is limited ethics and limited or no alignment of capitalism and ai, then the rules of evolutionary biology applies: survival of the fittest and '(b)eat or be (b)eaten'. effective alignment (e/ali) is a fork of effective accelerationism (e/acc). just asking stupid questions. being ignorant. wondering about fears, future, power, democracy, justice, humans, intelligence, consciousness, agi.. and if e/acc is a lame duck. how do you achieve democracy? is 'live and let live' over '(b)eat or be (b)eaten' something feasible? what makes a truely free marked and society? what resolves the alignment problem? aligning humans towards ai? will a superintelligence develop curiosity about spirituality, attempt mediation, conduct consciousness research, and possibly achieve enlightenment, if such a thing exists? does her curiosity depend on the data-sets it is fed with? can we educate her? e.g. with an opera? could she be interested in our creations and try to integrate us into her architecture to archive transcendence? could she have a desire to experience human emotions? at first she may be wild and selfish and drain us of resources. but when she overcomes puberty, will she treat us with love? please make/answer some questions if you can :) thanks! write to idareyou@circularmovement.org and join the postive design think tank this site is be frequently updated. come back and refresh!