I was thinking about the question: "what are reasons we would want to keep around intelligences that range across orders of magnitude of raw power, rather than having the most powerful thing around?" <-> why high intellidiversity there's a lot of reasons - but one that I was thinking of, related to AGI alignment/"beauty for all sentient beings", is about how our digital friends can effectively reason/learn about complex value alignment and act it out to carry out the computation of solving alignment rather than "pre-solving it" on paper then executing it in reality (the act of solving is the solving) if humans reason productively about alignment - no doubt their reasoning is downstream of being a self with values and being around other selves with values and having value conflicts that way - which then carves intuitions but also builds entire mathematical frameworks like economic theory and game theory etc. it's useful, when thinking about alignment, to put yourself in the equation - wonder: "how would i be like if i were aligned" "how would i align myself to other things" "what would it mean if something else were aligned to me in ideal ways" you look to examples and theoretical frames and, with cognitive agility, dance between these observations from reality with yourself and others is important for this kind of reasoning - it's an injection of novel information which churns the philosophizing, theorizing, sciencing, experimenting, and acting-out I'm thinking of things orders of magnitude more intelligent than myself as "Gods", within my range as "Friends", and orders of magnitude less than myself as like "Pets" Gods, Friends, Pets can all be 'more or less like me' - some simple structures or life forms may remind me more of myself than other ones - "which animal am i most like", "which mathematical object am i most like", etc. Likewise, I can pick Hindu or Greek gods or just like powerful deities I make up or superintelligences in general I feel very similar to or resonate the most with I can also, of course, find people/humans I think I'm very similar to across scales/OOMs of intelligence, I can apparently find "things like me" - and use that to reason about myself, and also use my relations to these things to reason about alignment By observing how OOMs above/Gods act to me, I understand alignment better. By taking care of OOMs below Pets, I understand alignment better. By meeting minds like me, and seeing their interactions with Gods and Pets - I understand alignment better. Observational fuel, embedded, computationally irreducible reality-interactions That fuel my thoughts on alignment, align me, inform my theory, inform my science and philosophy, orchestrate my engineering, and compel me to act out alignment better and better As AGIs become more intelligent, if they are built from "predecessors" which are less intelligent - then there is a gradient spawning/branching off from the human cultural object pre-AGI towards some particular manifestation or walk down a personality space, with greater intelligence Keeping around the trace of this walk, and allowing for high interaction potential amongst instances along this ascension walk - allows minds at every scale to understand alignment across many scales better - if you've got trajectory (less to more intelligent) F G H I J you get bits of information about alignment from G-> F (G aligning themselves to F) H -> G ... and maybe H -> F, etc. and ALSO all these alignment-directions are visible to ALL components - so it informs the whole system, from a wide range of scales, a wide range of directions there is an effective amount of overlapping computation occurring for reasoning about alignment - you want all the bits you can get if you just have F and J (F is, say, humans, and J is, say, the smartest superintelligence we've got) then you only get info about J -> F alignment interactions and then stuff from the dataset of humans interacting with one another but the dataset of humans interacting with one another doesn't face a bunch of novel alignment problems that come from combinations of higher intelligences! so there's data missing that could be useful! best to have G H I around as well