explained to someone that the only rule you need for AGI is to never put it in charge of designing the incentive system (taxes, gvt etc) and their reply was โbut wait thatโs all that these people really want to do with itโ
and itโs like well yes. of course thatโs their goal. but if theyโre serious about AGI Safety whatever whatever they should not do that. it is an unwise idea.
of course they will do it anyway because hubris is a bitch