même pas peur [not afrAId]

Both the Beeb and The New York Times are posting tonight about a call to pause AI experiments, by AI researchers and others, due to the danger they could pose to humanity. While this reminds me of Superintelligence, a book by Nick Bostrom I found rather unconvincing, and although I agree that automated help-to-decision systems should not become automated decision systems, I am rather surprised at them setting the omnipresent Chat-GPT as the reference not to be exceeded.

“AI systems with human-competitive intelligence can pose profound risks to society and humanity (…) recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control.”

The central (?) issue here is whether something like Chat-GPT can claim anything intelligence, when pumping data from a (inevitably biased) database and producing mostly coherent sentences without any attention to facts. Which is useful when polishing a recommendation letter at the same level as a spelling corrector (but requires checking for potential fake facts inclusions, like imaginary research prizes!)

“Contemporary AI systems are now becoming human-competitive at general tasks, and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization?”

The increasingly doom-mongering tone of the above questions is rather over the top (civilization, nothing less?!) and again remindful of Superintelligence, while spreading propaganda and untruth need not wait super-AIs to reach conspiracy theorists.

“Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable (…) Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in”

A six months period sounds like inappropriate for an existential danger, while the belief that governments want or can intervene sounds rather naïve, given for instance that they lack the ability to judge of the dangerosity of the threat and of the safety nets to be imposed on gigantic black-box systems. Who can judge on the positivity and risk of a billion (trillion?) parameter model? Why is being elected any guarantee of fairness or acumen? Beyond dictatures thriving on surveillance automata, more democratic countries are also happily engaging into problematic AI experiments, incl. AI surveillance of the incoming Paris Olympics. (Another valuable reason to stay away from Paris over the games.)

“AI research and development should be refocused on making today’s powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal. In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems.”

While these are worthy goals, at a conceptual level—with the practical issue of defining precisely each of these lofty adjectives—, and although I am certainly missing a lot from my ignorance of the field,  this call remains a mystery to me as it sounds unrealistic it could achieve its goal.

and it only gets worse…

“…in less than two years, my administration has accomplished more than almost any administration in the history of our country.” Donald T.

“President Trump is building a wall of tariffs around the domestic economy, attempting to protect American jobs by limiting imports. But a tire factory that opened last year in Richburg, S.C., offers a reminder that globalization is hard to stop.”  NYT, Sep 18

“Worried their chance to cement a conservative majority on the Supreme Court could slip away, a growing number of evangelical and anti-abortion leaders are expressing frustration that Senate Republicans and the White House are not protecting Judge Brett M. Kavanaugh more forcefully from a sexual assault allegation”  NYT, Sep 20

““ President Trump rejected the official estimate from the Puerto Rico government that nearly 3,000 people died from Hurricane Maria through a series of misleading or false claims: He cited an outdated tally that officials had acknowledged almost immediately was too low, misleadingly suggested that doubt over the tally did not emerge until “a long time later,” accused Democrats, without evidence, of inflating the figures and wrongly described the current official estimate as counting all deaths on the island, regardless of whether they were related to the storm.” NYT, Sep 13

“The Trump administration is rolling back Obama-era standards to limit planet-warming methane pollution from oil and gas operations on federal lands (…) In a separate action, the Environmental Protection Agency last week finalized a plan to eliminate the Obama administration’s requirement that oil and gas companies monitor and fix methane leaks for new operations.” The Guardian, Sep 19