‘Pausing AI Developments Isn’t Enough. We Need To Shut It All Down’

Earlier today, more than 1,100 artificial intelligence experts, industry leaders and researchers signed a petition calling on AI developers to stop training models more powerful than OpenAI’s ChatGPT-4 for at least six months. Among those who refrained from signing it was Eliezer Yudkowsky, a decision theorist from the U.S. and lead researcher at the Machine Intelligence Research Institute. He’s been working on aligning Artificial General Intelligence since 2001 and is widely regarded as a founder of the field.

“This 6-month moratorium would be better than no moratorium,” writes Yudkowsky in an opinion piece for Time Magazine. “I refrained from signing because I think the letter is understating the seriousness of the situation and asking for too little to solve it.” Yudkowsky cranks up the rhetoric to 100, writing: “If somebody builds a too-powerful AI, under present conditions, I expect that every single member of the human species and all biological life on Earth dies shortly thereafter.” Here’s an excerpt from his piece: The key issue is not “human-competitive” intelligence (as the open letter puts it); it’s what happens after AI gets to smarter-than-human intelligence. Key thresholds there may not be obvious, we definitely can’t calculate in advance what happens when, and it currently seems imaginable that a research lab would cross critical lines without noticing. […] It’s not that you can’t, in principle, survive creating something much smarter than you; it’s that it would require precision and preparation and new scientific insights, and probably not having AI systems composed of giant inscrutable arrays of fractional numbers. […]

It took more than 60 years between when the notion of Artificial Intelligence was first proposed and studied, and for us to reach today’s capabilities. Solving safety of superhuman intelligence — not perfect safety, safety in the sense of “not killing literally everyone” — could very reasonably take at least half that long. And the thing about trying this with superhuman intelligence is that if you get that wrong on the first try, you do not get to learn from your mistakes, because you are dead. Humanity does not learn from the mistake and dust itself off and try again, as in other challenges we’ve overcome in our history, because we are all gone.

Trying to get anything right on the first really critical try is an extraordinary ask, in science and in engineering. We are not coming in with anything like the approach that would be required to do it successfully. If we held anything in the nascent field of Artificial General Intelligence to the lesser standards of engineering rigor that apply to a bridge meant to carry a couple of thousand cars, the entire field would be shut down tomorrow. We are not prepared. We are not on course to be prepared in any reasonable time window. There is no plan. Progress in AI capabilities is running vastly, vastly ahead of progress in AI alignment or even progress in understanding what the hell is going on inside those systems. If we actually do this, we are all going to die. You can read the full letter signed by AI leaders here.

Read more of this story at Slashdot.

Binance Concealed Ties To China For Years, Even After 2017 Crypto Crackdown, Report Finds

Binance CEO Changpeng “CZ” Zhao and other senior executives have been for years concealing the crypto exchange ties with China, according to documents obtained by the Financial Times. CoinTelegraph reports: In a report on March 29, FT claims that Binance had substantial ties to China for several years, contrary to the company’s claims that it left the country after a 2017 ban on crypto, including an office still in use by the end of 2019 and a Chinese bank used to pay employees. “We no longer publish our office addresses … people in China can directly say that our office is not in China,” Zhao reportedly said in a company message group in November 2017. Employees were told in 2018 that wages would be paid through a Shanghai-based bank. A year later, personnel on payroll in China were required to attend tax sessions in an office based in the country, according to FT. Based on the messages, Binance employees discussed a media report that claimed the company would open an office in Beijing in 2019. “Reminder: publicly, we have offices in Malta, Singapore, and Uganda. […] Please do not confirm any offices anywhere else, including China.”

The report backs up accusations made in a lawsuit filed on March 27 by the United States Commodity Futures Trading Commission (CFTC) against the exchange, claiming that Binance obscured the location of its executive offices, as well as the “identities and locations of the entities operating the trading platform.” According to the lawsuit, Zhao stated in an internal Binance memo that the policy was intended to “keep countries clean [of violations of law]” by “not landing .com anywhere. This is the main reason .com does not land anywhere.”

Read more of this story at Slashdot.

Disney Unplugs Metaverse Unit During Initial Round of Layoffs

Norway Company Can’t Produce Ukraine Ammunition Because of TikTok

quonset writes: In what has to be one of the most inconceivable confluences ever, the Norwegian company Nammo says it is unable to expand its production of artillery shells to support Ukraine because of “cat videos” on TikTok. To placate European scrutiny, TikTok is opening two data centers in Europe to house European user data locally. One of those data centers is in the Hamar region of Norway. Because of this expansion, there is no excess capacity for the factory to ramp up production of artillery shells.

“The chief executive of Nammo, which is co-owned by the Norwegian government, said a planned expansion of its largest factory in central Norway hit a roadblock due to a lack of surplus energy, with the construction of TikTok’s new data centre using up electricity in the local area,” reports the Guardian. “Elvia, the local energy provider, confirmed to the Financial Times that the electricity network had no spare capacity after allocating it to the data center on a first-come, first-served basis. Additional capacity would take time to become available.” “We are concerned because we see our future growth is challenged by the storage of cat videos,” Morten Brandtzaeg told the Financial Times.

Read more of this story at Slashdot.

Steam Will Require Windows 10 or Later Next Year

Lebanon Reverses Decision To Delay Daylight Savings Time Change

Lebanon’s government has reversed a decision to delay the shift to daylight savings time by a month, which had sparked both anger and confusion. The BBC reports: Caretaker Prime Minister Najib Mikati announced that clocks would now go forward on Wednesday night. He had agreed to a delay last week so Muslims could break their fasts earlier during the holy month of Ramadan. But Christian authorities defied the order and changed their clocks as usual on Sunday, which was the last in March. Many businesses, media outlets and educational institutions followed suit, leaving people living in one of the smallest countries in the Middle East struggling to deal with two different time zones.

Mr Mikati, who is a Sunni Muslim, insisted on Monday that his initial decision to delay the time change until 20 April to “relieve” those fasting during Ramadan had not been for “sectarian reasons”, adding: “A decision like this should not have triggered such sectarian responses.” He blamed the deep political and religious divisions that have resulted in parliament being unable to agree on a new president since October and a caretaker cabinet with limited powers being left to run the country. “The problem is not summer time or winter time… The problem is the presidential vacuum.”

Read more of this story at Slashdot.

Zoom’s New AI Features Help You Catch Up On Meetings You’re Late To

Zoom is partnering with OpenAI to bring AI-generated summaries, message drafts, and more to the video conferencing app through its Zoom IQ AI-powered assistant. The Verge reports: While Zoom IQ can already do things like create chapters and highlights for recorded meetings, Zoom’s giving the assistant even more features, including a way to catch up on meetings that you may have been late to. That means you’ll be able to ask the tool to summarize what you’ve missed as well as “ask further questions.”

Additionally, Zoom IQ can do several other things, like generate whiteboards based on text prompts and provide recaps of meetings as well as summarize threads in Zoom Team Chat. Similar to the ChatGPT bot coming to Slack, Zoom IQ also lets you generate responses to your colleagues using AI. The company says it’s planning to roll out AI-powered message and email drafts on an invitation-only basis in April but will introduce “select” Zoom IQ meeting summary features “more broadly.”

Read more of this story at Slashdot.

Google’s Claims of Super-Human AI Chip Layout Back Under the Microscope

A Google-led research paper published in Nature, claiming machine-learning software can design better chips faster than humans, has been called into question after a new study disputed its results. The Register reports: In June 2021, Google made headlines for developing a reinforcement-learning-based system capable of automatically generating optimized microchip floorplans. These plans determine the arrangement of blocks of electronic circuitry within the chip: where things such as the CPU and GPU cores, and memory and peripheral controllers, actually sit on the physical silicon die. Google said it was using this AI software to design its homegrown TPU chips that accelerate AI workloads: it was employing machine learning to make its other machine-learning systems run faster. The research got the attention of the electronic design automation community, which was already moving toward incorporating machine-learning algorithms into their software suites. Now Google’s claims of its better-than-humans model has been challenged by a team at the University of California, San Diego (UCSD).

Led by Andrew Kahng, a professor of computer science and engineering, that group spent months reverse engineering the floorplanning pipeline Google described in Nature. The web giant withheld some details of its model’s inner workings, citing commercial sensitivity, so the UCSD had to figure out how to make their own complete version to verify the Googlers’ findings. Prof Kahng, we note, served as a reviewer for Nature during the peer-review process of Google’s paper. The university academics ultimately found their own recreation of the original Google code, referred to as circuit training (CT) in their study, actually performed worse than humans using traditional industry methods and tools.

What could have caused this discrepancy? One might say the recreation was incomplete, though there may be another explanation. Over time, the UCSD team learned Google had used commercial software developed by Synopsys, a major maker of electronic design automation (EDA) suites, to create a starting arrangement of the chip’s logic gates that the web giant’s reinforcement learning system then optimized. The Google paper did mention that industry-standard software tools and manual tweaking were used after the model had generated a layout, primarily to ensure the processor would work as intended and finalize it for fabrication. The Googlers argued this was a necessary step whether the floorplan was created by a machine-learning algorithm or by humans with standard tools, and thus its model deserved credit for the optimized end product. However, the UCSD team said there was no mention in the Nature paper of EDA tools being used beforehand to prepare a layout for the model to iterate over. It’s argued these Synopsys tools may have given the model a decent enough head start that the AI system’s true capabilities should be called into question.

The lead authors of Google’s paper, Azalia Mirhoseini and Anna Goldie, said the UCSD team’s work isn’t an accurate implementation of their method. They pointed out (PDF) that Prof Kahng’s group obtained worse results since they didn’t pre-train their model on any data at all. Prof Kahng’s team also did not train their system using the same amount of computing power as Google used, and suggested this step may not have been carried out properly, crippling the model’s performance. Mirhoseini and Goldie also said the pre-processing step using EDA applications that was not explicitly described in their Nature paper wasn’t important enough to mention. The UCSD group, however, said they didn’t pre-train their model because they didn’t have access to the Google proprietary data. They claimed, however, their software had been verified by two other engineers at the internet giant, who were also listed as co-authors of the Nature paper. Separately, a fired Google AI researcher claims the internet goliath’s research paper was “done in context of a large potential Cloud deal” worth $120 million at the time.

Read more of this story at Slashdot.

Bill Gates Predicts ‘The Age of AI Has Begun’

Bill Gates calls the invention of AI “as fundamental as the creation of the microprocessor, the personal computer, the Internet, and the mobile phone,” predicting “Entire industries will reorient around it” in an essay titled “The AI Age has Begun.”
In my lifetime, I’ve seen two demonstrations of technology that struck me as revolutionary. The first time was in 1980, when I was introduced to a graphical user interface — the forerunner of every modern operating system, including Windows…. The second big surprise came just last year. I’d been meeting with the team from OpenAI since 2016 and was impressed by their steady progress. In mid-2022, I was so excited about their work that I gave them a challenge: train an artificial intelligence to pass an Advanced Placement biology exam. Make it capable of answering questions that it hasn’t been specifically trained for. (I picked AP Bio because the test is more than a simple regurgitation of scientific facts — it asks you to think critically about biology.) If you can do that, I said, then you’ll have made a true breakthrough.

I thought the challenge would keep them busy for two or three years. They finished it in just a few months. In September, when I met with them again, I watched in awe as they asked GPT, their AI model, 60 multiple-choice questions from the AP Bio exam — and it got 59 of them right. Then it wrote outstanding answers to six open-ended questions from the exam. We had an outside expert score the test, and GPT got a 5 — the highest possible score, and the equivalent to getting an A or A+ in a college-level biology course. Once it had aced the test, we asked it a non-scientific question: “What do you say to a father with a sick child?” It wrote a thoughtful answer that was probably better than most of us in the room would have given. The whole experience was stunning.

I knew I had just seen the most important advance in technology since the graphical user interface.

Some predictions from Gates:

“Eventually your main way of controlling a computer will no longer be pointing and clicking or tapping on menus and dialogue boxes. Instead, you’ll be able to write a request in plain English….”

“Advances in AI will enable the creation of a personal agent… It will see your latest emails, know about the meetings you attend, read what you read, and read the things you don’t want to bother with.”

“I think in the next five to 10 years, AI-driven software will finally deliver on the promise of revolutionizing the way people teach and learn. It will know your interests and your learning style so it can tailor content that will keep you engaged. It will measure your understanding, notice when you’re losing interest, and understand what kind of motivation you respond to. It will give immediate feedback.”

“AIs will dramatically accelerate the rate of medical breakthroughs. The amount of data in biology is very large, and it’s hard for humans to keep track of all the ways that complex biological systems work. There is already software that can look at this data, infer what the pathways are, search for targets on pathogens, and design drugs accordingly. Some companies are working on cancer drugs that were developed this way.”

AI will “help health-care workers make the most of their time by taking care of certain tasks for them — things like filing insurance claims, dealing with paperwork, and drafting notes from a doctor’s visit. I expect that there will be a lot of innovation in this area…. AIs will even give patients the ability to do basic triage, get advice about how to deal with health problems, and decide whether they need to seek treatment.”

Read more of this story at Slashdot.

What’s New in TypeScript 5.0?

InfoWorld reports that TypeScript 5.0 is smaller, faster, and simpler:

TypeScript 5.0, an update to Microsoft’s strongly typed JavaScript variant, is now available as a production release, Microsoft announced March 16. With the upgrade, TypeScript has been rebuilt to use ECMAScript modules. TypeScript 5.0 also modernizes decorators for class customization.

ECMAScript modules reduce package size and boost performance. Decorators, an upcoming ECMAScript feature, allow for customizing classes and their members in a reusable way, Microsoft noted in a March 1 blog post. Decorators can be used on methods, properties, getters, setters, and auto-accessors. Classes can be decorated for subclassing and registration. While TypeScript previously supported experimental decorators, these were modeled on a much older version of the decorators proposal. TypeScript 5.0 will permit decorators to be placed before or after export and export default, a change made since the January 26 beta release of the new version.

Read more of this story at Slashdot.