homehome Home chatchat Notifications


New AI can write in any style, answer deep questions, and even write poems

We are officially looking through the glass -- this AI is eerily good.

Mihai Andrei
July 24, 2020 @ 7:07 pm

share Share

“Music is the most advanced form of mathematics” — it’s a sentence you wouldn’t find anywhere on the internet, up until a few days ago. That’s because it wasn’t written by a philosopher, or a composer, or even a drunken math student.

The sentence was written GPT-3, a new language AI model recently released by OpenAI, a research laboratory that recently received a $1 billion funding grant from Microsoft. GPT-3 has the primary aim of answering questions, but it can also translate and coherently generate improvised text — and the results are crazy good.

This new AI is unlike anything we’ve seen before.

Writing new things

If you asked people two decades ago what artificial intelligence will be able to do, writing would never be on top of the list. Writing — the art of creating something and putting it into words, perhaps even adding your own style to it — is something inherently human. Or so we thought.

OpenAI’s machine learning approach relies on scraping massive amounts of data and analyzing it for statistical patterns, seeing what type of words work with what type of words, and then predicting and producing new sentences.

The previous version, model GPT-2, was trained on 40Gb of text and has 1.5 billion parameters. It was produced interesting results, but it wasn’t really that good. Meanwhile, GPT-3 has a whopping 175 billion parameters and it shows.

OpenAI is currently building an API for people who want to use the AI, but a few people have already gotten their hands on it for testing. Here is an example of the type of text it can output, from Vlad Alex of Towards Data Science:

Here is another example of GPT-3 writing about the dangers of GPT-3, via programmer Manuel Araoz. Long story short, the AI came up with a text about how dangerous the AI itself is.

Araoz even had the AI write a blog article about itself. Here’s how the article starts, and I dare you to find any clues that it’s not written by a human:

OpenAI’s GPT-3 may be the biggest thing since bitcoin
JUL 18, 2020

Summary: I share my early experiments with OpenAI’s new language prediction model (GPT-3) beta. I explain why I think GPT-3 has disruptive potential comparable to that of blockchain technology.

Changing styles

Remarkably the algorithm can even change its style. You can train it on different types of texts written in a specific style, and it mimics that style. Here’s an example of GPT-3 writing about Twitter in the style of 19th-century writer Jerome K. Jerome:

Here is another example where the AI writes in the style of an angry (and seemingly nihilistic) personal assistant:

Credits: Vlad Alex / Towards Data Science.

This is already impressive, but it also highlights the risks associated with AI. Jerome Pesenti, Facebook’s head of AI, went to Twitter to present a scary example. Prompted to write tweets from one word — Jews, black, women, holocaust — it came up with these results.

We need more progress on responsible AI before starting to truly use these models, Pesenti notes.

In addition, with the advent of deepfakes, this algorithm could make a great impersonator. OpenAI addresses this in their paper, saying that they are worried about abuses in fake content, spam, and phishing. For this purpose, the AI will not be freely available, only through an API.

“We will terminate API access for obviously harmful use-cases, such as harassment, spam, radicalization, or astroturfing [masking who is behind a message]. But we also know we can’t anticipate all of the possible consequences of this technology, so we are launching today in a private beta [test version] rather than general availability.”

The AI can also write code

As if that wasn’t impressive enough, the AI can also code. Not only can it code — but it can take human input and produce the desired result. In other words, you tell it what to do, and it can do it. Here’s an example:

This again, is very exciting and very scary at the same time. If this is improved and finessed, it can erase large swaths of an industry of millions of people. From buttons to data tables, or even re-creating Google’s homepage (without any training, no less), GPT-3 has already proven its coding ability. It will be a while before the AI can kill programming but with this preliminary performance, it seems more possible than ever.

This also hints at other general applications: every task that contains language, GPT-3 can tackle it. This even applies to images, because the algorithm can be trained on pixel sequences just like text. Its predecessor was already good at this, and GPT-3 will likely rival the best image AIs.

GPT-3 is walking a fine line between utopia and dystopia, and we’d be wise to take it seriously.

*This article was not written by an AI. Jokes aside, this could become a real disclaimer in the not-too distant future.

share Share

Why Paris Is Leaving Cars Behind for Bikes

Paris has reinvented itself as a cyclist’s paradise, moving from car-dominated streets to a city crisscrossed by bike lanes.

Single-Crystal Batteries Could Power EVs for Millions of Miles

A battery with this technology has been constantly charging and discharging for 6 years and it's at 80% of capacity.

Can AI help us create a universal flu vaccine? These researchers believe so

A universal flu vaccine would be a game changer. Could artificial intelligence help us defeat influenza once and for all?

Scientists Achieve Quantum Teleportation Using Existing Internet Cables

Researchers demonstrate quantum teleportation over internet traffic, paving the way for secure applications.

Chatbots won’t help anyone make weapons of mass destruction. But other AI systems just might

Over the past two years, we have seen much written about the “promise and peril” of artificial intelligence (AI). Some have suggested AI systems might aid in the construction of chemical or biological weapons. How realistic are these concerns? As researchers in the field of bioterrorism and health intelligence, we have been trying to separate […]

Godfather of AI says there's a 10-20% chance AI wipes out humanity in 30 years

AI could bring an industrial revolution-level change, but at what cost?

The pair of jeans that sent the chess world in turmoil

Magnus Carlsen wore jeans to a chess tournament. Now the entire sport is boiling over.

Leopards have unique roars, and AI can identify them

They say you can identify the leopard by its spots, but as it turns out, you can also identify it through its unique roar. Leopards, notoriously difficult to monitor due to their elusive nature, could soon be tracked using passive acoustic recorders paired with AI-based analysis. Leopard populations face significant challenges, with their ranges shrinking […]

3D-printed 'ghost guns', like the one Luigi Mangione allegedly used to kill a health care CEO, surge in popularity as law enforcement struggles to keep up

The use of 3D-printed guns in criminal and violent activities is likely to continue to increase. And governments and police will continue to have trouble regulating them.

For better or worse, machine learning is shaping biology research

Machine learning tools can increase the pace of biology research and open the door to new research questions, but the benefits don’t come without risks.