homehome Home chatchat Notifications


The unlikely story of how a pastry AI came to be used to detect cancer

The journey of this particular AI was as unexpected as it gets.

Mihai Andrei
October 16, 2024 @ 5:08 pm

share Share

AI image of pastries in a shop
AI-generated image of pastries in a shop.

In 2013, a computer systems engineer by the name of Hisashi Kambe was working on an innovative system. It was called BakeryScan and used a neural network model called AlexNet, which employed a technique called deep learning to classify images into different object categories.

It was a good fit. Japanese bakeries pride themselves on a wide variety of pastries. Bread and pastries have long been an import product in Japan, with scarcity and lack of variety being commonplace for centuries. As a result, people cherish variety now, and studies suggest that in Japan, the more types of pastries you have, the more you sell. In fact, many bakeries in Japan have a constant influx of new pastries coming in and out of selection. So much so, in fact, that even employees have a hard time knowing what some items are.

Having an AI that could automatically identify pastries makes things much easier. It enables fast, accurate recognition of pastries at checkout, reducing errors and speeding up the customer service process. It can also help with inventory management by tracking sales and product availability, ensuring that popular items are restocked efficiently. The system’s adaptability allows it to handle diverse product shapes and sizes, making it a valuable tool in busy bakery environments.

It worked well. It became pretty popular in the pastry industry, selling well, but then things took an unexpected turn.

From bread to healthcare

In 2017, a doctor in Kyoto, saw an ad for the algorithm. He thought the pastries looked pretty similar to cancer cells.

Thus began BakeryScan’s foray into the cancer detection world. In 2018, at a conference in Sapporo about the AI identification of cancer cells, Kambe said the algorithm is still impractical for some tasks due to the large amounts of data required. But he continued working on it — and deep learning algorithms also improved significantly.

By 2021, a prototype of BakeryScan customized for cancer detection (called Cyto-AiSCAN) was being trialed in two major hospitals in Japan. The algorithm had vastly improved — it didn’t need to look at single cells, it could work with entire microscope slides. Kambe refused to elaborate on how exactly the algorithm works, saying it’s an “original way,” just like with the pastries.

But the results spoke for themselves: the algorithm reportedly had 98% accuracy.

What started as an innovative solution for a bakery problem had evolved into a breakthrough in medical diagnostics. Hisashi Kambe’s journey with BakeryScan is a story of scientific success and adaptability, showing how a system designed for something as simple as identifying pastries could be repurposed for life-saving technology.

Nowadays, there are several AIs capable of medical diagnoses, but this is more than just a tale of deep learning or AI’s potential. It’s a testament to the flexibility of science. Since then, BakeryScan has been adapted to distinguish between pills in hospitals, amulets sold by shrines, and even 18th century Japanese woodblock prints.

share Share

This 5,500-year-old Kish tablet is the oldest written document

Beer, goats, and grains: here's what the oldest document reveals.

A Huge, Lazy Black Hole Is Redefining the Early Universe

Astronomers using the James Webb Space Telescope have discovered a massive, dormant black hole from just 800 million years after the Big Bang.

Did Columbus Bring Syphilis to Europe? Ancient DNA Suggests So

A new study pinpoints the origin of the STD to South America.

The Magnetic North Pole Has Shifted Again. Here’s Why It Matters

The magnetic North pole is now closer to Siberia than it is to Canada, and scientists aren't sure why.

For better or worse, machine learning is shaping biology research

Machine learning tools can increase the pace of biology research and open the door to new research questions, but the benefits don’t come without risks.

This Babylonian Student's 4,000-Year-Old Math Blunder Is Still Relatable Today

More than memorializing a math mistake, stone tablets show just how advanced the Babylonians were in their time.

Sixty Years Ago, We Nearly Wiped Out Bed Bugs. Then, They Started Changing

Driven to the brink of extinction, bed bugs adapted—and now pesticides are almost useless against them.

LG’s $60,000 Transparent TV Is So Luxe It’s Practically Invisible

This TV screen vanishes at the push of a button.

Couple Finds Giant Teeth in Backyard Belonging to 13,000-year-old Mastodon

A New York couple stumble upon an ancient mastodon fossil beneath their lawn.

Worms and Dogs Thrive in Chernobyl’s Radioactive Zone — and Scientists are Intrigued

In the Chernobyl Exclusion Zone, worms show no genetic damage despite living in highly radioactive soil, and free-ranging dogs persist despite contamination.