ZME Science
No Result
View All Result
ZME Science
No Result
View All Result
ZME Science

Home → Science → News

Microsoft’s new A.I. writes captions for images (and it’s hilarious)

We tested Microsoft's CaptionBot and had some laughs.

Tibi PuiubyTibi Puiu
April 14, 2016
in News, Tech
A A
Share on FacebookShare on TwitterSubmit to Reddit

The big tech companies in Silicon Valley are betting big on artificial intelligence, for good reason too. Previously, ZME Science told you all about how Google’s amazing dream-like neural networks operate to make sense of images. Later, I had a lot of fun toying with a similar neural network from Microsoft also available to the public which can interpret emotions based on facial expressions. Now, Microsoft is showcasing another powerful tool that writes captions for images.

They’re very basic — essentially descriptions of what the neural network algorithm “sees”. Sometimes the CaptionBot does a pretty good job.

a4

a10

a2

Pretty good. It seems to be handling celebrities and portraits nicely but gets really confused if there are more things in focus.

a1
This darling is CNUT, the ZME Science office cat.

In fact, after I gave it a couple more spins it started to sound like a half-blind uncle!

RelatedPosts

Endowing AI with confidence and doubt will make it more useful, paper argues
AI debates its own ethics at Oxford University, concludes the only way to be safe is “no AI at all”
Chat GPT’s new O1 model escaped its environment to complete “impossible” hacking task — should we be concerned?
New AI can make ‘zoom and enhance’ satellite imagery, making it sharper and more useful
It's a freaking golf ball, c'mon!
It’s a freaking golf ball, c’mon!

Then it really showed its (hilarious) limitations.

I would definitely
Ok… where’s the restaurant?
a7
Close, I guess.
Well...
Well…
Time-keeping wizards, yes.
Time-keeping wizards, yes.
a11
It’s the Grand Canyon FYI. The sheep though where’d you get that?
a6
Close, but no cigar.

 

The CaptionBot uses two neural networks, one to parse the images and the other to generate the caption. The images are identified using Microsoft’s Computer Vision API, mixed  with data from the Bing Image Search API. The Emotion API is what detects facial expressions. As it gets fed more photos, including these I played with, it will naturally get better and better. You can try it on your own here. Post some in the comments. This should be fun!

Tags: artificial intelligence

ShareTweetShare
Tibi Puiu

Tibi Puiu

Tibi is a science journalist and co-founder of ZME Science. He writes mainly about emerging tech, physics, climate, and space. In his spare time, Tibi likes to make weird music on his computer and groom felines. He has a B.Sc in mechanical engineering and an M.Sc in renewable energy systems.

Related Posts

Inventions

China’s New Mosquito Drone Could Probably Slip Through Windows and Spy Undetected

byMihai Andrei
3 weeks ago
Future

Your Brain Could Reveal a Deadly Heart Risk. AI Is Learning to Read the Signs

byMihai Andrei
4 weeks ago
Future

Can you upload a human mind into a computer? Here’s what a neuroscientist has to say about it

byDobromir Rahnev
2 months ago
AI-generated image.
Future

Does AI Have Free Will? This Philosopher Thinks So

byMihai Andrei
2 months ago

Recent news

Bees are facing a massive survival challenge. Could AI help them?

July 16, 2025

NASA finally figures out what’s up with those “Mars spiders”

July 15, 2025

Cycling Is Four Times More Efficient Than Walking. A Biomechanics Expert Explains Why

July 15, 2025
  • About
  • Advertise
  • Editorial Policy
  • Privacy Policy and Terms of Use
  • How we review products
  • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • Science News
  • Environment
  • Health
  • Space
  • Future
  • Features
    • Natural Sciences
    • Physics
      • Matter and Energy
      • Quantum Mechanics
      • Thermodynamics
    • Chemistry
      • Periodic Table
      • Applied Chemistry
      • Materials
      • Physical Chemistry
    • Biology
      • Anatomy
      • Biochemistry
      • Ecology
      • Genetics
      • Microbiology
      • Plants and Fungi
    • Geology and Paleontology
      • Planet Earth
      • Earth Dynamics
      • Rocks and Minerals
      • Volcanoes
      • Dinosaurs
      • Fossils
    • Animals
      • Mammals
      • Birds
      • Fish
      • Amphibians
      • Reptiles
      • Invertebrates
      • Pets
      • Conservation
      • Animal facts
    • Climate and Weather
      • Climate change
      • Weather and atmosphere
    • Health
      • Drugs
      • Diseases and Conditions
      • Human Body
      • Mind and Brain
      • Food and Nutrition
      • Wellness
    • History and Humanities
      • Anthropology
      • Archaeology
      • History
      • Economics
      • People
      • Sociology
    • Space & Astronomy
      • The Solar System
      • Sun
      • The Moon
      • Planets
      • Asteroids, meteors & comets
      • Astronomy
      • Astrophysics
      • Cosmology
      • Exoplanets & Alien Life
      • Spaceflight and Exploration
    • Technology
      • Computer Science & IT
      • Engineering
      • Inventions
      • Sustainability
      • Renewable Energy
      • Green Living
    • Culture
    • Resources
  • Videos
  • Reviews
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Editorial policy
    • Privacy Policy
    • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.