This website uses cookies to ensure you get the best experience on our website. Learn more

The Internet Couldn't Handle All the Data From the First Black Hole Photo

On Wednesday, astronomers announced that they’d captured the world’s first image of a black hole — and the internet couldn’t handle it. No, we’re not talking about black hole Shrek memes or snarky opinion pieces about how this image of an object 55 million light-years away was “so blurry.” We’re talking about how the internet literally couldn’t handle the quantity of data collected by the eight telescopes across five continents that make up the Event Horizon Telescope experiment that captured this image of the black hole at the center of the galaxy Messier 87.

Instead, the massive quantity of data collected by the radio antennae had to be flown on airplanes to central data centers where it could be cleaned and analyzed. So in addition to being a massive achievement of human ingenuity and understanding, one that confirmed several theories about black holes, the M87 black hole image was also a Herculean feat of data storage and management.

Over seven days in April 2017, the EHT experiment turned all eight telescopes toward M87. Synchronized by custom-made atomic clocks, they all started collecting the incoming radio signals from the distant black hole and logging the data on super-fast data recorders that had been built for this very task.

“We had 5 petabytes of data recorded,” Dan Marrone, Ph.D., an associate professor of astronomy at the University of Arizona who specialized in data storage for the EHT experiment, told reporters on Wednesday.

“It amounts to more than half a ton of hard drives. Five petabytes is a lot of data: It’s equivalent to 5,000 years of MP3 files.”

Here’s why and how this one picture required the data equivalent of 1.39 billion copies of “Old Town Road” by Lil Nas X.

The ALMA observatory in Chile was one of the eight telescopes that imaged the M87 black hole.

Eight Synchronized Telescopes

The EHT experiment employed a technique called very long baseline interferometry, which used the eight simultaneously recording telescopes to essentially turn the Earth into a single, rotating telescope dish. Each of these telescopes recorded raw incoming radio signals as tons of data.

Article continues below

Beat the "Sunday Scaries" with a weekly newsletter that mixes soothing science and relatable advice to get your mind & body ready for the week ahead.
Subscribe:

In other words, it’s like if eight people took videos of the same far-away phenomenon from different angles, then put all of their videos together to make one really clear video. In this scenario, though, the object was really far away, and the telescopes were really far apart.

The advantage of this long baseline between telescopes is that the rotation of the Earth gave scientists shots of the black hole from eight simultaneous angles.

Cleaning the Data

Once all 1,000 pounds of hard drives were filled with these 5 petabytes of raw data, they were loaded onto airplanes and flown to two centralized “correlators,” located in Massachusetts and Germany.

“The fastest way to do that is not over the internet, it’s actually to put them on planes,” said Marrone. “There’s no internet that can compete with 5 petabytes of data on a plane.”

Adding to this challenge, the scientists had to wait until summer to send the hard drives from the South Pole Telescope, as the images were captured during Antarctica’s winter.

The correlators then began the job of syncing up all the data from the telescopes with each other. This means that supercomputers took all the raw observational data collected by the telescopes and used the atomic clock information to line them all up with one another, creating a seamless record of the wavefront of light from the black hole as it reached Earth.

Exchanging Tools With Silicon Valley

Chi-Kwan Chan, Ph.D., a computational astrophysicist at the University of Arizona who dealt with computation for the M87 imaging project, tells Inverse that once the correlators had cleaned the data, the task then got a lot more granular.

“After that step, people usually just use a work station and do the computations on them,” he says. “But the contribution I made was I brought cloud computing technology into the collaboration so we could launch many powerful virtual machines in the cloud to do data analysis and accelerate it.”

Chan and his team developed this software, which helped the EHT team clean the data even further to create the final, composite image, which is just a few hundred kilobytes. He’s hopeful that the tech industry will be able to use this software for network architecture in the future.

“In that sense we’re also giving back to society,” he says.

Notably, the University of Arizona’s computers that Chan and his team have used to run black hole simulations are based on graphics processing units, which are computationally very powerful. These are the same graphics cards that have come under extremely high demand as they’ve become popular among cryptocurrency miners. So just as the black hole project created software that will persist for others to use, it also took cues from a vastly different field of computer science, all in the name of discovery.

Ironically, Chan’s team used these powerful GPUs to simulate so many black holes in advance of the M87 observation, they already knew what to expect from the real black hole.

“We created a huge library of black hole images,” he says. “Because we saw so many of them and saw so many possibilities, we were not surprised when we saw the real one.”

Media via European Space Agency, Event Horizon Telescope

5 Biohack Items Worth Buying On Amazon

You don't have to be a biologist to hack your own systems. Here's how to get started.

Biohacking is a relatively new term that can mean everything from messing with your diet and lifestyle so you feel and look better to installing implants to hack your own hardware. We are not into that last one, which seems more suited to a dystopian novel than to Inverse. But we are down with anything that helps us function better, feel better, fit into our clothes with fewer regrets, and generally live life happier. We are all about the first one.

Hack Your Way to Hydration

Let's be real, getting 64 ounces a day can be hard.

Everyone knows that the best way to stay hydrated is to, you know, simply drink water. The general rule of thumb is that on average you should be drinking 64-ounces of water or eight 8-ounce glasses per day (although the exact number is dependent upon your weight). But knowing that you should drink that much water and actually doing it are two different things. Not everyone likes drinking water because it’s normally tasteless and plain—and alternatives like sports drinks, juices and sodas are loaded with sugar. But there’s a way to get your legit water intake and make it tastier, too.

Video Shows How "Drunk Munchies" Are the Scientific Consequence of a Night Out

It's a vicious, delicious cycle.

It’s Saturday night, baby. You’ve had two or three or seven drinks, you’re not sure, you lost count. You had a good night (you danced briefly with that cute girl who always wears acid-washed overalls before they realized you weren’t someone else), but it’s coming to a close and you’re fast approaching your apartment in an Uber. You pass by a blurry blue and purple sign that can be none other than a Taco Bell. You are overcome by the munchies. They are undeniable and, in this moment, stronger than your common sense. You leap out of the moving car and roll safely to the sidewalk. You dust yourself off and stumble into the lobby. Cheesy Gordita Crunch Town, USA, here you come.

A Squished Face Isn't the Only Reason It's Hard for Bulldogs to Breathe

Vets discover another issue hiding beneath their short faces.

What you can’t tell by just an Instagram scroll through your favorite bulldogs is how exquisitely messed up their breed is. Behind those adorable flaps are dogs whose poor genetic diversity creates a host of health problems including, but not limited to, breathing difficulties. The root issue for French and English bulldogs has long been thought to be their squished faces, but a new study points out another factor that may be compounding the problem.

Australia's "Last Unspoiled Paradise" Hides New Threat Under 238 Tons of Trash

"This will be an endless game of catch up."

The world’s plastic problem persists in hard-to-reach places: human poop, the darkest depths of the ocean, and the internal organs of sea creatures. But as researchers describe in a devastating paper published Thursday, in “Australia’s last unspoiled paradise,” visual reminders of our plastic problem adorn the beaches in the form of familiar household items, piled so densely that they completely obscure the sand. Even worse, they write, is what’s beneath it.