This website uses cookies to ensure you get the best experience on our website. Learn more

The Internet Couldn't Handle All the Data From the First Black Hole Photo

On Wednesday, astronomers announced that they’d captured the world’s first image of a black hole — and the internet couldn’t handle it. No, we’re not talking about black hole Shrek memes or snarky opinion pieces about how this image of an object 55 million light-years away was “so blurry.” We’re talking about how the internet literally couldn’t handle the quantity of data collected by the eight telescopes across five continents that make up the Event Horizon Telescope experiment that captured this image of the black hole at the center of the galaxy Messier 87.

Instead, the massive quantity of data collected by the radio antennae had to be flown on airplanes to central data centers where it could be cleaned and analyzed. So in addition to being a massive achievement of human ingenuity and understanding, one that confirmed several theories about black holes, the M87 black hole image was also a Herculean feat of data storage and management.

Over seven days in April 2017, the EHT experiment turned all eight telescopes toward M87. Synchronized by custom-made atomic clocks, they all started collecting the incoming radio signals from the distant black hole and logging the data on super-fast data recorders that had been built for this very task.

“We had 5 petabytes of data recorded,” Dan Marrone, Ph.D., an associate professor of astronomy at the University of Arizona who specialized in data storage for the EHT experiment, told reporters on Wednesday.

“It amounts to more than half a ton of hard drives. Five petabytes is a lot of data: It’s equivalent to 5,000 years of MP3 files.”

Here’s why and how this one picture required the data equivalent of 1.39 billion copies of “Old Town Road” by Lil Nas X.

The ALMA observatory in Chile was one of the eight telescopes that imaged the M87 black hole.

Eight Synchronized Telescopes

The EHT experiment employed a technique called very long baseline interferometry, which used the eight simultaneously recording telescopes to essentially turn the Earth into a single, rotating telescope dish. Each of these telescopes recorded raw incoming radio signals as tons of data.

Article continues below

Beat the "Sunday Scaries" with a weekly newsletter that mixes soothing science and relatable advice to get your mind & body ready for the week ahead.

In other words, it’s like if eight people took videos of the same far-away phenomenon from different angles, then put all of their videos together to make one really clear video. In this scenario, though, the object was really far away, and the telescopes were really far apart.

The advantage of this long baseline between telescopes is that the rotation of the Earth gave scientists shots of the black hole from eight simultaneous angles.

Cleaning the Data

Once all 1,000 pounds of hard drives were filled with these 5 petabytes of raw data, they were loaded onto airplanes and flown to two centralized “correlators,” located in Massachusetts and Germany.

“The fastest way to do that is not over the internet, it’s actually to put them on planes,” said Marrone. “There’s no internet that can compete with 5 petabytes of data on a plane.”

Adding to this challenge, the scientists had to wait until summer to send the hard drives from the South Pole Telescope, as the images were captured during Antarctica’s winter.

The correlators then began the job of syncing up all the data from the telescopes with each other. This means that supercomputers took all the raw observational data collected by the telescopes and used the atomic clock information to line them all up with one another, creating a seamless record of the wavefront of light from the black hole as it reached Earth.

Exchanging Tools With Silicon Valley

Chi-Kwan Chan, Ph.D., a computational astrophysicist at the University of Arizona who dealt with computation for the M87 imaging project, tells Inverse that once the correlators had cleaned the data, the task then got a lot more granular.

“After that step, people usually just use a work station and do the computations on them,” he says. “But the contribution I made was I brought cloud computing technology into the collaboration so we could launch many powerful virtual machines in the cloud to do data analysis and accelerate it.”

Chan and his team developed this software, which helped the EHT team clean the data even further to create the final, composite image, which is just a few hundred kilobytes. He’s hopeful that the tech industry will be able to use this software for network architecture in the future.

“In that sense we’re also giving back to society,” he says.

Notably, the University of Arizona’s computers that Chan and his team have used to run black hole simulations are based on graphics processing units, which are computationally very powerful. These are the same graphics cards that have come under extremely high demand as they’ve become popular among cryptocurrency miners. So just as the black hole project created software that will persist for others to use, it also took cues from a vastly different field of computer science, all in the name of discovery.

Ironically, Chan’s team used these powerful GPUs to simulate so many black holes in advance of the M87 observation, they already knew what to expect from the real black hole.

“We created a huge library of black hole images,” he says. “Because we saw so many of them and saw so many possibilities, we were not surprised when we saw the real one.”

Media via European Space Agency, Event Horizon Telescope

Earth's Most Destructive Day Ever: Chicxulub Crater Evidence Study Tells a New Story

No wonder the dinosaurs didn’t survive.

The day a massive asteroid hit our planet about 65 million years ago may have been the most chaotic day on Earth, and we’re not just talking about the mass extinction part. New research on the Chicxulub crater in the journal Proceedings of the National Academy of Sciences outlines the aftermath of this asteroid impact, showing what it was really like to be there at the beginning of the Cretaceous-Paleogene extinction event, from the moment of impact until the Earth was plunged into chilling darkness.

Humans Can Reverse Their Biological Age, Shows a 'Curious Case' Study

In a yearlong clinical trial, three drugs rolled back participants' epigenetic clock.

Someone call Brad Pitt, because it might be time for a sci-fi spin on The Curious Case of Benjamin Button. New research shows humans may be able to reverse their epigenetic clocks, a measure of biological age, with a trio of drugs that are already on the market.

In a small, 1-year clinical trial published Thursday in the journal Aging Cell, nine participants took three common medications — growth hormone and two diabetes drugs — and reversed their biological age by 2-and-a-half years on average. Greg Fahy, Ph.D., lead author of the study and chief science officer of anti-aging therapeutics company Intervene Immune, tells Inverse that this research proves the concept that biological aging may not be unstoppable.

Human-Fueled Superbugs Are Putting This Intelligent Animal in Danger

Dolphins reflect the alarming trend seen in US hospitals.

As hospitals grapple with the growing problem of superbugs, a threat that could cost 10 million lives a year by 2050, new research suggests that humans aren’t the only animals that these serious, difficult-to-treat infections could affect.

It seems we may be spreading our problems to the marine community, too.

The Science Behind Why a Dog Loves to Be Called a "Good Boy"

Who's a GOOD BOY?!?

By Lauren Mackenzie Reynolds
Filed Under Animals & Pets

Scrolling back through my Instagram posts recently, I came across a short video I took a few summers ago. I’m throwing a ball into a lake for my parent’s yellow lab, Johnson, to fetch. Johnson is pretty excited about the whole affair — perhaps in part because after the successful retrieval you can hear my dad, sitting on the dock offscreen, praising his effort: “Good boy! _GOOD BOY!!!_”

Genetically Modified Mosquitoes Mate With Local Species in Brazil

These mutant offspring are the opposite of what researchers intended.

Mosquitoes around the world are known carriers of dangerous and potentially deadly human diseases such as West Nile virus, yellow fever, dengue, malaria, and Zika. In recent years as scientists have moved away from the hazardous insecticides of the past, their focus has turned to genetic modification as a more effective and less harmful way to control mosquito populations. But new results published in Scientific Reports by Yale researchers show that this new plan of attack is not without its bugs — literally.