December 23, 2024

NASA Turns to the Cloud for Help With Deluge of Data From Next-Generation Earth Missions

Part of the SWOT satellites science instrument payload beings in a tidy space at NASAs Jet Propulsion Laboratory during assembly. By measuring the height of the water in the planets ocean, lakes, and rivers, scientists can track the volume and place of the finite resource around the world. Credit: NASA/JPL-Caltech
The center is among numerous under NASAs Earth Science Data Systems program responsible for processing, archiving, recording, and distributing information from the agencys Earth-observing satellites and field jobs. The program has actually been working for several years on a solution to the information-volume difficulty by moving its information and data-handling systems from regional servers to the cloud– software and computing services that operate on the internet rather of locally on somebodys device.
The Sentinel-6 Michael Freilich satellite, part of the U.S.-European Sentinel-6/ Jason-CS (Continuity of Service) objective, is the first NASA satellite to utilize this cloud system, although the quantity of information the spacecraft sends back isnt as large as the information many future satellites will return.
Part of the NISAR satellite rests in a thermal vacuum chamber at NASAs Jet Propulsion Laboratory in August 2020. The Earth satellite will track subtle modifications in the planets surface as little as 0.4 inches. Credit: NASA/JPL-Caltech
Information from SWOT will be archived with the Physical Oceanography Distributed Active Archive Center while information from NISAR will be dealt with by the Alaska Satellite Facility Distributed Active Archive. NASAs existing Earth science information archive is around 40 petabyes (1 petabyte is 1,000 terabytes), but by 2025– a couple of years after SWOT and NISAR are introduced– the archive is anticipated to hold more than 245 petabytes of data.
Both NISAR and SWOT will use radar-based instruments to collect details. Targeting a 2023 launch, NISAR will keep an eye on the worlds surface, collecting information on environmental characteristics including shifts in the land connected with earthquakes and volcanic eruptions, changes to Earths ice sheets and glaciers, and fluctuations in agricultural activities, wetlands, and the size of forests.
Explore this 3D model of the SWOT satellite by focusing and out, or clicking and dragging the image around. Credit: NASA/JPL-Caltech
Set for a 2022 launch, SWOT will keep track of the height of the planets surface area water, both ocean and freshwater, and will assist scientists assemble the very first survey of the worlds fresh water and small-scale ocean currents. SWOT is being collectively developed by NASA and the French space firm Centre National dEtudes Spatial.
” This is a new period for Earth observation missions, and the substantial amount of information they will generate needs a new era for data dealing with,” stated Kevin Murphy, chief science information officer for NASAs Science Mission Directorate. “NASA is not simply working across the firm to help with effective access to a typical cloud facilities, were likewise training the science community to gain access to, examine, and use that information.”
Faster Downloads
Presently, Earth science satellites send out data back to ground stations where engineers turn the raw information from ones and zeroes into measurements that people can utilize and understand. Processing the raw data increases the file size, however for older missions that return reasonably smaller sized quantities of info, this isnt a substantial issue. The measurements are then sent out to an information archive that keeps the information on servers. In basic, when a researcher wishes to use a dataset, they go to a site, download the information they desire, and then deal with it on their device.
Nevertheless, with missions like SWOT and NISAR, that will not be feasible for a lot of researchers. If somebody desired to download a days worth of info from SWOT onto their computer system, they d require 20 laptops, each capable of keeping a terabyte of data. If a researcher wished to download 4 days worth of data from NISAR, it would take about a year to perform on a typical house internet connection. Dealing with information saved in the cloud means researchers wont have to purchase huge hard disk drives to download the data or wait months as numerous big files download to their system. “Processing and saving high volumes of information in the cloud will enable an affordable, efficient approach to the research study of big-data issues,” said Lee-Lueng Fu, JPL task researcher for SWOT.
Infrastructure constraints will not be as much of an issue, either, given that organizations wont need to pay to save mind-boggling quantities of data or preserve the physical area for all those hard drives. “We just do not have the extra physical server area at JPL with sufficient capability and versatility to support both NISAR and SWOT,” stated Hook Hua, a JPL science data systems architect for both objectives.
NASA engineers have actually currently benefited from this aspect of cloud computing for a proof-of-concept product using information from Sentinel-1. The satellite is an ESA (European Space Agency) objective that likewise takes a look at changes to Earths surface, although it uses a various kind of radar instrument than the ones NISAR will use. Dealing with Sentinel-1 information in the cloud, engineers produced a colorized map showing the change in Earths surface area from more vegetated locations to deserts. “It took a week of consistent computing in the cloud, using the equivalent of thousands of devices,” said Paul Rosen, JPL job researcher for NISAR. “If you attempted to do this outside the cloud, you d have had to buy all those thousands of machines.”
Cloud computing wont change all of the ways in which scientists deal with science datasets, however a minimum of for Earth science, its definitely picking up speed, stated Alex Gardner, a NISAR science staff member at JPL who studies glaciers and sea level rise. He imagines that many of his analyses will happen somewhere else in the near future instead of on his laptop or personal server. “I totally anticipate in 5 to 10 years, I will not have much of a hard disk on my computer and I will be exploring the brand-new firehose of data in the cloud,” he stated.

The advanced Earth science satellites launching in the future will be generating unmatched quantities of data on our planets important signs. Cloud computing will assist researchers take advantage of those chests of details. Credit: NASA Earth Observatory
As satellites collect bigger and bigger amounts of engineers, data and scientists are carrying out services to manage these big boosts.
The cutting-edge Earth science satellites introducing in the next couple of years will give more comprehensive views of our planet than ever before. Well have the ability to track small ocean functions like seaside currents that move nutrients essential to marine food webs, keep an eye on how much fresh water streams through lakes and rivers, and area motion in Earths surface of less than half an inch (a centimeter). These satellites will likewise produce a deluge of data that has engineers and scientists setting up systems in the cloud capable of processing, saving, and examining all of that digital information.
” About five or 6 years ago, there was a realization that future Earth missions were going to be creating a huge volume of data which the systems we were utilizing would become inadequate extremely rapidly,” stated Suresh Vannan, manager of the Physical Oceanography Distributed Active Archive Center based at NASAs Jet Propulsion Laboratory in Southern California.

The modern Earth science satellites releasing in the near future will be producing extraordinary quantities of information on our planets crucial signs. Data from SWOT will be archived with the Physical Oceanography Distributed Active Archive Center while information from NISAR will be handled by the Alaska Satellite Facility Distributed Active Archive. NASAs current Earth science information archive is around 40 petabyes (1 petabyte is 1,000 terabytes), however by 2025– a couple of years after SWOT and NISAR are introduced– the archive is expected to hold more than 245 petabytes of data.
Presently, Earth science satellites send out information back to ground stations where engineers turn the raw details from ones and nos into measurements that people can understand and utilize. Working with data stored in the cloud suggests researchers will not have to purchase big difficult drives to download the data or wait months as numerous large files download to their system.