New augmented reality applications assist astronaut repairs to Space Station

New augmented reality applications assist astronaut repairs to Space Station

Most often, communications delays between the International Space Station crew and ground are nearly unnoticeable as they are routed from one Tracking and Data Relay Satellite to another as the station orbits about 250 miles above Earth. As NASA prepares to explore the Moon, about 240,000 miles away, and eventually Mars, which averages about 245 million miles away, NASA is developing tools to increase astronaut autonomy to operate spacecraft or systems without assistance from the Mission Control Center at NASA’s Johnson Space Center in Houston because communication delays from Earth will last longer.

The T2 Augmented Reality (T2AR) project demonstrates how station crew members can inspect and maintain scientific and exercise equipment critical to maintaining crew health and achieving research goals without assistance from ground teams.

To kick off the T2AR activities in orbit in April, astronaut Soichi Noguchi of the Japan Aerospace Exploration Agency (JAXA) was tasked with maintenance for one of the space station crew’s pieces of exercise equipment, the T2 Treadmill. The inspection procedure is typically available as a PDF document to be accessed on a computer or tablet, which can be hard to hold while also operating tools or flashlights or examining equipment in a tight space.

This time, no extra handheld instructions or communication with ground teams in Mission Control were necessary since the information was all in plain sight. Using the Microsoft HoloLens augmented reality (AR) goggles and armed with novel procedure tracking software NASA developed, Noguchi had step-by-step guidance and cues to assist in the work without referring to a separate screen.

T2AR is the first in-space operational use of the HoloLens in combination with custom-built AR software, which enables an astronaut to perform unassisted maintenance and inspections on a major piece of crew support hardware. This investigation builds on the Sidekick experiment former NASA astronaut Scott Kelly conducted in 2016.

This novel demonstration used 3D directional cues to direct the astronaut’s gaze to the proper work sites and displayed the procedure instructions. The device followed an astronaut’s verbal instructions to navigate procedures and displayed AR cues and procedure text over the hardware as appropriate for the procedure step being performed. The system also provided supplemental information, such as instructional videos and system overlays, to assist in performing the procedure.

“AR tools hold the promise of allowing us to pre-package guidance and expertise,” says International Space Station associate scientist Bryan Dansberry at Johnson. “The space station is the perfect platform to test out AR systems and refine these tools so they will be ready when future astronauts need them. Closer to home, these tests help to mature software and AR technology now so expertise and support are available in remote locations around the world.”

Since that first activity with Noguchi, astronaut Thomas Pesquet of ESA (European Space Agency) and NASA astronaut Megan McArthur have also used the AR application aboard the space station. The tests provided researchers with information about how the technology does and does not work to assist crew inspection maintenance procedures. With the completion of this maintenance activity, nine more test sessions remain in the technology demonstration plan.

While this demonstration was currently limited to the critical T2 Treadmill, the platform is designed to be used across a wide variety of space station needs in the future, leading to increased crew efficiency and activity execution accuracy. In addition to use on the space station, this technology could aid astronauts on future journeys to the Moon and Mars, when communication delays are greater, by allowing them to conduct tasks without waiting for further direction from Earth.

NASA’s Advanced Exploration Systems division sponsors this technology demonstration aboard the microgravity laboratory to advance future human and robotic exploration missions as part of NASA’s Moon and Mars exploration approach.

News Related

OTHER NEWS

Space industry grapples with COVID-19-related oxygen fuel shortage

A pandemic-related shortage of a key rocket propellant, liquid oxygen, could force rocket launches to be postponed in coming months, possibly delaying important scientific and national defense missions, industry observers ... Read more »

Gaofen 5-02 satellite launched from Taiyuan

China launched the Gaofen 5-02 Earth-observation satellite on Tuesday morning at the Taiyuan Satellite Launch Center in Shanxi province, according to the China National Space Administration. The administration said the ... Read more »

Largest virtual universe free for anyone to explore

Forget about online games that promise you a “whole world” to explore. An international team of researchers has generated an entire virtual UNIVERSE, and made it freely available on the ... Read more »

Laser solid-phase synthesis of single atom catalysts

Laser fabrication of nanoparticles offers a powerful and flexible alternative to the purely chemical approaches. In recent years, laser synthesized precious metal nanoparticles are becoming increasingly important in catalysis due ... Read more »

Kleos secures A$12.6 million to grow constellation

Kleos Space S.A, a space-powered Radio Frequency Reconnaissance data-as-a- service (DaaS) company, has secured A$12.6 million (equivalent to 9.3 million USD) from new and existing institutional and sophisticated investors in ... Read more »

Eutelsat completes OneWeb equity investment

Eutelsat Communications confirms the closing of its $550m equity investment in OneWeb announced on April 27, 2021. Subject to completion of the subsequently announced investments in OneWeb by Bharti and ... Read more »

Global computing's carbon footprint is bigger than previously estimated

The world is more online than ever before, and as the digital economy continues to expand, so does the Internet’s carbon footprint. According to a new study, published Friday in ... Read more »

Smoke alarm, burning smell disrupt crew on International Space Station

Russian cosmonauts woke up to an emergency alarm Thursday in one of their service modules at the International Space Station. Audio from NASA’s television feed caught a French astronaut identifying ... Read more »

NASA works to give satellite swarms a hive mind

Swarms of small satellites could communicate amongst themselves to collect data on important weather patterns at different times of the day or year, and from multiple angles. Such swarms, using ... Read more »

New ALMA receivers achieve first light, set record for observational capabilities

new set of receivers installed on antennas at the Atacama Large Millimeter/submillimeter Array (ALMA) have achieved first light. With it, they set a new record for the longest wavelengths visible ... Read more »

Crews at Russian Cosmodrome assemble spacecraft with VR Glasses

Virtual reality glasses are used by the military units of the Plesetsk cosmodrome in Russia to train to assemble space rockets, St. Petersburg-based Mozhaisky Military Space Academy told reporters on ... Read more »

Satellite in sun's backyard unravels the origins of interplanetary dust

What do shooting stars and astronaut safety have in common? Both stem from the sub-microscopic rock fragments found throughout the solar system, sometimes called interplanetary dust. When these particles collide ... Read more »

NASA awards launch services contract for GOES-U Mission

NASA has selected Space Exploration Technologies (SpaceX) of Hawthorne, California, to provide launch services for the Geostationary Operational Environmental Satellite-U (GOES-U) mission. GOES-U will provide advanced imagery and atmospheric measurements ... Read more »

DARPA announces research teams to advance fundamental science of atomic vapors

DARPA has announced its selection of eight industry and university research teams to support the Science of Atomic Vapors for New Technologies (SAVaNT) program that kicked off this week. The ... Read more »

DLR Lampoldshausen prepares P5 test stand for the technologies of the future

The German Aerospace Center (Deutsches Zentrum fur Luft- und Raumfahrt; DLR) is preparing a central component of its extensive test infrastructure for the future by expanding the European Space Agency ... Read more »

Protective equipment against radiation to be tested on Nauka Module on ISS in 2023

New equipment that will help protect people from radiation during interplanetary flights will be tested on the Russian Nauka multipurpose laboratory module at the International Space Station, the head of ... Read more »

German ESA astronaut Matthias Maurer is ready for his first ISS mission - 'Cosmic Kiss'

At the end of October 2021, the German ESA astronaut Matthias Maurer, together with the NASA astronauts Raja Chari, Thomas H. Marshburn and Kayla Barron, are expected to launch to ... Read more »

Astronomers nail down the origins of rare loner dwarf galaxies

By definition, dwarf galaxies are small and dim, with just a fraction of the stars found in the Milky Way and other galaxies. There are, however, giants among the dwarfs: ... Read more »

Rocket flight to sharpen NASA's study of the Sun

It’s best not to look directly at the Sun, unless you’re one of NASA’s Sun-observing instruments. And even then, doing so will cause some damage. Exposure to the Sun degrades ... Read more »

Diamonds in the sky

Scientists from the Okinawa Institute of Science and Technology Graduate University (OIST) and Rutgers University have used simple concepts from granular physics to explain the curious diamond shapes of two ... Read more »

Planetary radar observes 1,000th near-earth asteroid since 1968

Seven days after this historic milestone, a massive antenna at NASA’s Deep Space Network Goldstone complex imaged another, far larger object. On Aug. 14, 2021, a small near-Earth asteroid (NEA) ... Read more »

Physicists discover black holes exert a pressure in serendipitous scientific first

Physicists at the University of Sussex have discovered that black holes exert a pressure on their environment, in a scientific first. In 1974 Stephen Hawking made the seminal discovery that ... Read more »

ESA Council agrees resolution on Ariane 6 and Vega-C exploitation and future space transportation

ESA Member States have agreed upon the boundary conditions for Europe’s upcoming exploitation of Ariane 6 and Vega-C and request ESA to propose a roadmap for new and innovative space ... Read more »

The Sun's 11-year cycle cannot explain global warming

The Earth’s global climate system fluctuates in 11-year and 3, 5-year cycles find Yizhak Feliks, Justin Small and Michael Ghil. The study was published in Climate Dynamics on July 15th. ... Read more »

Leak and destroy: On the hunt for climate killing gas

After finding a rusty gas canister near his midwest US home, Rick Karas checked online if it was worth anything. Incredibly, it turned out to be a coveted commodity in ... Read more »

Ariane 5 elements for Webb launch reach Europe's Spaceport

Major elements of the Ariane 5 rocket to launch the James Webb Space Telescope arrived safely in Kourou, French Guiana from Europe on 3 September 2021. The rocket’s fairing, upper ... Read more »

Parker Solar Probe team sheds new light on structure, behavior of inner solar system dust

Scientists using data from NASA’s Parker Solar Probe have assembled a comprehensive picture of the structure and behavior of the large cloud of space dust that swirls through the innermost ... Read more »

Astronomers explain origin of elusive ultradiffuse galaxies

As their name suggests, ultradiffuse galaxies, or UDGs, are dwarf galaxies whose stars are spread out over a vast region, resulting in extremely low surface brightness, making them very difficult ... Read more »

Antennas searching for ET threatened by wildfire

The Allen Telescope Array, an ensemble of 42 antennas used in the search for extraterrestrial intelligence (SETI), is once again threatened by wildfires. The scientists and engineers normally on-site have ... Read more »

Earthlike planets in other solar systems? Look for moons

Finding an exact copy of the Earth somewhere in the universe sounds like a far-fetched notion, but scientists believe that because Earth happened in our solar system, something similar is ... Read more »

China releases first batch of gamma photon data from dark matter explorer

China has released the first batch of gamma photon data obtained by the Dark Matter Particle Explorer (DAMPE), according to Science and Technology Daily on Wednesday. The National Space Science ... Read more »

ESO captures best images yet of peculiar "dog-bone" asteroid

Using the European Southern Observatory’s Very Large Telescope (ESO’s VLT), a team of astronomers have obtained the sharpest and most detailed images yet of the asteroid Kleopatra. The observations have ... Read more »

New wave of electron research

While studying the behavior of electrons in iron-based superconducting materials, researchers at the University of Tokyo observed a strange signal relating to the way electrons are arranged. The signal implies ... Read more »

D-Orbit UK signs contract with ESA for development of debris removal technology

The UK branch of D-Orbit signed a euro 2,197M contract with the European Space Agency (ESA) for phase 1 of the development and in-orbit demonstration of a “Deorbit Kit” as ... Read more »

Independent group formed to advance interoperability in satellite and ground system networks

Leading companies and organizations in the space industry, including two major branches of the U.S. Department of Defense, have come together to form the Digital IF Interoperability (DIFI) Consortium, a ... Read more »

Putting a new theory of many-particle quantum systems to the test

New experiments using trapped one-dimensional gases-atoms cooled to the coldest temperatures in the universe and confined so that they can only move in a line-fit with the predictions of the ... Read more »

Chinese astronauts out of spacecraft for second time EVA

Chinese astronauts Nie Haisheng and Liu Boming had both slipped out of the space station core module Tianhe by 10:12 a.m. (Beijing Time) on Friday to conduct extravehicular activities (EVAs) ... Read more »

Computers help scientists understand the particles that make up atoms

Scientists use particle accelerators to speed up electrically charged particles to nearly the speed of light. They then smash those particles together to study the new particles that form, including ... Read more »

A few steps closer to Europa: spacecraft hardware makes headway

The hardware that makes up NASA’s Europa Clipper spacecraft is rapidly taking shape, as engineering components and instruments are prepared for delivery to the main clean room at the agency’s ... Read more »

Meteosat Gen 3 takes major step towards its first launch

After many technical and programmatic challenges, the first satellite of the next generation of the Meteosat family has taken a major step towards its first flight, currently scheduled for launch ... Read more »