Sakurajima 3D terrain mapping flight planing using Drone Harmony

Sakurajima Disaster Prevention

(2020-2021)

3D terrain mapping this active volcano for disaster prevention

During the filming of the "Sakurajima - Capturing Rare Moments" I got to work closely with the scientists from Kyoto University's Disaster Prevention Research Insitute (DPRI), National Research Institute for Earth Science and Disaster Resilience (NIED) and the Sakurajima Volcanic Observatory (SVO). Already our high-resolution imagery captured from a close proximity to the volcano using our custom 8K drone was very useful to the scientists. But it was our expertise in 3D terrain mapping that really interested them. Basic 3D terrain models of the volcano exist, but they are either outdated, or have very low resolution. Sakurajima is so active - that the actual shape of the volcano changes on regular basis.

Archived paintings of the Sakurajima's An-ei eruption in 1779
Paintings of the Sakurajima's An-ei eruption in 1779

The large eruptions of Sakurajima are defined by the fact that it almost always erupts from more than just a single crater. The above paintings from the 1779 An-ei eruption are a great example, showing Sakurajima erupting from 4 separate locations. This has been confirmed by geological studies of the respective lava flows from the diferent eruptions - as can be seen in the below 3D model:

So the scientists had an idea: If we could terrain-map Sakurajima into precise and up-to-date 3D model, they can run various eruption simulations from many locations on the volcano. These simulations can then be used during an actual eruption (or even shortly prior - if the volcano deformations could help predict the eruption points) to guide disaster response and prioritise evacuation. These simulations take a very long time and a lot of computing power - it will be too late to try to run them once the eruption has began. Being able to simulate various scenarios - the scientist could then just refer to the correct one and act immediately. The question then became - how do you map such a large and active volcano?

Sakurajima erupting in 2019
Sakurajima eruption on 24th November, 2019

One of my favorite proverbs is "If you fail to plan - you plan to fail !". But planing such a large-scale project was no easy task. To begin with, Sakurajima covers area of 77 km2 (30 sq mi) - not your typical 3D terrain mapping project! Then you have to deal with the steep terrain. Most terrain mapping solutions are based on drone flights leveled in the horizontal plane. Some of the locations on the volcano are impossible to access - a 2 km radius (1.25 mi) around the currently active Minamidake crater is strictly off-limits - and even the wider area requires specialised permits. Most commercially-available drones are limited to maximum flight height of 500 m (1640 ft) from the take-off point - and that only if you can keep it under 120 m (400 ft) AGL (above ground level). Given that Sakurajima rises to 1117 m (3665 ft) directly from the surrounding ocean, this alone made the flight planing extremely complicated. And don't forget that Sakurajima is the most active volcano in Japan (and in the top 10 worldwide) - with eruptions occuring on average 2~3 times each day - and even between the eruptions the volcano is almost constantly off-gassing and releasing huge amounts of fine & highly-abrasive ash.

After a lot of initial research and testing - we have chosen to use terrain mapping mission planing SW from Drone Harmony AG (Switzerland). It was, at that time, one of only two solutions that implemented 3D terrain awareness when planing the drone flights. What set their solution apart was personalised attention and wilingness to work closely with us on adopting their existing solution to adress the unique challenges of our project. Their SW allowed us to semi-automate the complex flight operations, while giving us the freedom to manually adjust specific parameters for each flight. Frequently we would need to depart from a point on the volcano almost 3 km (1.9 mi) from the main crater, fly around the volcano beyond the visual sight (BVLOS) from our base and execute the mapping mission with enough battery power remaining to safely return. To simplify the operations, we have organised the volcano into 1 x 1 km (0.6 x 0.6 mi) grid, with each square requiring dozens of flights. In the first stage of the project we have focused on the southern and eastern portions of the volcano and the area surrounding the active crater:

Sakurajima map split to 1x1 km grid for drone mission planning
Map of Sakurajima organised into 1 x 1 km (0.6 x 0.6 mi) grid for drone mission planning

It took us several months just to complete the first stage of mapping. Then it was time to process the phtogrammetry data into a 3D model that the scientist could use. We had to severely upgrade our computing render farm just to process the individual 1 km2 sections. The weapon of choice here was the METASHAPE photogrammetry SW from Agisoft LLC. The initial results were incredible and the level of detail unprecendented for a project of this scale. We could identify details just few cm (1~2 in) across:

Sakurajima Minamidake 3D model
Sakurajima Minamidake 3D model detail
Sakurajima Nabeyama 3D model
Sakurajima Nabeyama 3D model detail
Sakurajima lahar dam 3D model
Sakurajima lahar dam 3D model detail

Various Sakurajima 3D model sections and thier respective details

Each section's 3D model was then converted to a format compatible with the scientist's supercomputer used for the eruption simulations and exported in various resolutions. It turned out that at the full resolution our data was too mcuh even for the supercomputer and needed to be slightly reduced. NHK followed us through out each step and has released the first documentary focused the initial stage of the project - the 3D terrain mapping. It is 30 min long and I hope you enjoy watching it:


Sakurajima Disaster Prevention and Response project video
Sakurajima Disaster Prevention & Response (NHK, 2021)
The final documentary for Stage 1 of the project

In 2022, David Adjiashvili - the CTO and Founder of Drone Harmony AG (Switzerland) was interviewed on the Drone Radio Show (episode 365) and discussed this project in great detail, the challenges it presented and the assistance provided directly by Drone Harmony. The project itself is also prominently featured in the Customer Stories section of the Drone Harmony website. You can listen to the full podcast episode, or select a specific chapter below:

0:00 0:00

Due to the restrictions related to the Covid pandemic (extending in Japan well into 2023) and the related severe restrictions on the NHK Enterprise's budgets, the completion of the full 3D model has been delayed. Currently more than a half of the volcano has been 3D terrain mapped with focus on the southern and eastern sections - where the majpority of the local residents live and where any future volcanic activity is expected...

Selected pictures from the project:
Custom Landcruiser interior to carry the 8K drone (right), generator and space for our 3x crew & film equipment
Custom Landcruiser interior to carry the 8K drone (right), generator and space for our crew, equipment & supplies.
Peter Majtan planing drone flight missions to map Sakurajima using Drone Harmony terrain-aware mission planning software
Planning flights missions using Drone Harmony. The yellow HDDs in the background hold 8TB of data each...
Eastern view of Sakurajima revealing the deep scars caused by rain erosion, constantly changing the volcano's shape
Eastern view of Sakurajima revealing the deep scars caused by rain erosion, constantly changing its shape.
Driving to Sakurajima volcano in the early morning hours to maximise the day light for the drone mapping flights
Driving to Sakurajima volcano in the early morning hours to maximise the day light for the drone mapping flights.
Gate providing access to the restricted area between publicly accessible sections and the 2km radius around the active crater
Access to the restricted area between the 2 km exclusion zone and public sections required complex permits.
Driving to Sakurajima volcano inside the restricted area in the early morning hours to maximise the day light for the drone mapping flights
Inside the restricted area. The Yunohira Observatory behind us is the closest access point for general public.
Peter Majtan leaving the parked car to start the drone mapping flights on Sakurajima volcano
Parking at the upper lahar dam. From here it's on foot and up the steep terrain to the flights staging area.
Close-up of the steep terrain made of loosely fused volcanic ash and tephra, requiring careful navigation
The steep terrain is made of loosely fused volcanic ash and tephra, requiring careful navigation.
Looking back at the Aira Caldera bay with lahar deposits down below and Kirishima volcanic range in the distance
Looking back at the Aira Caldera bay with lahar deposits down below and Kirishima volcanic range in the distance.
Tighter aerial view from Sakurajima showing the extent of the lahar deposits down below, next to Nabeyama on the right
Tighter aerial view showing the extent of the lahar deposits down below, next to Nabeyama on the right.
Close-up of drone showing the fine volcanic ash sticking to everything, even between eruptions
Even between eruptions the air was full of fine staticly charged volcanic ash, sticking to absolutely everything.
microscopic view shows the abrasive properties of Sakurajima volcanic ash with high silica content
This microscopic view shows the abrasive properties of the Sakurajima volcanic ash with high silica content.
Sakurajima volcano spewing dangerous gas and fine volcanic ash into the air even when not erupting explosively
Even when not erupting explosively, the volcano spewed dangerous gas and the fine volcanic ash into the air.
Peter Majtan performing regular cleaning and maintenance on the drone
When we could not fly - it was time to (a very regular) cleaning and maintenance - especially for the drone.
Performing regular cleaning and maintenance on the drone, including replacing the propulsion units (motors and propellers) every few weeks
Every few weeks we would need to completley replace the drone's propulsion units (motors and propellers).
Setting up flight base inside the restricted zone to clean and maintain the equipment to save time
Trying to save time - we would setup base inside the restricted zone to clean and maintain the equipment.
Working late into the night at the flight base inside the restricted zone to clean and maintain the equipment
Having to work well into the night, assuring we could fly the drone next day. Kagoshima city in the background.
Night view of our flight base inside the restricted zone, half way up the huge volcano looming in the background
We must have looked like aliens to the local residents, half way up the huge volcano looming in the background.
Rain causes the loose tephra to erode and wash away as lahar, cement-like mixture of volcanic material and water
Rain causes the loose tephra to erode and wash away as lahar, cement-like mixture of volcanic material and water.
Series of lahar dams are constructed around the volcano to control the flow of these dangerous lahar flows
Series of lahar dams are constructed around the volcano to control the flow of these dangerous lahar flows...
Safety lahar channel directing the lahar flows into the ocean to prevent them from flooding and destroying local comunities
... leading them safely to the ocean and preventing them from flooding and destroying local comunities.
Drone Harmony interface showing the complex flight planing for the drone mapping missions on Sakurajima volcano
Complex flight planing was crucial to creating an accurate 3D model of the volcano. (Drone Harmony SW)
Our custom 8K drone executing mapping flight mission near the main active Minamidake crater on Sakurajima volcano
Our custom 8K drone executing mapping flight mission near Sakurajima's main active Minamidake crater.
Peter Majtan, inside the restricted zone, adjusting the drone flight plan for area near the main active Minamidake crater on Sakurajima volcano
Some extreme areas (especially near the crater) required final mission adjustments inside the restricted zone.
Satellite imagery showing the dual-vent structure of the Minamidake crater with Showa crater to the right
Satellite imagery showing the dual-vent structure of the Minamidake crater with Showa crater to the right.
Aerial view of the dual-vent structure of the Minamidake crater, as the pressure builds up inside, captured from our drone
Aerial view (from our drone) of the dual-vent structure of the Minamidake crater, as the pressure builds up inside.
Close-up view of the left-most vent inside of the currently active Minamidake crater on Sakurajima volcano
Close-up view (from our drone) inside of the left-most vent in the currently active Minamidake crater.
During night eruption we can see the glowing lava bombs being ejected from the crater, some the size of a SUV
During night eruption we can see the glowing lava bombs being ejected from the crater, some the size of a SUV...
Close-up view of a lava bomb - a large piece of molten rock ejected during an eruption with surface cracking due to rapid cooling
Typical lava bomb (about 60 cm / 2 ft in diameter). The rapid cooling solidifies the lava, cracking the surface.
Giving a project update to Dr. Eisuke Fujita - the director of the Resarch Division for Volcanic Disasters at NIED
Giving a project update to Dr. Eisuke Fujita - the director of the Resarch Division for Volcanic Disasters at NIED.

← Back to R&D