TY - JOUR
T1 - Multimodal SuperCon
T2 - classifier for drivers of deforestation in Indonesia
AU - Hartanti, Bella Septina Ika
AU - Vito, Valentino
AU - Arymurthy, Aniati Murni
AU - Alfa Krisnadhi, Adila
AU - Setiyoko, Andie
N1 - Funding Information:
We are grateful for the support of Tokopedia-UI AI Center of Excellence, Faculty of Computer Science, Universitas Indonesia, for providing access to the NVIDIA DGX-A100 system necessary to run the experiments. The authors declare no conflicts of interest.
Publisher Copyright:
© 2023 Society of Photo-Optical Instrumentation Engineers (SPIE).
PY - 2023/7/1
Y1 - 2023/7/1
N2 - Climate change can have a serious impact on human life and occurs due to the emission of greenhouse gases, such as carbon dioxide, into the atmosphere. Deforestation is one contributing factor to climate change. It is important to understand the drivers of deforestation for mitigation efforts, but there is a lack of datadriven studies that can predict these drivers. In this work, we propose a contrastive learning architecture, called Multimodal SuperCon, to classify the drivers of deforestation in Indonesia using composite images obtained from Landsat 8. Multimodal SuperCon is an architecture that combines contrastive learning and multimodal fusion to handle the available Indonesian deforestation dataset. As a means to yield better performance, Multimodal SuperCon upgrades ordinary SuperCon so that it is able to handle auxiliary spatial variables as additional inputs. Our proposed model outperforms previous work on driver classification, giving an 8% improvement in accuracy compared to a state-of-the-art rotation equivariant model for the same task.
AB - Climate change can have a serious impact on human life and occurs due to the emission of greenhouse gases, such as carbon dioxide, into the atmosphere. Deforestation is one contributing factor to climate change. It is important to understand the drivers of deforestation for mitigation efforts, but there is a lack of datadriven studies that can predict these drivers. In this work, we propose a contrastive learning architecture, called Multimodal SuperCon, to classify the drivers of deforestation in Indonesia using composite images obtained from Landsat 8. Multimodal SuperCon is an architecture that combines contrastive learning and multimodal fusion to handle the available Indonesian deforestation dataset. As a means to yield better performance, Multimodal SuperCon upgrades ordinary SuperCon so that it is able to handle auxiliary spatial variables as additional inputs. Our proposed model outperforms previous work on driver classification, giving an 8% improvement in accuracy compared to a state-of-the-art rotation equivariant model for the same task.
KW - class imbalance
KW - contrastive learning
KW - deforestation driver classification
KW - multimodal fusion
UR - http://www.scopus.com/inward/record.url?scp=85173273007&partnerID=8YFLogxK
U2 - 10.1117/1.JRS.17.036502
DO - 10.1117/1.JRS.17.036502
M3 - Article
AN - SCOPUS:85173273007
SN - 1931-3195
VL - 17
JO - Journal of Applied Remote Sensing
JF - Journal of Applied Remote Sensing
IS - 3
M1 - 036502
ER -