Open Access
Subscription Access
Study on Applications and Challenges in Natural Disaster Management Using Multimodal System
Organizations, which include government agencies, the military, and humanitarian groups, are responsible for providing the most vulnerable individuals with aid and protection during emergencies and disasters. Their rapid decisions are made possible through the information they gather. Their information needs vary depending on their specific roles and responsibilities. In times of crisis, they need factual and timely information, especially when there is a lack of reliable sources such as radio or TV. Due to the increasing number of people using social media platforms and mobile technologies, the general public has gained access to more effective and practical ways to share information. The term multimodal refers to the combination of various computational methods used to analyze the data collected from social media platforms. Some studies show how social media analytics can be used to summarize and curate information related to disasters. This paper discusses the research being conducted in the field of crisis informatics, which is an interdisciplinary discipline that combines the expertise of social science and computing to extract information related to disasters. Due to the availability of social media data, this field is heavily focused on developing effective strategies to use it.
Keywords
Multimodal System, Natural Disaster Management, Social Media, Machine Learning.
User
Font Size
Information
- Li, T., Xie, N., Zeng, C., Zhou, W., Zheng, L., Jiang, Y., Yang, Y., Ha, H.Y., Xue, W., Huang, Y. and Chen, S.C., 2017. Data-driven techniques in disaster information management. ACM Computing Surveys (CSUR), 50(1), pp.1-45.
- Zhang, M., Huang, Q. and Liu, H., 2022. A Multimodal Data Analysis Approach to Social Media during Natural Disasters. Sustainability, 14(9), p.5536.
- Presa Reyes, M.E., Pouyanfar, S., Zheng, H.C., Ha, H.Y. and Chen, S.C., 2018. Multimedia data management for disaster situation awareness. In Proceedings of International Symposium on Sensor Networks, Systems and Security: Advances in Computing and Networking with Applications (pp. 137-146). Springer International Publishing.
- Foresti, G.L., Farinosi, M. and Vernier, M., 2015. Situational awareness in smart environments: socio-mobile and sensor data fusion for an emergency response to disasters. Journal of Ambient Intelligence and Humanized Computing, 6, pp.239-257.
- Jing, M., Scotney, B.W., Coleman, S.A., McGinnity, M.T., Zhang, X., Kelly, S., Ahmad, K., Schlaf, A., GrĂ¼nder-Fahrer, S. and Heyer, G., 2016, June. Integration of text and image analysis for flood event image recognition. In 2016 27th Irish Signals and systems conference (ISSC) (pp. 1-6). IEEE.
- Alam, F., Ofli, F. and Imran, M., 2020. Descriptive and visual summaries of disaster events using artificial intelligence techniques: case studies of Hurricanes Harvey, Irma, and Maria. Behavior & Information Technology, 39(3), pp.288-318.
- Kumar, P., Ofli, F., Imran, M. and Castillo, C., 2020. Detection of disaster-affected cultural heritage sites from social media images using deep learning techniques. Journal on Computing and Cultural Heritage (JOCCH), 13(3), pp.1-31.
- Pohl, D., Bouchachia, A. and Hellwagner, H., 2015. Social media for crisis management: clustering approaches for sub-event detection. Multimedia tools and applications, 74, pp.3901-3932.
- Pohl, D., Bouchachia, A. and Hellwagner, H., 2016. Online indexing and clustering of social media data for emergency management. Neurocomputing, 172, pp.168-179.
- Vernier, M., Farinosi, M., Foresti, A. and Foresti, G.L., 2023. Automatic Identification and Geo-Validation of Event-Related Images for Emergency Management. Information, 14(2), p.78.
- Chaudhuri, N. and Bose, I., 2019. Application of image analytics for disaster response in smart cities.Proceedings of the 52nd Hawaii International Conference on System Sciences.pp.3036-3045.
- Fan, C., Zhang, C., Yahja, A. and Mostafavi, A., 2021. Disaster City Digital Twin: A vision for integrating artificial and human intelligence for disaster management. International Journal of Information Management, 56, p.102049.
- Zou, Z., Gan, H., Huang, Q., Cai, T. and Cao, K., 2021. Disaster image classification by fusing multimodal social media data. ISPRS International Journal of Geo-Information, 10(10), p.636.
- Pi, Y., Ye, X., Duffield, N. and Microsoft AI for Humanitarian Action Group, 2022. Rapid Damage Estimation of Texas Winter Storm Uri from Social Media Using Deep Neural Networks. Urban Science, 6(3), p.62.
- Chaudhuri, N. and Bose, I., 2020. Exploring the role of deep neural networks for post-disaster decision support. Decision Support Systems, 130, p.113234.
- Munawar, H.S., Ullah, F., Qayyum, S., Khan, S.I. and Mojtahedi, M., 2021. UAVs in disaster management: Application of integrated aerial imagery and convolutional neural network for flood detection. Sustainability, 13(14), p.7547.
- Pi, Y., Nath, N.D. and Behzadan, A.H., 2020. Convolutional neural networks for object detection in aerial imagery for disaster response and recovery. Advanced Engineering Informatics, 43, p.101009.
- Tian, H., Tao, Y., Pouyanfar, S., Chen, S.C. and Shyu, M.L., 2019. Multimodal deep representation learning for video classification. World Wide Web, 22, pp.1325-1341.
- Gautam, A.K., Misra, L., Kumar, A., Misra, K., Aggarwal, S. and Shah, R.R., 2019, September. Multimodal analysis of disaster tweets. In 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM) (pp. 94-103). IEEE.
- Jixian, L., An, G., Zhihao, S. and Song, X., 2022. Social Media Multimodal Information Analysis based on the BiLSTM-Attention-CNN-XGBoost Ensemble Neural Network. International Journal of Advanced Computer Science and Applications, 13(12).
- Pouyanfar, S., Tao, Y., Tian, H., Chen, S.C. and Shyu, M.L., 2019. Multimodal deep learning based on multiple correspondence analysis for disaster management. World Wide Web, 22, pp.1893-1911.
Abstract Views: 228
PDF Views: 0