Repo for flood prediction using LSTMs and HAND

Overview

Abstract

Every year, floods cause billions of dollars’ worth of damages to life, crops, and property. With a proper early flood warning system in place, decision-makers can take the necessary steps to prevent or at least mitigate the damage caused by floods. Although various flood prediction models exist, a majority of them fail to be fast, reliable, and detailed simultaneously. Our proposed system presents a novel hybrid flood prediction model using Long Short Term Memory(LSTM) for multivariate time series forecasting of water depth based on meteorological conditions and Height Above Nearest Drainage(HAND) to predict river stage in real-time and map the inundated areas for the corresponding water depth using enhanced HAND. Unlike traditional flood forecasting models, this hybrid approach is resource efficient and easy to implement making it highly practicable for real-time flood inundation mapping.

Methodology

The proposed system prioritizes quick development and real-time predictions without compromising on the accuracy. A range of factors affect the occurrences of riverine floods. However, climatological conditions are the major driving force behind them. Factors such as land use/land change and deforestation, although important, only affect flooding in the watershed over a long period of time. Hence, the proposed system used only meteorological conditions and DEM rasters for predicting floods over the next few days.

The relation between weather conditions and flood inundation is simplified by breaking the system into two modules. The first module being estimation of river stage height and the second one being flood inundation mapping. The system uses LSTMs, a data-driven empirical approach, to model the dependence of stage height on meteorological data and HAND, a simplified conceptual approach, to generate flood inundation maps based on the terrain of the watershed and the river stage height predicted by the first module.

Modules :

  1. Inundation Mapping - HAND algorithm to map inundated areas for a given stage height(as proposed in this paper).
  2. River Stage Estimation - Recurring neural networks (LSTMs) to predict the maximum stage height based on weather conditions of the last 3 days.
  3. Deforestation Analysis - Land use classification to identify the changing features of the area over time and identify the areas affected by deforestation.

Datasets

The proposed system uses different data for the three modules. Each of these are collected from different sources and processed separately. The module-wise requirements of data are as follows :

  1. Inundation Mapping:
    1. Digital Elevation Maps from United States Geological Survey
  2. River Stage Estimation:
    1. Meteorological data from National Climatic Data Center
    2. River stage height data from United States Army Corps of Engineers’ river gage data.
  3. Deforestation Analysis:
    1. Satellite images - Landsat 8, Landsat 5 from USGS Earth Explorer

Results

Stage Height Estimation

We tested our proposed system for Cedar Rapids, Iowa. Our experiments showed that features such as vegetation and soil type have little effect on short term flooding and can be disregarded for the prediction module. Testing multiple models showed that single output LSTM models perform better than single shot models. These models are stable upto lead times of 4 days with a Nash-Sutcliffe Efficiency greater than 0.5.

Flood Mapping

Each pixel of the inundation map raster is compared with a reference map created by ground-truthing to identify how many points were incorrectly classified as not flooded. The red areas in the image depict false negatives generated by the proposed system.

Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight)

[NeurIPS 2021 Spotlight] HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning [Paper] This is Official PyTorch implementatio

42 Nov 01, 2022
Code for the paper "Benchmarking and Analyzing Point Cloud Classification under Corruptions"

ModelNet-C Code for the paper "Benchmarking and Analyzing Point Cloud Classification under Corruptions". For the latest updates, see: sites.google.com

Jiawei Ren 45 Dec 28, 2022
Manipulation OpenAI Gym environments to simulate robots at the STARS lab

Manipulator Learning This repository contains a set of manipulation environments that are compatible with OpenAI Gym and simulated in pybullet. In par

STARS Laboratory 5 Dec 08, 2022
OCR Post Correction for Endangered Language Texts

📌 Coming soon: an update to the software including features from our paper on semi-supervised OCR post-correction, to be published in the Transaction

Shruti Rijhwani 96 Dec 31, 2022
Code for KHGT model, AAAI2021

KHGT Code for KHGT accepted by AAAI2021 Please unzip the data files in Datasets/ first. To run KHGT on Yelp data, use python labcode_yelp.py For Movi

32 Nov 29, 2022
RNG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answering

RNG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answering Authors: Xi Ye, Semih Yavuz, Kazuma Hashimoto, Yingbo Zhou and

Salesforce 72 Dec 05, 2022
4K videos with annotated masks in our ICCV2021 paper 'Internal Video Inpainting by Implicit Long-range Propagation'.

Annotated 4K Videos paper | project website | code | demo video 4K videos with annotated object masks in our ICCV2021 paper: Internal Video Inpainting

Tengfei Wang 21 Nov 05, 2022
covid question answering datasets and fine tuned models

Covid-QA Fine tuned models for question answering on Covid-19 data. Hosted Inference This model has been contributed to huggingface.Click here to see

Abhijith Neil Abraham 19 Sep 09, 2021
Implementation of OpenAI paper with Simple Noise Scale on Fastai V2

README Implementation of OpenAI paper "An Empirical Model of Large-Batch Training" for Fastai V2. The code is based on the batch size finder implement

13 Dec 10, 2021
PyTorch implementation of the method described in the paper VoiceLoop: Voice Fitting and Synthesis via a Phonological Loop.

VoiceLoop PyTorch implementation of the method described in the paper VoiceLoop: Voice Fitting and Synthesis via a Phonological Loop. VoiceLoop is a n

Meta Archive 873 Dec 15, 2022
Minimal deep learning library written from scratch in Python, using NumPy/CuPy.

SmallPebble Project status: experimental, unstable. SmallPebble is a minimal/toy automatic differentiation/deep learning library written from scratch

Sidney Radcliffe 92 Dec 30, 2022
A Transformer-Based Siamese Network for Change Detection

ChangeFormer: A Transformer-Based Siamese Network for Change Detection (Under review at IGARSS-2022) Wele Gedara Chaminda Bandara, Vishal M. Patel Her

Wele Gedara Chaminda Bandara 214 Dec 29, 2022
Draw like Bob Ross using the power of Neural Networks (With PyTorch)!

Draw like Bob Ross using the power of Neural Networks! (+ Pytorch) Learning Process Visualization Getting started Install dependecies Requires python3

Kendrick Tan 116 Mar 07, 2022
PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

Introduction PyTorch3D provides efficient, reusable components for 3D Computer Vision research with PyTorch. Key features include: Data structure for

Facebook Research 6.8k Jan 01, 2023
git《FSCE: Few-Shot Object Detection via Contrastive Proposal Encoding》(CVPR 2021) GitHub: [fig8]

FSCE: Few-Shot Object Detection via Contrastive Proposal Encoding (CVPR 2021) This repo contains the implementation of our state-of-the-art fewshot ob

233 Dec 29, 2022
Studying Python release adoptions by looking at PyPI downloads

Analysis of version adoptions on PyPI We get PyPI download statistics via Google's BigQuery using the pypinfo tool. Usage First you need to get an acc

Julien Palard 9 Nov 04, 2022
Open source implementation of AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing

AceNAS This repo is the experiment code of AceNAS, and is not considered as an official release. We are working on integrating AceNAS as a built-in st

Yuge Zhang 6 Sep 07, 2022
A tf.keras implementation of Facebook AI's MadGrad optimization algorithm

MADGRAD Optimization Algorithm For Tensorflow This package implements the MadGrad Algorithm proposed in Adaptivity without Compromise: A Momentumized,

20 Aug 18, 2022
Robot Hacking Manual (RHM). From robotics to cybersecurity. Papers, notes and writeups from a journey into robot cybersecurity.

RHM: Robot Hacking Manual Download in PDF RHM v0.4 ┃ Read online The Robot Hacking Manual (RHM) is an introductory series about cybersecurity for robo

Víctor Mayoral Vilches 233 Dec 30, 2022
Indoor Panorama Planar 3D Reconstruction via Divide and Conquer

HV-plane reconstruction from a single 360 image Code for our paper in CVPR 2021: Indoor Panorama Planar 3D Reconstruction via Divide and Conquer (pape

sunset 36 Jan 03, 2023