Task

The data is obtained from
FireData: https://sentinel.ga.gov.au/#/
WeatherData: http://www.bom.gov.au/vic/?ref=hdr

This is part of the assignment for the unit FIT3182 (Big Data Management and Processing), which required myself to migrate data to a NoSQL database (MongoDB) and to analyse the data to provide results. In addition, building an application to stream, store, and analyse data using Apache Kafka, Apache Spark Streaming and MongoDB.

Full report can be found on my github (private): https://github.com/TingHanGan/FIT3182_Assignment1.

(Preview) Streaming data


(Preview) Real-time data graph


(Preview) Map with hotspots