OceanMappingDataframe - Scalable multi-indexed dataframe for hydrography
| dc.contributor.advisor | Church, Ian | |
| dc.contributor.advisor | Ray, Suprio | |
| dc.contributor.author | Gandhi Kalidasan, Vishwa Barathy | |
| dc.date.accessioned | 2023-10-26T18:14:09Z | |
| dc.date.available | 2023-10-26T18:14:09Z | |
| dc.date.issued | 2023-02 | |
| dc.description.abstract | Ocean data constitutes one of the largest geospatial datasets. Due to developments in the field of multibeam sonar, the amount of data gathered from hydrographic surveys is growing, causing the data to fall into the category of massive spatial data. Dataframe is a popular data model used to represent the data and is widely used in data science applications. Due to the lack of a suitable dataframe that can load large volumes of multibeam sonar data and support advanced analytics libraries, in this thesis, a new multi-indexed dataframe, OceanMappingDataframe, is introduced that can be used to load, store, and analyze multibeam sonar data. The multi-indexed dataframe was implemented using the MODIN dataframe library. The multi-indexed dataframe can load the hydrography files in Generic Sensor Format (GSF) or CSV file format, and save the results in partitioned Parquet files. The multi-indexed dataframe can also support advanced AI libraries such as OpenAI. This has been demonstrated by applying the Reinforcement Learning (RL) algorithm to an outlier detection problem in hydrography. | |
| dc.description.copyright | © Vishwa Barathy Gandhi Kalidasan, 2023 | |
| dc.format.extent | xiv, 101 | |
| dc.format.medium | electronic | |
| dc.identifier.oclc | (OCoLC)1419291325 | en |
| dc.identifier.other | Thesis 11145 | en |
| dc.identifier.uri | https://unbscholar.lib.unb.ca/handle/1882/37508 | |
| dc.language.iso | en | |
| dc.publisher | University of New Brunswick | |
| dc.relation | University of New Brunswick | |
| dc.rights | http://purl.org/coar/access_right/c_abf2 | |
| dc.subject.discipline | Computer Science | |
| dc.subject.lcsh | Ocean. | en |
| dc.subject.lcsh | Sonar. | en |
| dc.subject.lcsh | Geospatial data. | en |
| dc.subject.lcsh | Hydrography. | en |
| dc.subject.lcsh | Database management. | en |
| dc.title | OceanMappingDataframe - Scalable multi-indexed dataframe for hydrography | |
| dc.type | master thesis | |
| oaire.license.condition | other | |
| thesis.degree.discipline | Computer Science | |
| thesis.degree.grantor | University of New Brunswick | |
| thesis.degree.level | masters | |
| thesis.degree.name | M.C.S. |