Data Warehousing
The objective to empower the business, for better and prudent decision-making, needs to be fulfilled with analysing and transforming massive datasets, into intelligent data insights.
MOL-IT is working on a Cloud based Data Platform System for different business divisions of MOL. We are working towards structuring the structured and unstructured data that is targeted to be the base of the future enterprise data platform. This data will subsequently be used for analytical purposes by different MOL divisions.
A smart and improved Data extraction system has been built using data derived from heterogeneous sources and use of modern technique. The objective is to reduce the manual work and improve the overall data extraction and transformation speed/quality.
The technologies used are Python, Cosmos DB, Azure SQL Server, Azure Data Factory, and Data Lake.
Another data warehouse solution is ‘MOL Archive’ that has been built using Microsoft Azure SQL Data Warehouse. It contains the entire business data for the MOL Liner and Car Carrier businesses. It is also designed to store the local data for MOL Agents (the MOL subsidiary companies across the globe).
The data that is stored, constitutes of both structured and unstructured data.
Considering the huge volume of data along with varied data types, complex logic is used to extract data in the Azure data warehouse. Another salient feature of this data warehouse is the generation of different business documents on the fly, such as Bill Of Lading, Invoice, Cash receipt etc. that might be required for legal and investigational purposes.
The data that is stored, constitutes of both structured and unstructured data.
Considering the huge volume of data along with varied data types, complex logic is used to extract data in the Azure data warehouse. Another salient feature of this data warehouse is the generation of different business documents on the fly, such as Bill Of Lading, Invoice, Cash receipt etc. that might be required for legal and investigational purposes.