Issuu

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 11 Issue: 03 | Mar 2024

p-ISSN: 2395-0072

www.irjet.net

Telangana Tourism Insights Analysis using Data Engineering System Dr T Sankara Rao1, A Bhanu Mythreyi2, Ch Gayatri Sri Sowmya3, B Yasaswini4, N Lohita5 1Associate Professor, Dept. of Computer Science Engineering, GITAM University, Andhra Pradesh, India 2,3,4,5Student, Dept. of Computer Science Engineering, GITAM University, Andhra Pradesh, India

---------------------------------------------------------------------***---------------------------------------------------------------------

Abstract - Recognizing the transformative power of data

The data engineering process involves activities that enable us to use vast raw data for practical purposes. Stages in Data Engineering: 1. Data Ingestion 2. Data Transformation 3. Data Serving 4. Data flow orchestration

analysis in fostering economic growth, this project endeavors to enhance revenue generation in Telangana by focusing on its tourism and culture sector. The proposed system aims to equip the Telangana government with actionable insights to inform strategic decision-making in the tourism and culture domain. By analyzing trends and patterns related to tourist spots, domestic and foreign visitors, as well as revenue generated through taxes, the system facilitates the development of tailored strategies to enrich tourism experiences, promote cultural attractions, and optimize resource allocation. To achieve these objectives, the project advocates for the implementation of a robust data engineering system. Data Engineering encompasses a set of operations designed to efficiently utilize data for business purposes. The system's core focus lies in designing and building data gathering and storage mechanisms, ensuring that raw data is meticulously prepared for in-depth analysis. Activities within the data engineering process include configuring data sources, integrating analytical tools, and managing the architecture of the entire system. This project positions data analysis as a strategic enabler for Telangana to harness the vast potential of its tourism and culture sector. By leveraging insights derived from effective data analysis, the state can attract more tourists, encourage increased spending within its borders, and realize sustainable economic growth. Establishing a robust data analysis system is deemed crucial for Telangana to capitalize on the wealth of opportunities within its tourism and culture sector, paving the way for a prosperous and economically vibrant future.

Data Ingestion - Moves data from multiple sources to a target system which is later processed for further analysis, Data Transformation - Makes data into a valuable form of data which involves removing duplicates, and errors, normalizing the data, and converting it into the form that is required for us to perform further processes, Data Serving - Delivers transformed data to end users, Data flow Orchestration, It provides visibility into the entire process and ensures that all the processes are successful Data Pipeline - In simple terms, it is a mechanism that automates the ingestion, transformation, and serving steps of the data engineering process. It can also be considered as a series of automated processes that move data from one system or stage to another. It combines the integration tools and connects sources to a data warehouse, and it also helps in loading information from one place to another. The processes in a data pipeline can include: Extraction, Validation, Transformation, Loading, Monitoring. The data pipeline is beneficial because it would have been complicated to manually transfer data and perform extractions, transformations, and track changes in data without it. Data Warehouse - It is a central repository for storing data in query able forms. It can also be considered a regular database which is enhanced for reading and querying huge amounts of data. The main advantage of a data warehouse is the historical data, as the general transactional databases do not store historical data. They use data sources like flat files, relational databases, and other forms of data. General databases normalize data by eliminating data redundancies and making them into different tables. Such processes might involve heavy computations as each simple query demands to combine various tables. We use simple queries with fewer tables in data warehouses, improving performance. Data Analytics It involves analyzing the data to find valuable insights and draw valid conclusions from the information. It involves streaming analytical results from the data processed and stored. It improvises business intelligence and helps businesses grow revenue and use data efficiently.

Key Words: Data Engineering, Tourism, Data Pipeline, Data Warehouse, Data Visualization, Cloud Computing, Structured Query Language (SQL)

1.INTRODUCTION Data Engineering is a set of operations that make data efficiently used by businesses. It is required to design and build systems for gathering and storing data at stake and preparing it for further analysis. It involves gathering raw data to analyze valuable insights from the gathered data. It involves processes such as configuring data sources to integrating analytical tools. All these systems are to be architecture, built, and managed.

Impact Factor value: 8.226

ISO 9001:2008 Certified Journal

Page 536