Senior Software Engineer

Job Description

Job Title: Senior Software Engineer

Job Summary:
The Data Engineer will design, build, and maintain data ingestion pipelines and visualization tools to support data-driven decision-making in the aviation and airline industry. This role involves working with modern data platforms and tools to process, transform, and visualize data, ensuring data availability, security, and performance optimization.

Key Responsibilities:

Design and deploy data ingestion pipelines using StreamSets Data Collector and Kafka.
Process and manage data using SQL and PL/SQL procedures.
Automate and orchestrate data ingestion workflows.
Transform data into a Star Schema Data Model, including partitioning and distribution strategies.
Create a Semantic Layer and Data Marts for easy access and analysis.
Build and maintain aggregate tables to support reporting needs.
Develop visualizations for key performance indicators (KPIs) and compose Tableau Sheets using data models.
Develop and automate Tableau Workbooks, utilizing containers and parameterized sheets for dynamic reporting.
Perform regular maintenance, including system log monitoring, security updates, and patching.
Monitor platform and applications to ensure smooth operation and availability.

Skills and Qualifications:

Technical Skills: Proficiency in Snowflake, StreamSets Data Collector, Kafka, DBT, Airflow, PostgreSQL + Citus, and Tableau.
Data Expertise: Strong experience in Data Warehousing, Dimensional Modeling, Data Visualization, and Reporting.
Industry Knowledge: Background in the software industry, with a focus on data integration and reporting; experience in the aviation and airline industry is advantageous.
Experience: 5-7 years of overall experience, with 3-5 years in relevant data engineering roles.
Certifications: Certifications in data integration and data modeling are preferred.