Data Engineer

Job location- Hyderabad Work Mode- Hybrid Mode Experience: 7to 11 years Job Description: Data Engineer + Scala We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong foundation in building and managing data pipelines, as well as extensive experience with cloud data warehousing solutions, specifically AWS . This role will involve working with large datasets, writing complex SQL queries, and leveraging tools like Airflow and Snowflake to create efficient data flows.

Experience in Learning Management Systems (LMS) is a plus. Key Responsibilities: Design, build, and maintain ETL data pipelines for large-scale data integration. Develop and optimize complex SQL queries and scripts for data extraction and transformation.

Work with relational databases and cloud data warehouses (preferably AWS Redshift ). Develop and maintain Stored Procedures , Tasks , and manage real-time data streaming using AWS Kinesis . Create and maintain ER models , and design enterprise-level data architectures.

Collaborate with cross-functional teams to ensure seamless data integration and accuracy. Implement and manage Airflow for workflow orchestration. Document and present technical information to stakeholders.

Required Skills: Strong experience with building data pipelines (ETL). In-depth knowledge of SQL , especially in complex querying, stored procedures, and optimization. Proficiency in AWS Redshift.

Expertise in ER modeling , big data, and enterprise data models. Python programming for automation and data manipulation. Hands on experience in Big Data is mandate.

Hands-on experience with Apache Airflow for job scheduling and orchestration. Excellent documentation, communication, and organizational skills. Nice-to-Have Skills: Experience with dbt (data build tool).

Familiarity with Learning Management Systems (LMS) .