Snr Data Engineer

Job description

Our Story At Alight, we believe a company's success starts with its people. Alight embraces values that come directly from our people - purposeful, human, united and growth-minded - reflecting our inclusive culture and promise that our clients expect. We are passionate about connecting purpose with impact. Alight empowers clients to build a healthier and more financially secure workforce by unifying the benefits ecosystem across health, wealth, wellbeing, navigation, and absence management. Our Benefits With a comprehensive total rewards package, Alight offers programs and plans that support your mind, body, wallet, and life. Benefits include health, starting Day One. Additionally, Alight colleagues enjoy wellbeing programs, retirement plans, and career growth opportunities - all within a thriving global organization. Great Place to Work Thanks to the work of every colleague, Alight has received multiple awards of recognition including "Great Place to Work" for the past 7 years and Fortune's "Best Companies to Work For." To learn more about our company culture and awards Click Here. We invite you to join our team! Learn more at careers.alight.com . JD - Snr Software Engineer (ETL) Experience & Expectations : Leverage extensive experience (4 to 8 years overall ETL experience, to assist in solution design and delivery along with build of new ETLs). We are seeking an experienced ETL Developer with strong expertise in Big Data (Spark, Cloudera). Experience orchestrating workflows using AWS Step Functions (state machines) for reliable and scalable data pipelines. Ability to implement end-to-end serverless data architectures integrating Glue, Lambda, S3, and Redshift Core Responsibilities : Build and maintain high volume ETL/ELT pipelines across Hadoop (HDFS, Hive, Spark, Kafka) and AWS (Glue, EMR, Lambda, Step Functions, Redshift). Develop distributed data processing solutions using PySpark, Spark SQL, and scalable cloud serverless patterns. Implement reusable data ingestion frameworks for batch, ability to design & implement Orchestration process and Leverage AI Optimize data workflows using partitioning, bucketing, compression, file formats (Parquet/ORC). Understanding hybrid data lake architectures using S3 + HDFS, ensuring data governance and best practices are adheres Experience to deliver complex projects in an Agile environment Assist in Design and build…