AWS Data Engineer(Remote)
About the position Responsibilities • Lead the design and implementation of scalable cloud-based architectures using AWS services. • Oversee the development and deployment of data pipelines utilizing MWAA (Airflow) and AWS Glue ETL. • Provide expertise in AWS DevOps to streamline CI/CD processes and automate infrastructure provisioning. • Manage and secure AWS IAM roles and policies to ensure robust access control and compliance. • Optimize data storage and retrieval processes using Amazon Redshift and Amazon Dynamo DB. • Develop and maintain Python scripts for data processing and automation tasks. • Utilize AWS Glue Studio to create and manage ETL workflows and data transformations. • Implement and manage AWS Glue Catalog to maintain a centralized metadata repository. • Ensure efficient data storage and retrieval from Amazon S3 leveraging best practices for data management. • Integrate Apache Spark for large-scale data processing and analytics. • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. • Monitor and troubleshoot system performance ensuring high availability and reliability of cloud services. • Stay updated with the latest AWS technologies and best practices to continuously improve our cloud infrastructure. Requirements • Bachelor's degree in science, engineering, or equivalent. • 8-12+ years of experience in AWS technologies and data engineering. • Proficiency in AWS DevOps, AWS IAM, Amazon Redshift, Amazon Dynamo DB, Python, AWS Glue Studio, AWS Glue ETL, AWS Glue Catalog, Amazon S3, MWAA (Airflow), and Apache Spark. Benefits • Medical/Dental/Vision/Life Insurance • Paid holidays plus Paid Time Off • 401(k) plan and contributions • Long-term/Short-term Disability • Paid Parental Leave • Employee Stock Purchase Plan Apply tot his job