Job Description
About the Job: We are seeking a highly skilled Python Data Engineer to join our team at AVM Consulting Inc. and work on a large-scale project in the Capital Markets space.
The successful candidate will have extensive experience in AWS services development, including Redshift, Glue, Boto3, Lambda, S3, Step Functions, EC2, ECS, CloudFormation, RDS, and CloudWatch. They will also have strong expertise in Python programming, database interactions, Pandas, PySpark, SQL, and data modeling and visualization.
This role requires excellent communication skills, attention to detail, and the ability to work independently. The candidate should also be familiar with AWS CLI and have experience with interactive user interfaces.
Bonus points for knowledge of SAS, DevOps tools, testing automation, and experience with building services like Python APIs (Flask, Django, FastAPI). Additionally, proficiency in Git, Terraform, Jira, Confluence, Agile, and Pytest is a plus.
Key Responsibilities include designing and implementing data pipelines, optimizing data processing, and ensuring data quality and integrity.
Working Environment: Our company culture values innovation, collaboration, and continuous learning. We offer a dynamic and supportive work environment that encourages growth and development.
Responsibilities
- Key Responsibilities include designing and implementing data pipelines, optimizing data processing, and ensuring data quality and integrity
Requirements
- The successful candidate will have extensive experience in AWS services development, including Redshift, Glue, Boto3, Lambda, S3, Step Functions, EC2, ECS, CloudFormation, RDS, and CloudWatch
- They will also have strong expertise in Python programming, database interactions, Pandas, PySpark, SQL, and data modeling and visualization
- This role requires excellent communication skills, attention to detail, and the ability to work independently
- The candidate should also be familiar with AWS CLI and have experience with interactive user interfaces
- Bonus points for knowledge of SAS, DevOps tools, testing automation, and experience with building services like Python APIs (Flask, Django, FastAPI)