Data Engineer
Location:
Hybrid in McLean OR Richmond, VA
Plano, TX OR Boston, MA
Schedule:
Monday-Friday
Type:
W2 Contract
Duration:
Long term on-going
Pay Rate:
$70-$75 an hour with benefits!
Data Engineer
Position Summary
We are seeking a Data Engineer with strong Python and AWS expertise to support the development and enhancement of a cloud-native data ingestion platform. This role will focus on building scalable, secure, and reliable data pipelines that move financial data from source systems into downstream applications. The ideal candidate will have hands-on experience with AWS services, modern data engineering practices, automation, and CI/CD processes.
Responsibilities
- Design, develop, and maintain data pipeline components across ingestion, validation, tokenization, transformation, and publishing stages.
- Build and enhance Python-based applications and AWS-native solutions utilizing services such as Lambda, ECS, Kinesis, S3, DynamoDB, IAM, and AWS CDK.
- Develop and support data processing frameworks using AWS Glue, Apache Spark, Flink, and event-driven architectures.
- Create and execute rigorous unit, integration, and end-to-end testing to ensure platform reliability and data quality.
- Support system integration and end-to-end testing efforts, troubleshooting issues and implementing corrective actions.
- Ensure compliance with data protection and security standards, including handling of sensitive and regulated data.
- Identify, prioritize, and remediate security vulnerabilities across application code, infrastructure, and third-party dependencies.
- Participate in code reviews and contribute to CI/CD pipeline improvements and deployment automation.
- Collaborate with cross-functional teams to gather requirements, design technical solutions, and deliver scalable data engineering capabilities.
- Maintain technical documentation and support ongoing platform operations in a production environment.
Required Qualifications
- Strong experience developing applications and data pipelines using Python.
- Hands-on experience with AWS cloud services, including:
- AWS Lambda
- ECS
- Kinesis
- S3
- DynamoDB
- IAM
- AWS CDK
- Experience with data processing technologies such as AWS Glue, Apache Spark, and/or Apache Flink.
- Solid understanding of Git version control and CI/CD best practices.
- Experience building and supporting scalable, high-volume data integration or ingestion platforms.
- Knowledge of secure software development practices and data protection requirements.
- Strong troubleshooting, debugging, and problem-solving skills.
Preferred Qualifications
- Experience working with financial services or financial data platforms.
- Familiarity with event-driven and streaming architectures.
- Experience with containerized environments and cloud-native application development.
- Knowledge of infrastructure-as-code and automated deployment frameworks.
- Experience supporting security audits, vulnerability remediation, and compliance initiatives.
Key Skills
Python • AWS • Lambda • ECS • Kinesis • S3 • DynamoDB • IAM • AWS CDK • AWS Glue • Apache Spark • Apache Flink • CI/CD • Git • Data Engineering • Data Pipelines • Cloud Architecture • Data Security
#INDPRO