Data Engineer (Builder)
- Country: United States
- Advertiser: Tech Providers Inc.
- Category: I.T. & Communications
Description:
- Data Engineer (Builder)
- 5-7 years in data engineering or database development.
- Hands on experience with SQL Server ETL/ELT pipelines.
- Experience integrating pipelines with cloud services (AWS Glue, Azure Data Factory, GCP Dataflow).
- Familiarity with streaming technologies (Kafka, Kinesis).
- Experience in data modeling and architecture design.
- Proficiency in Python/Scala/Java programming for pipeline development.
- Exposure to DevOps automation (Terraform, Ansible) and containerization (Docker, Kubernetes).
- DevOps and automation maturity with certifications (HashiCorp Terraform Associate, AWS DevOps Engineer) and containerization (Docker, Kubernetes).
- Preferred: Advanced programming depth with applied coursework or certifications (Python Institute PCPP, Scala Professional Certification).
- Preferred: Data modeling specialization with advanced coursework or vendor specific training (Snowflake, AWS Big Data Specialty).
- Bachelor's degree in Computer Science, Software Engineering, or related technical field.
- AWS Certified Data Engineer
- Azure Data Engineer Associate
- Google Professional Data Engineer
- Problem solving and optimization mindset.
- Documentation skills: ability to produce pipeline diagrams, technical specifications, and compliance documentation.
- Strong debugging and troubleshooting skills.
- Collaborative aptitude for working with governance and SQL engineers.
- Full command of the English language, both written and verbal, is mandatory.
- SQL Server (ETL/ELT pipelines, stored procedures).
- Orchestration tools (Airflow, DBT).
- Cloud integration services (AWS Glue, Azure Data Factory, GCP Dataflow).
- Observability tools (OpenLineage, Monte Carlo).
- DevOps automation tools (Terraform, Ansible).
- Containerization platforms (Docker, Kubernetes).