Data Engineer
What we’re looking for
Ideaware is looking for a Data Engineer to join our team & work on an inspiring international project with one of our global partners.
In this role, you will help build data-intensive products and improve our data pipeline and infrastructure. You are excited to work in a startup environment with new projects, challenges, and freedom and ownership.
Your responsibilities will revolve around backend development, architecture improvements, and working with various datasets.
This is a 3-month contract (Initially).
Responsibilities
- Python and SQL development to support data efforts and data science teams.
- Troubleshooting and bug fixing.
- Build and document API endpoints and product functionality.
- Collaborate with developers and data scientists to build, maintain, and optimize data pipelines and large datasets.
- Take ownership of existing datasets and data products to expand their coverage and functionality.
Qualifications
- BA/BS degree in computer science or relevant experience.
- Significant experience with SQL and relational databases (+5 years of experience).
- Knowledge in Sparks, Databricks, Airflow, and Python.
- Ability to lead and make technical decisions.
- Familiarity with AWS services such as AWS Lambda, EC2, ECS, ECR, and S3.
- Experience designing, building, and working with APIs.
- Ability to work on and develop scalable Python codebases (we use Serverless Framework and SST on top of AWS infrastructure for most of our data jobs and API endpoints).
- Experience collaborating with different teams, such as product, design, and frontend development teams.
- You thrive in a fast-paced start-up environment where there are always new projects and challenges.
- Bilingual fluency in English and Spanish, with excellent written and verbal communication skills.
Bonus
- Knowledge in backend development (Java, .NET) is a must.