Vacancy expired!
- Data Engineer: 5-8 years’ experience.
- Python Scripting: (required)
- Python 2.6+
- Python 3.3+
- Experience developing highly scalable data platform and reliable data pipeline and processing large data feeds using Python
- Database: (required)
- Oracle
- Postgres / Aurora
- Experience building and maintaining data pipelines and/or analytical or reporting systems at scale
- Knowledge of Data Science, Machine Learning and Statistical Models is desirable
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional and non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies
- Experience with Cloud computing (AWS)
- AWS DevOps skills
- Experience with Spark
- Experience in developing high volume transaction processing solutions
Vacancy expired!