Job Details

ID #16982281
State Illinois
City Chicago
Job type Contract
Salary USD Depends on Experience Depends on Experience
Source Reliable Software Resources
Showed 2021-07-19
Date 2021-07-06
Deadline 2021-09-04
Category Et cetera
Create resume

Data engineer

Illinois, Chicago, 60290 Chicago USA

Vacancy expired!

Role : Data engineer

Location : New York, New Jersey, Florida, Chicago, IL, California

Duration : Long Term

Job Description

2 refs must

Interview process: zoom with our account manager than zoom with client

Must have: Airflow, Python, AWS, and SQL, 70 percent is support/monitoring, 30 percent developmentSr. Data Engineer must have a broad and deep data skillset as well as strong analytical capabilities . In addition to being a hands on individual contributor, the ideal candidate is a productive team player and a mentor to Junior Data Engineers. Additionally, we are looking for strong technical experts.Actively participate in team technical discussions in all things dataIdentify and address issues with data sets from multiple vendorsIdentify and address code and data quality issuesActively participate in code reviews and grooming sessionsActively participate in technology architecture discussions for product developmentTranslate business requirements into strategyAdvocate for software best practices within your team as well as across engineeringBe ultra-responsive and capable of making instant decisions, always kicking the ball forwardWork on unique and interesting data challenges around architecting, building and managing pipelines that securely process hundreds of terabytes of dataWork closely with analysts and statisticians to ensure the validity of our processesOur engineers are expected to wear a number of hats and have the opportunity to touch all parts of the stack. Our stack includes Apache Spark, Scala, Redshift and an ever-growing list of many other cool technologies.

RequirementsAirflowExperience wrangling terabytes of big, complicated, imperfect dataExperience with AWS products (Redshift, EMR, S3, IAM, RDS, etc)You have a deep understanding of scalable systems and you have large-scale engineering experience in an Agile development environmentBachelor's degree in Computer Science or a related field (or 4 additional years of relevant work experience)A strong understanding of data structures, algorithms, and effective software designSignificant development experience with a major modern language (e.g. Java, Scala, Python, Ruby, C/C, etc.)Significant experience working with structured and unstructured data at scale and comfort with a variety of different stores (key-value, document, columnar, etc.) as well as traditional RDBMSes and data warehousesExperience with or interest in AWS Glue, Redshift Spectrum and any other tools that enable data querying at scaleExperience writing unit, functional and integration testsComfort with version control systems (e.g. Git, SVN)Excellent verbal and written communication skills; must work well in an agile, collaborative team environment

Thanks,

Abdul Samad

Technical Recruiter

(O): 248.636.2768

Vacancy expired!

Subscribe Report job