Job Details

ID #21740232
State New York
City New york city
Job type Contract
Salary USD $130,000.00 - $150,000.00 hourly 130000.00 - 150000.00 hourly
Source Kforce Technology Staffing
Showed 2021-10-27
Date 2021-10-26
Deadline 2021-12-24
Category Et cetera
Create resume

Data Engineer - Data Lake

New York, New york city, 10011 New york city USA

Vacancy expired!

RESPONSIBILITIES:Kforce has a client in NYC that is seeking a Data Engineer - Data Lake.

Job Responsibilities of the Data Engineer include: Operationalize our data lake platform built on S3 and Dremio Optimize our data lake storage, leveraging file compaction and archiving strategies Create and maintain our data catalog Implement a layered architecture to enable self-service business intelligence and data science initiatives while maintaining query performance In this capacity, you will be hands-on in the design and implementation of our new platform while working in a small, cross-functional team

REQUIREMENTS: Strong expertise in advanced data modeling, schema and ETL process design, implementation and maintenance Experience with numerous Data Lake and Analytics technologies (Dremio preferred, Snowflake, AWS Athena, Presto) Strong knowledge of Data Lake best practices Strong background in advanced SQL and focused on understanding, manipulating, processing and extracting values from large datasets and data streams AWS experience (Glue, Lambda, Fargate) Scripting and coding experience (Python, Typescript) Experience with different variety of data types (JSON, Parquet, Excel, Flat files) Experience with databases and data stores including: Microsoft SQL, Postgresql, Elasticsearch, Mongo, AWS S3 Candidates qualifying for this position will have similar experience along with the skills and abilities to perform the duties mentioned Any relevant education and/or training will be considered a plus

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Vacancy expired!

Subscribe Report job