Job Details

ID #49531036
State New Jersey
City Jerseycity
Job type Permanent
Salary USD Depends on Experience Depends on Experience
Source Nityo Infotech Corporation
Showed 2023-03-24
Date 2023-03-23
Deadline 2023-05-22
Category Et cetera
Create resume

Azure DataBricks Architect

New Jersey, Jerseycity, 07097 Jerseycity USA

Vacancy expired!

Role: Azure DataBricks Architect

Location: New Jersey or anywhere in East Coast (onsite)

Type: Full-Time Skills: Azure Data Lake. Azure Synapse Azure Data Factory Azure Data Lake Storage, Azure Role based access controlJD:
  • Azure Data Architect who can demonstrate following skills:
  • Design a data storage structure:
  • design an Azure Data Lake solution recommend file types for storage recommend file types for analytical queries design for efficient querying design for data pruning design a folder structure that represents the levels of data transformation design a distribution strategy
  • Design a partition strategy: design a partition strategy for files | design a partition strategy for analytical workloads
  • Implement physical data storage structures: compression partitioning sharding different table geometries with Azure Synapse Analytics pools data redundancy implement distributions implement data archiving
  • Implement the serving layer: deliver data in a relational star schema deliver data in Parquet files maintain metadata implement a dimensional hierarch
  • Design and Develop Data Processing Ingest and transform data using Spark, T-SQL, Data Factory, Synapse Pipelines
  • Implement stream and batch pipelines Design and Implement Data Security
  • Data policies and standards: masking, encryption, row level and column level security, RBAC,
  • Data retention, auditing Manage sensitive information

Vacancy expired!

Subscribe Report job