Job Details

ID #12268937
State Michigan
City Auburnhills
Job type Contract
Salary USD $65+ 65+
Source DISYS - Digital Intelligence Systems, LLC
Showed 2021-04-15
Date 2021-04-14
Deadline 2021-06-13
Category Et cetera
Create resume

Big Data Architect

Michigan, Auburnhills, 48321 Auburnhills USA

Vacancy expired!

Role:Big Data ArchitectDuration: 12 MonthsLoaction: Auburn Hills, MI

Description:Role: manage and maintain Data Lake clusters infrastructure: installation, configuration, performance tuning and monitoring of Hadoop clusters• BS degree, preferably in Computer science or equivalent• Good communication skills with right attitude to blend in with team• Minimum 5 years work experience in Hadoop ecosystems (Horton HDP or Cloudera’s CDH/CDP)• should demonstrate strong concepts in Unix/Linux, Windows OS, cloud platforms (MS Azure, AWS)• must have good exposure to Cloudera manager, Cloudera Navigator or similar cluster management tool• Collaborate and assist developers in successful implementation of their code, monitor and fine tune their process for optimum resource utilization on cluster, ability to automate run time process• must have good knowledge of HDFS, Ranger/Sentry, Hive, Impala, Spark, HBase, Kudu, Kafka, Ni-Fi, sqoop and other Hadoop related services• exposure to Data Science collaborative tools such as data science workbench, anaconda, etc.• should have strong Networking concepts: topology, proxy, F5, firewall• Strong security concepts: Active directory ,Kerberos, LDAP, SAML, SSL, data encryption @rest• programming language concepts: Java, Perl, python, PySpark and Unix shell scripting• Experience in tuning and optimizing Hadoop environment in keeping clusters healthy and available for end users and applications with maximum cluster uptime as defined in SLA• important role is to keep the cluster performing well and dependable• should possess experience in cluster management, perform cluster upgrade, migration and testing• Perform periodic updates to cluster and keeping the stack current• Familiarity with Cloudera’s BDR tool to perform and monitor backups of critical data and able to restore data when in need• ability to expand clusters by adding new nodes and rebalance cluster storage systems• manage application databases, application integration, users, roles, permissions within cluster• collaborate with Unix, network, database and security teams on cluster related matters• must monitor cluster for maximum uptime, ability to research on cluster issues via logs and collaborate with support in a proactive way

Vacancy expired!

Subscribe Report job