Senior Data Engineer Bigdata Engineer job vacancy

Vacancy expired!

Role : Senior Data Engineer/Bigdata Engineer

Location: Miami, FL

Duration: 24 Months

Your Role Drive the evolution of Data & Services products/platforms with an impact-focused on data science and engineeringDesigning machine learning systems and self-running artificial intelligence (AI) software to automate predictive models.Ensuring that algorithms generate accurate user recommendations.Turning unstructured data into useful information by auto-tagging images and text-to-speech conversions.Solving complex problems with multi-layered data sets, as well as optimizing existing machine learning libraries and frameworks.Provide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.Discover, ingest, and incorporate new sources of real-time, streaming, batch, and API-based data into our platform to enhance the insights we get from running tests and expand the ways and properties on which we can testExperiment with new tools to streamline the development, testing, deployment, and running of our data pipelines.Maintain awareness of relevant technical and product trends through self-learning/study, training classes and job shadowing.Participate in the development of data and analytic infrastructure for product developmentContinuously innovate and determine new approaches, tools, techniques & technologies to solve business problems and generate business insights & recommendationsPartner with roles across the organization including consultants, engineering, and sales to determine the highest priority problems to solveEvaluate trade-offs between many possible analytics solutions to a problem, taking into account usability, technical feasibility, timelines, and differing stakeholder opinions to make a decisionBreak large solutions into smaller, releasable milestones to collect data and feedback from product managers, clients, and other stakeholdersEvangelize releases to users, incorporating feedback, and tracking usage to inform future developmentEnsure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.Work with small, cross-functional teams to define the vision, establish team culture and processesConsistently focus on key drivers of organization value and prioritize operational activities accordinglyEscalate technical errors or bugs detected in project workMaintain awareness of relevant technical and product trends through self-learning/study, training classes, and job shadowing.

Ideal Candidate Qualifications: Superior academic record at a leading national university in Computer Science, Data Science, Computer Engineering, Technology, or a related field or equivalent work experienceExpertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environmentAt least 5 years of experience as a data engineer or machine learning engineer and with open-source toolsPrior experience in working in product development/management roleExperience in building and deploying production level data driven applications and data processing workflows/pipelinesExperience with application development frameworks (Java/Scala, Spring)Experience with data processing and storage frameworks like Hadoop, Spark, KafkaExperience implementing REST services with support for JSON, XML and other formatsExperience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scriptsExperience of working in Agile teamsGood analytical skills required for writing and performance tuning complex SQL queries, debugging production issues, providing root cause, and implementing mitigation planAbility to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statementFlexibility to work as a member of a matrix based diverse and geographically distributed project teamsStrong project management skillsExperience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presentingCuriosity, creativity, and excitement for technology and innovationDemonstrated quantitative and problem-solving abilitiesAbility to multi-task and strong attention to detailMotivation, flexibility, self-direction, and desire to thrive on small project teamsGood communication skills - both verbal and written – and strong relationship, collaboration skills, and organizational skills

The following skills will be considered as a plus Financial Institution or a Payments experience a plusBatch processing and workflow tools such as NiFiExperience in developing integrated cloud applications with services like Azure, Databricks, AWS or Google Cloud PlatformExperience in managing/working in Agile teamsExperience developing and configuring dashboards

Vacancy expired!

ID	#43098780
State	Florida
City	South florida
Job type	Contract
Salary	USD Depends on Experience Depends on Experience
Source	ICONMA
Showed	2022-06-16
Date	2022-06-09
Deadline	2022-08-08
Category	Et cetera
Create resume

Job Details

Senior Data Engineer/Bigdata Engineer

Related jobs

»Senior Network Engineer - USA Remote

»Senior Project Manager - Professional Civil Engineer

»Senior Electrical Engineer P6

»Insfrastructure Engineer

»IBM i System Engineer

»AI Cloud Solution Engineer

»Network Firewall Engineer, Level 2