Job Details

ID #20986890
State New York
City Whiteplains
Job type Contract
Salary USD $60 - $70 60 - 70
Source Ampcus Inc
Showed 2021-10-11
Date 2021-10-06
Deadline 2021-12-04
Category Et cetera
Create resume

ETL - Pentaho Developer

New York, Whiteplains, 10601 Whiteplains USA

Vacancy expired!

Hello,please go through below job description and let me know your interest,

Title: ETL Pentaho Developer

Location: White Plains, NY

Expected Duration: Long Term Assignment

Job Description:

Project Overview The goal is to replace the existing legacy EVE Forecasting Engine in 2020 before the Oracle database sunsets. There are no plans for upgrades or maintenance from the vendor and the system uses antiquated technology and does not interface well with other current scheduling applications. The solution should integrate with PowerOptix. The details of the different data integrations that will be enabled over the duration of the project are outlined below.1) Datasets information
  • a) Capacity Data
  • b) CRM Data for 7 utilities
  • c) Interval Data for 7 utilities
  • d) Billing Latest Balance Data for 7 utilities
  • e) MV90 for MUNI(s)
  • f) SAP EDCAP Billing Data for 7 utilities
  • 2) Reviewing and confirming data requirements (schema, format, frequency, etc.) for the different data flows3)Provisioning the project on NYPA Enterprise Data Platform4)Initial one-time data profiling of datasets to provide visibility on Data Quality and help identify required Data Quality rules5) Storing the processed data and merging with historical data set6) Enabling a nightly automated process to ingest the data, refresh the tables and create the required output files7) Setting up monitoring jobs using NYPA’s monitoring service to send email alerts on any job / validation failures8) Performing testing and UAT activities to validate input and output tables and columns

    Job Functions & ResponsibilitiesCollaborate with all developers and business users to gather required data and execute all ETL programs and scripts on systems and implement all data warehouse activities.Collaborate and perform tests and provide update to all ETL activities within schedule and provide support to all large data volumes and assist in data processing.Documents all technical and system specifications documents for all ETL processes and perform unit tests on all processes and prepare required programs and scripts.Analyze and interpret all complex data on all target systems and analyze and provide resolutions to all data issues and coordinate with data analyst to validate all requirements.Perform tests and validate all data flows and prepare all ETL processes according to business requirements and incorporate all business requirements into all design specifications.Develop all data warehouse models and prepare reports for all meta data integration into systems and draft all ETL scripts and prepare required reports for all end users.Provide support to all ETL schedule and maintain compliance to same and develop and maintain various standards to perform ETL codes and maintain an effective project life cycle on all ETL processes.Document all test procedures for systems and processes and coordinate with business analysts and users to resolve all requirement issues and maintain quality for same.Monitor all business requirements and validate all designs and schedule all ETL processes and prepare documents for all data flow diagrams.

    Professional

    Skills Pentaho Data Integrator tool (PDI)Python & Java scriptingWrite SQL complex queries and Store ProceduresPySpark languageAzure Blob StorageEducation & CertificationsBachelor's degree in computer science or equivalent with around 6+ years of experience in ETL Development, Data transformations using Pentaho – must be excellent Pentaho developerExperience in dealing with Data Quality issues. Regards,

    Dishant HumaneSpecialist - Talent AcquisitionAmpcus Inc.14900 Conference Center Dr, Suite 500,Chantilly, VA 20151Contact : +1 (703) -763- 4407Email ID : LinkedIn : https://www.linkedin.com/in/dishant-humane-21a283122/Web :

    www.ampcus.com

    Vacancy expired!

    Subscribe Report job