Vacancy expired!
- Skills and experience in using Synapse or a demonstrated ability to learn quickly
- Skills and experience programming in Python and SQL - 2+ years
- Skills and experience using PowerBI
- Ability to clearly document all work (commented code, readme files, diagrams, etc.) so that work is easily transferred back to internal employees
- Excellent attention to detail and QC skills to ensure errors are found and corrected before they appear in our public reporting
- Good verbal and written communication abilities for internal collaboration
- 1-2 years' experience: Python Scripting
- 2-4 years' experience: Adhoc SQL, Data Warehousing, Data Acquisition, Python Scripting
- Skilled in data engineering, coding in Python and other languages, and report/dashboard development in PowerBI and other data visualization tools. Specific tasks include:
- Develop data lake architecture and set up Synapse:
- Setting up automated jobs to bring in external, raw data sources. In some cases, we will be duplicating current functions. In other cases, new sources and thus new functions must be developed.
- Setting up automated tasks to transform raw data into processed (generally not final) form. We will be duplicating processes in some cases and enhancing or adding processes in other cases.
- A key element of this work will be deciphering processes with limited notation and creating new code with complete notation for the use of future programmers.
- Program in Python and SQL to develop refined data tables for feed into dashboard and recurring reports. This work will generally transform data that has been cleaned and/or transformed in simple ways from raw to generate more complex and calculation-based tables.
- Porting scripts over to Synapse.
- Re-writing particularly difficult scripts from current pipeline process in Python (i.e., looking through old code, inputs and outputs to rewrite for use in Synapse).
- Creating code to transform new data sources that replace older sources that are simpler or less accurate.
- Adding code notation as needed to explain processes for future users.
- Carrying out testing process to check results and improve quality of new and existing processes.
- Generate new data visualization outputs
- Building out many PowerBI dashboards, many relatively simple
- Developing Streamlit sites
- Migrating and enhancing daily email reports in PowerBI Report Builder and other tool
- Specific tasks will be defined as priorities and needs dictate. The consultant's charge is to take on and complete one specific task as a time.
Vacancy expired!