Data Engineer

Description

Our R&D engineers and scientists develop breakthrough technologies that change the way the world works, and industries do business. We constantly push the limits of convention, while retaining our focus on delivering solid returns for our customers and shareholders.

We are looking for ambitious and curious Data Engineer to join our Digital Solutions R&D team in Genova, supporting developing and productizing an end-to-end digital energy platform and applications for Grid Edge Solutions.

This role will be partnering closely with our domain R&D, Data Analytics and Software Development team to fulfill business and technology roadmap.

You will be responsible for preparing data pipelines, working with the software architect to define architecture for the data storage and retention policies.

You will work on building and maintaining data pipelines that can be automated or on-demand to consolidate data from different systems into a structured format using e-mesh Digital Energy Platform and consumed by e-mesh applications to build reports, dashboards, and drive decisions for energy and service domain users.

You will be part of the Grid Edge Solutions R&D team focusing on delivering digital applications applied to Distributed Energy Resources and Battery Energy Storage Systems. You will be working on topics related to Energy Management, Energy Trading, and Asset Performance Analysis.

Tasks and Responsibilities

• Design data pipelines, improve data management strategies for the main datasets powering our business. Deploy data pipelines that transforms data into structure output for analytics in a robust, efficient, and scalable framework.
• Build tools and frameworks to help users summarize and explore the data.
• Partner with our architecture and data analytics team to build data driven applications for energy trading, service, and virtual power plants. 
• Perform Advanced SQL queries on massive datasets to create analytics that provide insight to drive action using various SQL languages. Work with timeseries data.
• Create and maintain data ELT pipelines using Apache NiFi or similar tools.
• Build ad-hoc reporting
• Support analytics and models deployment process

General Requirements

• Bachelor’s degree or higher in Computer Science, Computer Engineering, Data Science or equivalent
• Working experience with data architecture and data engineering
• A passion and curiosity for data and data-driven decision making
• Strong knowledge of SQL and Python
• Demonstrated experience building data pipelines using ETL services like Apache NiFi
• Experience with Git source control
• Fluency in English written and spoken, and knowledge of Italian language
• Deep understanding of data architecture best practices (relational, non-structured, streaming), and concepts such as normalizing data structures, minimizing logic complexity, defining intuitive and consistent semantic layers, and eliminating redundancy
• Knowledge of various data communication protocols (REST APIs)
• Experience implementing integration and unit testing for productionized code
• Experience using Docker, Kubernetes is a plus
• Experience building, deploying, maintaining, and optimizing master data and machine learning pipelines
• Experience with big data technologies such as Apache Spark, Kafka, and other data processing frameworks is a plus
• Business intelligence reporting like PowerBI, and Tableau