Data Engineer

At Hitachi Energy our purpose is advancing a sustainable energy future for all. We bring power to our homes, schools, hospitals and factories. Join us and work with fantastic people, while learning and developing yourself on projects that have a real impact to our communities and society. Bring your passion, bring your energy, and be part of a global team that appreciates a simple truth: Diversity + Collaboration = Great Innovation

Our R&D engineers and scientists develop breakthrough technologies that change the way the world works, and industries do business. We constantly push the limits of convention, while retaining our focus on delivering solid returns for our customers and shareholders.

We are looking for ambitious and curious Data Engineer to join our Digital Solutions R&D team in Genova, supporting developing and productizing an end-to-end digital energy platform and applications for Grid Edge Solutions.

This role will be partnering closely with our domain R&D, Data Analytics and Software Development team to fulfill business and technology roadmap.

You will be responsible for preparing data pipelines, working with the software architect to define architecture for the data storage and retention policies.

You will work on building and maintaining data pipelines that can be automated or on-demand to consolidate data from different systems into a structured format using e-mesh Digital Energy Platform and consumed by e-mesh applications to build reports, dashboards, and drive decisions for energy and service domain users.

You will be part of the Grid Edge Solutions R&D team focusing on delivering digital applications applied to Distributed Energy Resources and Battery Energy Storage Systems. You will be working on topics related to Energy Management, Energy Trading, and Asset Performance Analysis.

Tasks and Responsibilities

• Design data pipelines, improve data management strategies for the main datasets powering our business. Deploy data pipelines that transforms data into structure output for analytics in a robust, efficient, and scalable framework.
• Build tools and frameworks to help users summarize and explore the data.
• Partner with our architecture and data analytics team to build data driven applications for energy trading, service, and virtual power plants.
• Perform Advanced SQL queries on massive datasets to create analytics that provide insight to drive action using various SQL languages. Work with timeseries data.
• Create and maintain data ELT pipelines using Apache NiFi or similar tools.
• Build ad-hoc reporting
• Support analytics and models deployment process

General Requirements

• Bachelor’s degree or higher in Computer Science, Computer Engineering, Data Science or equivalent
• Working experience with data architecture and data engineering
• A passion and curiosity for data and data-driven decision making
• Strong knowledge of SQL and Python
• Demonstrated experience building data pipelines using ETL services like Apache NiFi
• Experience with Git source control
• Fluency in English written and spoken, and knowledge of Italian language
• Deep understanding of data architecture best practices (relational, non-structured, streaming), and concepts such as normalizing data structures, minimizing logic complexity, defining intuitive and consistent semantic layers, and eliminating redundancy
• Knowledge of various data communication protocols (REST APIs)
• Experience implementing integration and unit testing for productionized code
• Experience using Docker, Kubernetes is a plus
• Experience building, deploying, maintaining, and optimizing master data and machine learning pipelines
• Experience with big data technologies such as Apache Spark, Kafka, and other data processing frameworks is a plus
• Business intelligence reporting like PowerBI, and Tableau

Basic Info

Location Genova, Genova, Italy

Job type Full time

Experience Experienced

Job function IT, Telecom & Internet

Contract Regular

Publication date 2023-11-06

Reference number R0033159

Share this job

Interested in working with us?

The best jobs in a performing and growing company

Hitachi Energy is a global technology leader that is advancing a sustainable energy future for all. We serve customers in the utility, industry and infrastructure sectors with innovative solutions and services across the value chain. Together with customers and partners, we pioneer technologies and enable the digital transformation required to accelerate the energy transition towards a carbon-neutral future. We are advancing the world’s energy system to become more sustainable, flexible and secure whilst balancing social, environmental and economic value. Hitachi Energy has a proven track record and unparalleled installed base in more than 140 countries. Headquartered in Switzerland, we employ around 40,000 people in 90 countries and generate business volumes of approximately $10 billion USD.

#J-18808-Ljbffr