R&D Engineer - Data Engineer - IDC

Business Information:

Hitachi Energy India Development Centre (IDC) is a research and development facility with around 500 R&D engineers, specialists, and experts, who focus on creating and sustaining digital solutions, new products and technology. This includes product integration, testing, cybersecurity, and certification.  The India Development Centre is situated in Chennai and Bangalore. IDC collaborates with the R&D and Research centers of Hitachi Energy, which are spread across more than 15 locations throughout 12 countries. In the past 20 years, IDC has secured more than 200 international papers and 150+ patents.

Mission Statement:

We are advancing the world’s energy system to become more sustainable, flexible and secure whilst balancing social, environmental and economic.  Hitachi Energy has a proven record and unparalleled installed base in more than 140 countries.

Your Responsibilities:

• Develop pipelines on Azure Synapse, ingestion + transformation and suitable storage structures.

• Testing to verify that data ingestion and transformation work.

• Work together with the current team and transfer knowledge at the same time.

• Develop enterprise grade pipelines (must be able to log and alert on error occurrences) – resilient and robust.

• Create a good mix of dedicated and parametrized pipelines and data structures – we expect more than 1000 different file formats that shall be ingested.

• Advice on good metadata descriptions and how to work with metadata.

• Able to stay on scope and take responsibility for meeting milestones and deadlines.

• Able to analyze, design, and implement components by applying best practices and coding standards.

• Proactive with suggestions for improvements; thinks laterally; receptive to new ideas.

• Write well designed, testable, efficient code.

• Living Hitachi Energy’s core values of safety and integrity, which means taking responsibility for your own actions while caring for your colleagues and the business.

Your Background:

• B.E (EEE/ECE/CSE) with 3+ years.

• Strong written and verbal communication skills.

• Worked with developing pipelines on Azure Synapse (Azure Data Factory will do, but Synapse is preferred ).

• Worked on enterprise scale development (to help us set up appropriate ways-of-working, code repository strategy etc).

• Worked with CI/CD pipelines for Synapse or Data Factory.

• Worked with decisions on how to propagate code artifacts Dev->Test->Prod with Synapse or Data Factory.

• Experience on working with Azure Purview.

• Proficiency in both spoken & written English language is required.