Data Engineer

Candidate will be a member of Bentley Commercial Programs: Enterprise Software Licensing and Usage Analytics team. The position involves cloud based operational development and maintenance of enterprise licensing data infrastructure and  building scalable/ robust data systems. Candidate should be comfortable working within a core team  interfacing with internal/ external stakeholders.

Role:

• Building Data systems using Microsoft Azure Cloud technologies: Azure Data Factory, Azure Databricks , Azure Data Lakes, Azure Functions
• Data Engineering involving design, development and maintenance of optimized Data pipelines orchestrating  ETL processes.
• Data Management of data assets using relational and big data stores i.e. Data Lake, Data warehouse.
• Defining Data Architecture to shape Data Governance strategy.
• Build and maintain fully automated CI/CD enabled build/release pipelines.  
• Collaboration with technical stakeholders to participate in design and development of cross functional systems.
• Collaboration with Product and Business Intelligence teams to implement business solutions.

Requirements:

• Bachelors/ Master’s degree in Computer Science.
• Excellent analytical and problem solving skills.
• Strong Computer Science Foundation: Algorithms, Data Structures, Object Oriented Programming.
• Hands on programming experience preferably in  C#, Python.
• Familiarity with Microsoft .Net Technology stack.
• Strong understanding of Databases and Transact-SQL .
• Knowledge of software development best practices: SCRUM, GIT, CI/CD, Test Automation
• Strong written and verbal communication skills.

Preferred applicants will have:

• Enthusiasm for building cloud based data systems and applications.
• Understanding/ Experience of Microsoft Azure Cloud, Azure Data Lake, Azure Data Factory, and SQL Databases or equivalent products from other cloud services providers (e. g. AWS
• Understanding/ Experience of Big Data Engines: Spark, Hadoop
• Experience in database development projects and ETL processes.
• Experience implementing RESTful services in ASP.Net, Python, Ruby etc.
• Hands on with scripting languages: PowerShell, Python.