Data Engineer needed to join the Information Management team and focus on the development of big data reporting and analytics solutions

Our client is looking for a  Data Engineer to join the Information Management team and focus on the development of big data reporting and analytics solutions, working closely with business partners and stakeholders to meet their decision-support requirements. 

Accountabilities will include:

• Working in collaboration with customers across the organization to plan, scope, execute and sustain data-based solutions
• Responding to internal and external ad hoc requests, review and clarify data requirements, ensuring report content is acceptable within policy and privacy protocols 
• Providing subject matter expertise within the department and to clients on data sources, reporting workflows, business process, and the appropriate tools with which to analyze their data 
• Participating with corporate data user teams, developing data validation and test plans, performing user acceptance testing, and providing feedback to development and sustainment teams 
• Conducting analysis for moderate to complex requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification 
• Leading a team of Data Engineers. 

Position Requirements To make an immediate contribution, the Data Engineer will bring the following: 

• Advanced skill in programming languages such as Scala or Java 
• Working experience with Big Data platforms, ideally with exposure to Hadoop ecosystem (HDFS, Hive, SPARK, NoSQL, YARN)
• Strong SQL and analytic skills with large datasets 
• Hands-on experience with structured and unstructured databases 
• Demonstrated ability to work with large and complex datasets, while managing priorities and responding to time pressures 
• Strong understanding of data quality process, data analysis and data profiling 
• Ability to apply critical thinking skills to troubleshoot and perform root cause analysis on technical problems and solution design 
• Providing technical advice and guidance to staff in resolving complex querying or data integration issues 
• Experience with performance tuning and code optimization 
• Design, develop and enforce best practices and standards around data quality and querying
• Understanding of Agile Methodologies 
• Experience with DevOps and visualization tools, such as Tableau would be an asset.