Intermediate Data Engineer to develop, evaluate, test, and maintain architectures and data solutions using Kubernetes, Python and Spark for a Major Banking Client -26032

Intermediate Data Engineer to develop, evaluate, test, and maintain architectures and data solutions using Kubernetes, Python and Spark for a Major Banking Client -26032
Location Address: HYBRID - Downtown Toronto/Remote
Duration: ASAP until October 31, 2022, high chance of extension
Scheduled Hours: Mon- Fri 37.5 hours a week

Job Description:
Reason: New Project
The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization’s data assets.

Job Responsibilities:

• Building end to end solution for data pipeline using technologies like python, Hadoop and spark.
  • Identify and resolve the problem if current data pipeline fails
  • Continuous improvement of a new product
  • Building new code from an older project
• Communication with data scientists, strategists, product team, etc. and finding the data gap if exists.
• Will need to be flexible to assist on other projects where their expertise is required
• Will need to help Data Scientist in developing, validating and operationalizing the Models built by them

Must have:

• 4+ years of experience as a Data Engineer or related field
• 4+ years of experience with Minio, Trino, Airflow, and Kubernetes
• 4+ years of experience with Python & Spark
• 4+ years of experience with Hadoop, Shell scripting, Strong SQL knowledge,

Nice to have

• FI experience

Education/Experience:

• Bachelor's degree in a technical field such as computer science, computer engineering or related field required.

Interview:
2 step interview
1 interview with HM 45 minutes video conference (Technical questions)
2 interview with HM & Director 30 video conference (Technical & Behavior questions)