Sr. Data Engineer (Scala Spark) to design and build a stack of data services on premise and in AWS cloud for a banking client

Job Type: Contract
Positions to fill: 2
Start Date: Nov 01, 2023
Job End Date: Oct 31, 2024
Pay Rate: Hourly: Negotiable
Job ID: 133177
Location: Toronto
Apply

Position: Senior Data Engineer

Duration: 12 months with possible extension

Location: remote anywhere is Canada


 

Must have:

  • 7+ years of experience as a Data Engineer (Core Java, Spring Boot, Scala, Spark) in the cloud environment - AWS (i.e. S3, Aurora, Glue family, etc.)
  • Relational Database (i.e. SQL server, Oracle, PostgreSQL, etc.)
  • Data Catalog and Lineage products (i.e. Informatica, Menta, etc.)
  • Data virtualization products (i.e. Dremio, Denodo, etc.)
  • Docker (i.e. OpenShift/AWS ECS fargate,e tc.)
  • DevOps integration (CI/CD with GitHub, Maven, etc.)

 

Nice to have:


- Other Java frameworks (i.e. Apache Camel, Spring Batch)

- Python

- AMPS, in-memory cache/data platform (MemSQL, Ignite, etc.)

- Elastic/ELK stack or Grafana, etc. dashboard tools

- Other AWS components (i.e. SageMaker, RedShift, etc.)