Data Engineer

RESPONSIBILITIES

• Work with a scrum team(s) to deliver product stories according to priorities set by the client and the Product Owners with a focus on building infrastructure
• Writing code to move data, such as: migrate informatica jobs to client's custom framework migrating legacy environment to S3 environment pipeline support.
• Working with existing teams that also write code to move data.
• Attending standups and scrum ceremonies.
• Interact with stakeholders and support our partners in leveraging pipelines.

REQUIREMENTS

• Must Have:
• Demonstrated expertise with a minimum of 3+ years of experience as data engineer or similar role
• Advanced SQL skills and experience with relational databases
• Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
• Strong exposure to write ETL / pipeline code
• Experience in Data collection from multiple sources and integrating based on business needs
• Proficient with Spark
• Familiarity with the AWS/Azure/GCP data engineering services
• Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
• Proficiency in the English language.
• Nice to have:
• Exposure to AI / ML
• Exposure to work with Big Data technologies such as Spark, Hadoop etc
• Knowledge of DataBricks, Snowflake, BigQuery
• Exposure to Tableau, PowerBI
• Experience in Java or Scala

BENEFITS

• Team Building.
• End of the year party.
• Family-friendly benefits and vacation time
• The flexibility of a software consulting environment; project variety, adapting to new business domains, and building complex applications
• Ability to flex your creativity muscle, and have your opinions heard
• A work culture where you'll look forward
• Free food and beverages during events like Thursday Night Socials
• Downtown Toronto location (easily accessible by public transit)