One of our clients from the retail industry is currently looking for a data engineer to join their team.
As a foundational member of the team, you will be responsible for driving the team’s long-term vision and architecture, drive/shape roadmaps, and provide technical leadership. You will be part of a talented and passionate squad of engineers, you will experience many facets of the world of online retail (e-tail) and take part in a growing push towards world class customer experience and operational excellence. New ideas are always welcome in a community driven work culture that continuously strives to be on the leading edge. As a Data Engineer, you are given the opportunity to help lead a transition to a scalable and versatile streaming data architecture. You will work closely with developers, stakeholders and BI analysts on operational and strategic data. Essentially, you will witness the core of what makes a serious e-commerce operation tick.
●Participate in the architecture, development, testing, deployment and delivery of streaming data flows that communicate between service data sources, the data lake, the data warehouse and 3rd party systems
●Enforce standards, nomenclature and best practices for data storage and transformation
●Maintain existing ETL / ELT processes and implement new ones for operational and BI purposes
●Create and maintain EDI and other 3rd party integrations
●Collaborate closely with operations and Business Intelligence to meet their needs
●Proactively work with the product team to conceive technical or functional solutions
●Bring the team to new heights by presenting new concepts to a tech committee
●Ensure product resilience by automating tests as part of the CI/CD process
●BS degree or higher in Computer Science, Engineering or related field. Master's degree or foreign equivalent in Computer Science, Engineering, Mathematics, is an asset
●2 + years of professional ecommerce experience working on distributed streaming resources such as Kafka / Spark, Spring, AWS Kinesis/ SNS / Event Bridge, etc.
●2 + years of professional experience with ETL batch processing (eg. Pentaho, Talend, SSIS)
●4+ years Experience with relational row-based (MySQL, MS-SQL) and column-based DBs (Snowflake, BigQuery, Cassandra) as well as NoSQL(MongoDB, DynamoDB, Elastic Search)
●Knowledge of Python, Bash or similar technologies
●Hands on experience in building and operating scalable and secure systems on AWS/Google cloud/Azur or similar
●Knowledge of professional software engineering practices & best practices for full software development life cycle, including coding standards, code reviews, source control management, testing, continuous deployments and operations.
●Demonstrated ability to mentor junior software engineers in all aspects of their engineering skill-set
●Knowledge of data science practices is a definite asset