Sr. Data Engineer (Remote)

Problems you will solve/Responsibilities

• Develop and establish scalable automated processes for large-scale data analysis and model development, verification and implementation.
• Create and ensure the optimal data pipeline architecture
• Assemble large, complex datasets that meet functional / non-functional business requirements
• Redesign the infrastructure for greater scalability, identify, design, and implement internal process improvements
• Building infrastructure to optimize the extraction, transformation and loading of data from various sources
• Cultivate data pipelines for analytic tools to provide actionable insights into operational efficiency and other key business performance metrics
• Create data tools for analytics and data scientist team members that assist in building and optimizing products

Skills and Requirements

Must have skills

• 5+ years of experience in a Data Engineer role
• High knowledge and experience working with relational databases, query authoring SQL, and familiarity with a variety of databases
• Experience with building and optimizing large, complex data pipelines, architectures and data sets
• Familiarity with big data tools: Hadoop, Spark, Kafka
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

Nice to have skills

• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Aptitude to obtain and maintain a security clearance

NOTE: The successful applicant must be able to acquire security clearance, and is able to work in Canada. For security clearance purposes, applicants may be required to have resided in Canada for at least 5 years.​