As a JUMO Data Engineer, you will design, build and maintain scalable data architectures. You will monitor their performance, perform root cause analysis and provide solutions to any issues that might arise. You will work with large, complex data sets, which means experience working with Big Data is essential. On a typical day, we use Spark, Kafka, Python, SQL, Airflow and AWS technologies, such as Redshift. We work with Docker and Kubernetes for automating deployment, scaling, and management of containerized applications.

You will

Be responsible for creating robust, mission critical batch and streaming data processing capabilities
Design, implement, and maintain the data pipelines that constitute JUMO’s data platform, enabling effective use of data across the organisation
Provide feedback on team members’ output, encouraging skills development within the team
Work closely with Portfolio Managers and Decision Scientists to understand the real world problems we’re trying to solve
Be supported by senior leaders as you drive your own development

You will need

BSc. in Computer Science, Electrical Engineering or equivalent tertiary degree
Real-world understanding ’ experience of data pipeline design and development, as well as data processing and storage (i.e. experience in designing systems to process and curate large data sets)
Experience in streaming technologies preferred, specifically Spark and Kafka
Experience with cloud technologies, AWS preferred
Experience working with big-data technologies such as Apache Spark, Flink, Hadoop, Kafka or Kinesis, Cassandra, DynamoDB, InfluxDB, MongoDB, Presto, Beam
Command of productionising and monitoring of data pipeline workflows, and working knowledge of the Data Product Lifecycle
Experience in application design and development with at least one of the following languages: Python (preferred), Scala, Java
RDBMS experience in any relevant technology such as MySQL, PostgreSQL, Redshift and SQL Server. This includes experience with relational database administration, technical architectures and infrastructure components
Understanding of CI/CD practices
Productive within a Linux command line environment
Proven ability to contribute software as part of a team. We are looking for someone that can effectively communicate technical concepts, and apply critical thinking under pressure