Data Engineer - Wellington

Company background Well known complex business based in Auckland City Fringe This role will ideally be based in Wellington however they will look at options in Auckland Position Overview Ideally after a Data Engineer who has senior level experience with AWS Cloud Data Platform There is a large data set so looking for someone who is experienced to transform useful data sets and to run the system they are using to process the data They work on Hive and Airflow Glue AWS Python and SQL Migration to AWS Organisational Structure Reports to the Head of Data Engineering Major Team Goals of the Role Work towards deadlines Facilitation the migration of people to the new platformHelp deploy the team Key Objectives 03 months The first three months of this role you will be focusing on cloud migration as they have a firm deadline for when they will be turning off their on premise solution 36 months After the initial project of migration is completed there is a list of their requirements which are not critical These projects will be budget and timeline dependent and are based on innovative ways to use data Key Challenges Success Limitations Obstacles Understanding the unique data and systems that they have It is a complicated but exciting environment There is also technical debt which you will need to work around What do the best do The best will be able to identify things which need to be done They will need to develop a deep understating of the requirements and how people will use this platform You will also look at other ways in which things can be done Required Capabilities Ideally you will come from a technology driven customer experience brand such as a telco advertising technology airline technology house etc Strong experience in software design and development Strong experience with at least 2 of the following Python SQL Java Scala C or R Good experience with database technologies such as Apache Spark Hadoop EMR MS SQL Server Oracle MySQL NoSQL MongoDB etc Proficient with Python PySpark SQL Best cultural fit character assets Great culture super friendly people are great Required qualifications and or technology stack AWS Apache Python JAVA and SQL DevOps CICD Github Good communication skillsTo Apply Apply on seek or call Sarah on 0272101710 if you have any questions