Join Simple Machines and be part of our mission to help clients unlock the full potential of their data through the creation of cutting-edge business driven data platforms and software solutions. As we continue to expand our team across Australia and New Zealand, we are seeking Principal / Senior Data Engineers who are unafraid to challenge the status quo and push boundaries.About YouWe are looking for individuals who are passionate about working closely with clients to solve complex problems and lead them on a journey from discovery to technical implementation. You have a knack for understanding client needs and delivering market-leading solutions.The Exciting PartSimple Machines is not your average consultancy or software engineering firm. Our team is comprised of inspiring technical leaders in Data Engineering, Machine Learning, and Artificial Intelligence. Our projects are data-focused and drive impactful business outcomes.About the RoleAs a Principal / Senior Data Engineer, you will have the opportunity to work on world-class programs, collaborate with our engineering and analytics teams, and mentor teams from various organisations.Sound good so far?ResponsibilitiesCollaborate with business stakeholders to understand their domain and data needsArchitect, design, and implement scalable solutions to meet stakeholder requirementsMentor teams across a variety of organisationsRequirementsUnderstanding of big data considerations, such as security, governance, reliability, and scalabilityAbility to upgrade existing solutions to meet new requirementsAbility to model data to meet business requirements and make informed technology recommendationsDeep understanding of structured, semi-structured, and unstructured dataHands-on experience with batch processing and streaming tools and technologies, such as Spark, Kafka, Flink, DBT, and AthenaExperience with cloud platforms (AWS, GCP, Azure)Proficiency in programming languages such as Python, Java, Scala, GoLang, or RustExperience with data warehousing technologies (BigQuery, Snowflake, Databricks) and data storage formats (Parquet, Delta, ORC, Avro, JSON)Nice-to-HavesExperience with infrastructure as code tools (Terraform, Pulumi, CDK)Knowledge of containerised solutions (Docker, Kubernetes)Familiarity with CI/CD tools (GitHub Actions, Azure DevOps, JetBrains TeamCity, Octopus Deploy, ArgoCD)Experience with testing tools and frameworks (DBT, Great Expectations, Soda)Unless otherwise stated: You must have full working rights in New Zealand.Working at Simple MachinesWe're looking for someone who's as passionate as we are about building a world-class technology company specialising in engineering for data.Just some of the benefits of working with Simple Machines include:Flexible working: Want to work from home or leave early to pick up the kids? Need to start early some days, later on others? No problem!Generous parental leave: Three months' fully paid primary carer leave and one month fully paid secondary carer leave, subject to a minimum 12 month tenureLearning and development: We all love continually learning and have a generous budget for you to upskill, join conferences, get certified and qualifiedLunch is on us. Always! We happily supply lunch at each of our office locations every Monday, Wednesday and Friday.#J-18808-Ljbffr
