Software Engineer - AI / ML
Build and maintain scalable data pipelines (BigQuery, Cloud Composer, Airflow, Dataflow, Spark, Flink, dbt) on GCP for AI/ML experiences. Use Docker/k8s, Terraform, SQL, shell scripting, and monitoring tools (Monte Carlo, Looker, NewRelic, Splunk). Collaborate with product engineering, data science, and business teams.
Free Tailor for ATS: 10/10 runs left
Our client, a leading global SaaS organisation is looking for a Software Engineer to work on exciting AI/ML user experience projects, for a 12 month contract. Hybrid working available.
Experience
• 3+ years experience developing applications written in a modern programming environment - preferably Scala/Java and/or Python.
• Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt;
• Working knowledge of SQL and shell scripting;
• Experience with Docker/k8s and “infrastructure as a code” tools such as Terraform, Salt or similar.
• Confident at articulating complex technical content to peers and partners across the organization via Technical Design Documents.
Responsibilities;
• Providing data sources that help build the AI/ML user experience
• Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow.
• Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness.
• Scope and plan work together with product engineering, data science and the business; support other teams for all tasks related to data tracking, collection, ingestion, quality monitoring and alerting.
This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform.
Benefits
• Hybrid working
• Long contract
• Award winning work environment