Big Data Engineer
Templeton & Partners
Hilversum, Netherlands 
2 dagen geleden

The Opportunity

Templeton & Partners is looking for Big Data Engineer to join one of our international clients in Hilversum, Netherlands.

This project duration is up to two years with initial 6 months contract.

Responsibilities :

  • Design and implement distributed data processing pipelines using Spark, Hive, Sqoop, Python, and other tools and languages prevalent in the Hadoop ecosystem.
  • Ability to design and implement end to end solution.

  • Build utilities, user defined functions, and frameworks to better enable data flow patterns.
  • Research, evaluate and utilize new technologies / tools / frameworks centered around Hadoop and other elements in the Big Data space.
  • Define and build data acquisitions and consumption strategies
  • Build and incorporate automated unit tests, participate in integration testing efforts.
  • Work with teams to resolving operational & performance issues
  • Work with architecture / engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.
  • Qualification :

  • MS / BS degree in a computer science field or related discipline
  • 6+ years’ experience in large-scale software development
  • 1+ year experience in Hadoop or big data technologies.
  • Strong Java programming, Python, shell scripting, and SQL
  • Strong development skills around Hadoop, Spark, Hive, and Pig
  • Good understanding of file formats including JSON, Parquet, Avro, and others
  • Experience with performance / scalability tuning, algorithms and computational complexity
  • Ability to understand relational database schemas
  • Proven ability to work cross functional teams to deliver appropriate resolution
  • Experience with AWS components and services, particularly, EMR, S3, and Lambda
  • Automated testing, Continuous Integration / Continuous Delivery
  • Nice to have :

  • Experience with open source NOSQL technologies such as HBase, DynamoDB, Cassandra
  • Experience with messaging & complex event processing systems such as Kafka and Storm
  • Scala
  • Machine learning frameworks
  • Statistical analysis with Python, R or similar
  • Experience (at least familiarity) with data warehousing, dimensional modeling and ETL development
  • We very much look forward to receiving your application, and will be in touch promptly to discuss in more detail.

    Bij de favorieten invoegen
    Verwijder van favorieten
    Mijn E-mail
    Door op "voortzetten" te klikken, gaat u ermee akkoord dat neuvoo uw persoonlijke gegevens verzamelt en verwerkt die u in dit formulier hebt verstrekt, om een ​​neuvoo-account te maken en u te abonneren op onze e-mailwaarschuwingen, in overeenstemming met ons Privacybeleid . U kunt uw toestemming te allen tijde intrekken door te volgen deze stappen .