#16620 | 2020-05-15 Warszawa, Gdynia, Poland

Hadoop/Big Data Developer

PROJECT INFORMATION:
  • Industry: Finance / Banking
  • Location: Warszawa or Gdynia
  • Business trips: Occasional
  • Project language: English, Polish
  • Remuneration: 140-150 PLN/H + VAT
  • Project length: 12 months +

PROJECT REQUIREMENTS:

Role description:
  • Responsible for Database
  • Reporting development in the agile team

Scope: We are building a new customer account reporting engine to (over the coming years) replace our existing legacy customer account reporting solutions across our home markets. A pre-requisite is that we consolidate all account and payment transaction data to Hadoop, so we have dozens of data formats and integration points both upstream and downstream. The project has two delivery streams: CA that deliver new reports to Corporate customers in ISO XML format and CBP that will deliver old legacy reports to all 10M customers in the Nordics.

Responsibilities:
  • As an expert Big Data Developer you will be responsible for a successful design and implementation of a high-performing, flexible, robust, scalable and easily maintainable global reporting solution.

Required skills/competencies:
  • Hadoop; Hive; Impala; Kafka; Splunk

Other skills/competencies:
  • Deep understanding of the principles of distributed systems
  • Knowledge and experience with: Apache Hadoop, Hive, Oozie, Pig, Sqoop, Impala, Kafka
  • Experience with NoSQL databases: MongoDB, Cassandra, HBase or similar
  • Experience with building ETL/ETL pipelines
  • Production experience with performance tuning of Hadoop/Spark solutions
  • Familiar with OOD and design patterns
  • Experience from large-scale system integration projects
  • Working with RDBMS and knowledge of SQL
  • Integration towards RESTful and SOAP/OSB-services
  • Knowledge and experience with web servers such as Tomcat, Jetty or Weblogic
  • Knowledge and experience with tools like Maven, Git, and the Atlassian suite (Stash/Bitbucket, Jira, Confluence)
  • Hands on experience with Redhat, Linux shell scripting
  • Hands-on experience with writing Apache Spark-based applications in Scala
  • 7+ years of software development

WE OFFER:
  • Challenging international projects in a Scandinavian business culture.
  • Transparently built relations based on trust and fair play.
  • Benefits: Medicover card, Multisport card.
  • Internal reference bonus.


Start: ASAP
Duration: 12 months+
Work location: Warszawa, Gdynia, Poland
Requirements: Min. 5 years of professional IT experience.
Job type: Freelance

Opgaven er lukket

Vi beklager, men vi søger ikke længere konsulenter til dette projekt.

Klik på "Freelance job" for at se listen over aktuelle opgaver og job.

Hvis du er kunde og leder efter en lignende profil, kan du benytte "Få CV på IT-konsulent" formularen på vores andet website.

ProData Consult gemmer data i din browser / enhed ved hjælp af cookies med henblik på statistik og optimering af vores hjemmesider og eventuelt til målrettet annoncering. Ved at acceptere, giver du os dit samtykke til denne brug af cookies. Læs vores privatlivspolitik for mere information. Du kan altid trække dit samtykke tilbage her: Persondata politik & cookies

Webstedet kræver brug af "Nødvendige cookies". Vores nødvendige cookies bruges kun til at levere en korrekt fungerende hjemmeside og webservice.

Udvalgte tredjepartstjenester kan lagre cookies for at placere relevante annoncer, der leveres til dig på tredjepartswebsteder.