Praca: Data Engineer - Professional


Avenga is a global IT and digital transformation champion. We deliver strategy, customer experience, solution engineering, managed services, software products and outsourcing services like: staff augmentation, team leasing and permanent employment.Together, we are more than 2500 professionals with over 20 years of experience. We are present in Europe, Asia and the USA.
Data Engineer - Professional
Miejsce pracy: woj. podkarpackie
Nr ref.: LP/DEP/ZD/10

Strong Python + Pandas knowledge

  • good SQL knowledge
  • knowledge around AWS, Docker, Gitlab CI/CD

Duties:

  • data flow design
  • data pipelines optimization
  • social media data preprocessing and cleaning for data modelling purposes

The project is about building a system that collects, analyze and generate insights based on Social Media data to improve market research and better support our patients.

Requirements:

  • 2+ years of working with programming language focused on data pipelines,eg. Python or R
  • 1+ years of experience working on GCP, Cloud (AWS/Azure/Google) or other cloud platform (optional)
  • 1+ years of experience in data pipelines maintenance
  • 1+ years of experience with different types of storage (filesystem, relation, MPP, NoSQL) and working with various kinds of data (structured, unstructured, metrics, logs, etc.)
  • 1+ years of experience in working in data architecture concepts (in any of following areas data modeling,
  • metadata mng., workflow management, ETL/ELT, real-time streaming, data quality, distributed systems)
  • 2+ years of experience working with SQL
  • Exposure to open source and proprietary cloud data pipeline tools such as Airflow, Glue and Dataflow (optional)
  • Very good knowledge of relational databases (optional)
  • Very good knowledge of Git, Gitflow and DevOps tools (e.g. Docker, Bamboo, Jenkins, Terraform
  • Very good knowledge of Unix
  • Good knowledge of Java and/or Scala
  • Pharma data formats is a big plus (SDTM)
Please include in your application the following consent:I agree to the processing of my personal data provided by me, not mentioned in art. 221 § 1 of the Labor Code, or other specific provisions applicable pursuant to art. 221 § 4 of the Polish Labour Code, in order to recruit by the Administrator - Avenga IT Professionals Sp. z o.o. with registered office in Wrocław, ul. Gwiaździsta 66, 53-413 Wrocław, for the position Data Engineer - Professional.
APLIKUJ TERAZ

Zobacz podobne oferty

Avenga

Python Developer

Lokalizacja: podkarpackie /

O KLIENCIE Klientem jest lider na rynku usług medycznych w obszarze płodności i zdrowia kobiet. Skutecznie łączy medycynę,...

Opublikowano: wczoraj

Avenga

Python Developer

Lokalizacja: podkarpackie /

We are looking for an experienced Python software engineer to further develop the Remote Patient Monitoring Data Analysis software...

Opublikowano: wczoraj

Avenga

Python Developer

Lokalizacja: podkarpackie /

We are looking for an experienced Python software engineer to further develop the Remote Patient Monitoring Data Analysis software...

Opublikowano: wczoraj

Fujitsu Technology Solutions Sp. z o.o.

Python Developer

Lokalizacja: podkarpackie /

Development of new functionality according to defined requirements Following all defined way of working, and coding standards and...

Opublikowano: wczoraj

Fujitsu Technology Solutions Sp. z o.o.

Python Software Developer

Lokalizacja: podkarpackie /

Write reusable, testable, and efficient code Design and implement of low-latency, high-availability, and performant applications...

Opublikowano: wczoraj

Polcode Sp. z o.o

Python Developer

Lokalizacja: podkarpackie / Rzeszów, Mielec, Stalowa Wola, Łańcut, Przemyśl, Sanok, Krosno, Jasło, Dębi

Lokalizacja: zdalnie lub biuro Warszawa, Kraków, Białystok Rekrutacja odbywa się oczywiście całkowicie online w obecnej sytuacji....

Opublikowano: 2021-11-29