Python TSQL NoSQL AWS Kafka Spark Teletreball

In NS Group we are selecting As a Data Engineer, you will be responsible implementing complex data pipelines and analyticsbsolutions to support key decision-making business processes in our client´s domain. Key responsibilities include: - Work closely...
In NS Group we are selecting As a Data Engineer, you will be responsible implementing complex data pipelines and analyticsbsolutions to support key decision-making business processes in our client´s domain.

Key responsibilities include:

- Work closely with Product Owners and AWS Professional Service Architects to understand

requirements, formulate solutions, and implement them.

- Implement scalable data transformation pipelines as per design

- Implement Data model and Data Architecture as per laid out design.

- Evaluate new capabilities of AWS analytics services, develop prototypes, and assist in drawing POVs , participate in design discussions

Requirements

Minimum 3 years´ experience implementing transformation and loading of data from a wide variety of traditional and non-traditional sources such as structured, unstructured, and semi structured using SQL, NoSQL and data pipelines for real-time, streaming, batch and on-demand workloads

At least 2 years implementing solutions using AWS services such as Lambda, AWS

Step Functions and Glue, AWS S3, Redshift, Kinesis, DynamoDB, Apache Spark,

Experience working with data warehousing data lakes or Lakehouse concepts on AWS

Experience implementing batch processing using AWS Glue/Lake formation, & Data Pipeline

Experience or Exposure to AWS Dynamo DB will be a plus

Develop object-oriented code using Python, besides PySpark, SQL

Experience on Streaming technologies both OnPrem/Cloud such as consuming and producing from Kafka, Kinesis would be a plus

Experience building pipelines and orchestration of workflows in an enterprise environment using Apache Airflow/Control M

Experience implementing Redshift on AWS or any one of Databricks on AWS, or Snowflake on AWS

Good understanding of Dimensional Data Modelling will be a plus.

Ability to multi-task and prioritize deadlines as needed to deliver results

Ability to work independently or as part of a team

Excellent verbal and written communication skills with great attention to detail and accuracy

Experience working in an Agile/Scrum environment"

NS is a company that values both the professional technological profile of its employees and the interest and aptitude they show when it comes to developing new projects.

For this reason, we require constant people, with a desire to evolve and learn.

No et perdis res!

Uneix-te a la comunitat de wijobs i rep per email les millors ofertes d'ocupació


Mai no compartirem el teu email amb ningú i no t'enviarem correu brossa

Subscriu-te ara

Darreres ofertes d'ocupació de Enginyer/a de Dades a Madrid

Data Engineer

2 de febr.

Mática Partners

Madrid, ES

¿Te apasiona el BigData? ¿Quieres formar parte de un equipo con una de las trayectorias más solventes en el mundo del...

Grupo TECDATA Engineering

En Grupo Tecdata , estamos en la búsqueda de un Data Engineer Junior con experiencia en Spark/Scala y SQL para un...

Grupo NS

Desde Grupo NS precisamos incorporar un perfil con experiencia como Data Engineer donde es necesario un nivel avanzado de...

Grupo NS

Desde Grupo Ns estamos buscando perfiles con experiencia como Senior Azure DevOps para un proyecto 100% remoto. Skills: -...

Devops

31 de gen.

CAS TRAINING

Tecnologías a usar: - At least one of: Terraform and Microsoft Azure /Kubernettes management and deployment - At least...

GMV

Si tu meta es salvar el mundo, pero consideras entrenamiento de élite comer palomitas sin espegar la vista de la...

Serem

¿Te apasiona la ingeniería de datos y las tecnologías más punteras en la nube? Si tienes experiencia en Azure y estás...

Data Engineer

30 de gen.

Malthus Darwin

Malthus Darwin es una empresa de Consultoría, especializada en la búsqueda, selección yevaluación de perfiles IT. Nuestro...

Data Engineer

30 de gen.

Plexus

Join Plexus Tech. We are looking for different profiles of Data experts for a large project in the ICT market.

NPR Spain

En NPR Spain buscamos incorporar varios perfiles Data Engineer especialistas en PowerCenter para unirse a la unidad de...