Python Azure Cloud Coumputing Kafka

ABOUT US At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the...
ABOUT US

At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.

JOIN THE TEAM

We are currently seeking a talented Solutions Architect to join our team at BASF´s Agricultural Solutions department Digital Factory.

RESPONSIBILITIES

- Design and develop scalable and efficient cloud-based data integration architectures using Databricks and Azure Data Factory.
- Integrate real-time streaming solutions with Event Hubs and Kafka to manage high-throughput data ingestion and processing.
- Optimize data storage, transformation, and access using Azure Data Lake Storage Gen2 (ADLS Gen2).
- Write clean, efficient, and reusable code in Python and PySpark to process and analyze large-scale datasets
- Collaborate with cross-functional teams to understand data requirements and implement solutions that align with business goals
- Monitor, troubleshoot, and improve the performance of cloud-based data platforms and pipelines
- Ensure data quality, governance, and security standards are met across all data solutions
- Review and approve the developments of the team.
- Communicate with the business stakeholders.

REQUIREMENTS

- Proven expertise in Databricks and Azure Data Factory for building data pipelines and workflows.
- Strong experience with Event Hubs and Kafka for real-time data streaming and messaging.
- Proficiency in working with Azure Data Lake Storage Gen2 (ADLS Gen2) for data management and storage optimization.
- Advanced programming skills in Python and PySpark for data engineering tasks.
- Solid understanding of data integration, transformation, and optimization best practices in cloud environments
- Experience working with large-scale data processing and real-time streaming architectures.
- Familiarity with Azure cloud services and related tools
- Strong analytical and problem-solving skills with a focus on performance and scalability.

NICE TO HAVE

- Strong understanding of IT solutions design principles, methodologies, and best practices.
- Ability to conduct requirement analyses by gathering, analyzing, and translating business needs into technical solution designs.

BENEFITS

- Responsibility from day one in a challenging work environment and "on-the-job" training as part of a committed team.
- Adequate compensation according to your qualifications and experience • A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holidays per year
- Another 5 days (readjustments days) and 2 days (cultural days)
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided

No et perdis res!

Uneix-te a la comunitat de wijobs i rep per email les millors ofertes d'ocupació


Mai no compartirem el teu email amb ningú i no t'enviarem correu brossa

Subscriu-te ara

Darreres ofertes d'ocupació de Informàtica i IT a Madrid

Financiera El Corte Inglés E.F.C, S.A.

En Financiera El Corte Inglés , buscamos la excelencia en la gestión del riesgo. Nuestra área de Riesgos es clave para...

Hays

Desde Hays estamos buscando un Membership Manager que quiera buscar nuevos retos profesionales en una empresa lider en...

Hays

Consultor/a 360 de desarrollo de negocio y recursos humanos. ¿Te gustaría trabajar en una empresa orientada a objetivos y...

SEPD

La Sociedad Española de Patología Digestiva (SEPD) es una organización científica y profesional sin ánimo de lucro que...

Hercesa

Alcalá de Henares, ES

En Hercesa somos una empresa con más de 50 años de experiencia en el desarrollo inmobiliario, comprometidos con la...

RAS España

Madrid, ES

¿Te apasiona analizar datos y transformar información en decisiones estratégicas? ¡Este proyecto es para ti! Desde la...

Lognext

Madrid, ES

En Lognext llevamos más de 18 años identificando e implementando soluciones tecnológicas prácticas que nos permitan...

BBVA Technology en Europa

¡Bienvenido al lugar que te mereces! 🔍¿Qué buscamos? Buscamos profesionales con experiencia en gestión de proyectos...

Palladium Hotel Group

¿Te has preguntado alguna vez qué es lo que hace especial a una empresa que hace vivir experiencias únicas a miles de...

CAE

Madrid, ES

About This Role Aircraft Transitions Engineer Are you looking for a work environment where you can innovate, reach...