Senior Data Engineer

 we're at the forefront of digital transformation and software services in the German market. Our mission is to provide Scale-ups, SMEs, and large corporations with a wide range of services to help them thrive in the digital age. We aim to become Germany’s fastest-growing and most impactful software design and development firm, and the natural go-to partner for CTO-as-a-Service and digital transformation across sectors such as mobility, telecom, insurance, banking, and healthcare.We're establishing a design center in Cairo and are on the lookout for talented software engineers, architects, data scientists, and data engineers to join us in realizing our vision.

Responsibility : 

As a Senior Data Engineer, you bring years of experience designing, building, and operating

large-scale data platforms in mission-critical production environments. 

Have built systems that ingest and process data from diverse sources, data modalities, and ingestion

patterns, including batch, real-time, and streaming workloads.

Expert in designing and implementing robust, scalable data pipelines that power continuously evolving machine learning systems.

Have extensive experience designing and evolving complex data schemas, managing schema evolution through CI/CD pipelines,and operating data platforms in Kubernetes-based environments.

Optimize data storage, read and write paths, database queries, indexing strategies, partitioning schemes, and connection pools to build highly performant and reliable

systems. 

Design, implement, test, and monitor asynchronous data ingestion,processing, and transformation jobs.

Have a strong engineering mindset and care deeply about operational excellence.

Build comprehensive observability dashboards with alerting mechanism to ensure the health and reliability of data pipelines. 

Write clear technical documentation and operational runbooks that help guarantee data freshness, data quality, and controlled schema evolution.

Required :

• You have at least 5 years of professional experience as a Data Engineer building and operating production-grade data platforms.

• Highly proficient in Python and its ecosystem, including FastAPI, Pydantic

v2, SQLAlchemy 2.x (Core and ORM), Alembic (multi-head migrations, autogenerate review, rollback), and Celery.

• Expert in PostgreSQL, with deep knowledge of query plans, indexing strategies, partitioning, materialized views, and pgvector.

• Extensive experience designing and operating data platforms on Kubernetes and packaging applications using Helm.

• Hands-on experience building and orchestrating data pipelines using Kubeflow Pipelines (KFP) and Apache Airflow.

• Experience working with S3-compatible object storage for Parquet datasets.

• Experience implementing GitOps and CI/CD workflows using GitHub Actions and ArgoCD.

• Experience with Qdrant or other vector databases is highly desirable.

• Experience with geospatial data processing is highly desirable, including PostGIS,GeoPy, and a working knowledge of spatial indexing systems such as S2 or H3.

• Familiarity with the NVIDIA GPU Operator, KServe, and vLLM is highly desirable.

• Familiarity with the Microsoft Azure data platform is highly desirable.

• You are fluent in English. German language skills are a plus.