Ahmed - Expert Kafka Elasticsearch ELK

Ref : 100502A003

Email vérifié

Profil

Développeur, Ingénieur réseaux (40 ans)
Domicile

75014 PARIS
Mobilité

Ile-de-France
Tarif Journalier Moyen
Voir le tarif

Compétences

Elasticsearch

Kafka

Cloud AWS

Kubernetes

Docker

Ansible

Python

Java

ELK

Apache Spark

Expériences professionnelles

Consultant Elastic Stack Expert: Saudi Arabia

Elastic Stack Expert: Saudi Arabia
mars 2024 - aujourd'hui
Tasks:
- Design an Elastic Stack infrastructure architecture
- Define a data lifecycle strategy
- Migration Oracle Cloud to Huawei Cloud
- Cost optimization
Technical environment: Elasticsearch Cloud (8.x), Logstash, Kibana, Kubernetes, Oracle Cloud
Consultant Data Architect Leader (Team of 20):

BNPP
juillet 2022 - aujourd'hui
Ansible, Prometheus, Grafana, Gitlab, Java (8, 11, 17)
Manage tens of Elasticsearch and Kafka clusters:
- Redesign monitoring and alerting strategy
- Set up, configure, scale, upgrade, monitor
Elasticsearch

- Many clusters in production: various size and architectures (from 3 to 298 nodes)
- Various requirements: throughput (until 15 Tb/day), latency, availability, consistency
- Train Elasticsearch user teams (tuning, ingestion and querying optimization)
- Migration from Beats to Elastic Agent and Fleet.
Kafka
- Many clusters in production: various size and architectures (from 3 to 216 brokers)
- Migration from Zookeeper mode to Kraft
- Redesign Kafka Streams and Flink applications
- Develop a Java app for automatic partitions rebalancing
Technical environment: Elasticsearch (7.x, 8.x), Logstash, Kibana, Beat, Data Streams, Fleet, Agent, Kafka (Streams, Connect),
Consultant Operations, Leader technique Kafka: Michelin from

janvier 2021 - décembre 2021
Tasks:
- Set up clusters monitoring based on Prometheus and Grafana
- Migrate ansible scripts to cp-ansible (confluent) in production
- Install, manage applications, AKHQ on Kubernetes
- Support Kafka Streams application and Kafka Connectors
- Set up Kafka Connect bound to Kafka cluster in Confluent Cloud
- Set up, configure, operate, scale, upgrade clusters in production (Zookeper, Kafka, Connect and
schema registry)
- Train developers on Kafka Streams
Technical environment: Confluent Kafka, Kafka Streams, Kafka Connect, Confluent Cloud, Schema Registry, Prometheus, Grafana, Ansible, Gitlab, Java, Kubernetes
Consultant Data Architect, Elasticsearch and Kafka Expert: Accor from

BNPP
février 2020 - décembre 2022
Tasks:
- Manage (set up, configure, scale, upgrade, monitor) a logs monitoring infrastructure using
Elastic Stack
- Set up a search engine based on Elasticsearch
- Optimise Elasticsearch client Java application
- Manage (set up, configure, scale, upgrade, monitor) Kafka cluster in production
- Security provisioning automation: Users, Acls
- Monitoring: mutualize metrics and Grafana dashboards
- Kafka Connect: develop custom SMT, connectors templates
- Support and investigate stability and performance issues of Kafka Streams applications
- Design and develop Kafka Streams applications
Technical environment: Elasticsearch (5.x, 6.x, 7.x), Logtash, Kibana, AWS, Kafka (Streams, Connect), Prometheus, Grafana, Ansible, Gitlab, InfluxDB, Java (11)
Consultant Elasticsearch Expert: Aramisauto

Kafka: Michelin from
janvier 2020 - décembre 2020
Tasks:
- Load data from MySQL database into Elasticsearch
- Create a new search engine for ********
- Set up custom analyzer, customize score computing and develop search algorithm.
- Fuzzy search support and smart products suggestions
Technical environment: AWS, Elasticsearch (7.x), Kibana, Python, Flask, MySQL
Data Architect :

BNPP CIB
janvier 2018 - décembre 2019
Tasks:
• Expert and trainer Kafka, Kafka Streams
- Perform Ansible playbooks for deploying, upgrading, tuning clusters
- Operate huge clusters in production
• until 36 brokers / 5 nodes zookeeper cross data-centers, 10 Terabytes/day
- Develop micro-services based on Kafka Streams
- Define clusters sizing and scale clusters
- Define architectures : multi-clusters , CQRS-ES
- Set up Zookeeper and Kafka clusters monitoring using Elastic Stack
• Expert and trainer Elasticsearch, Elastic Stack, Machine Learning
- Operate many clusters in prodution
• More than 10 Terabytes/day. 5 Petabytes with one year retention
• More than 700 nodes cross data-centers
- Define clusters sizing and scale clusters
Define architecture for data processing: multi-clusters, hot-Warm
- Set up clusters monitoring using Elastic Stack
- Set up Metricbeats and Filebeats configurations and create Kibana Dashbords
- Components : advanced querying and agges, watchers, curator, recoveries, tasks, indextemplates, watcher, painless, …
Technical environment: Elasticsearch (version 5.x, 6.x), Logstash, Beats, Kibana, Painless, Machine Learning, Kafka, Kafka Ops, Kafka Streams, Ansible, Java, Spring, Splunk
Consultant Data Engineer:

JCDecaux
janvier 2017 - octobre 2017
Tasks:
- Upgrade ELK stack from version 2.1 to 5.6
- Develop a Kafka consumer library managing errors, retries …
- Develop a portal for managing, administrating and monitoring Kafka cluster
- Upgrade and extend Kafka cluster
- Connect Kafka to Cassandra and Elasticsearch (Kafka Connect, Kafka Stream)
- Replicate data within and across Kafka cluster (Mirroring) Develop application using Spark
Technical environment: Elasticsearch (2.x, 5.x), Confluent, Kafka, Java (11), Spring Boot, Rest, Maven, Logstash, Cassandra, Docker
Consultant Architect: Ritmx

août 2016 - janvier 2017
Tasks:
- Enrich data using Spark and index documents in Elasticsearch.
- Train developers on Elasticsearch
- Investigate and improve performances
- Develop prototypes for an application: Spring Core, Spring Data, Spring Rest, Hazelcast,
Elasticsearch, MongoDB, PostGreSQL NoSQL
- Develop data processing batches: Spring (Core, WS, Rest, Cloud, Batch, Remoting), MapStruct,
Swagger, Kryo, Avro, Jackson
- BDD and functional tests: Cucumber, Selenium
Technical environment: Java 8, JEE, SOAP, REST, Elasticsearch (2.x), Spring (Cloud, Boot, Core, Data, WS, Security, Batch, MVC, Rest), Hibernate, JProfiler, Git, Angular 2, PostGreSQL NoSQL, Cucumber, Selenium, Docker, Ansible
Consultant DevOps:

RATP
avril 2015 - juillet 2016
Tasks:
- Develop, audit Java applications: Maven, Spring, Hibernate, JSF, SOAP)
- Migrate from SVN to Git
- Develop applications: Git, Maven, Spring, AngularJS
- Set up and configure GitLab
Technical environment: Java 8, JEE 7, Intellij, Tomcat, Sonar, Jenkins, Artifactory, Play, Selenium, Git, GitLab, Android, Scala, Maven, Gradle, Spring (Boot, MVC, Rest), Hibernate, JSF, MyFaces
Consultant SOA Architect:

STEF
novembre 2013 - mars 2015
Tasks:
- GWT portal for flow monitoring
- SOA Inter-application integration
- Migrate from Oracle to Couchbase
- Design and develop of heterogeneous flow applications
Technical environment: JEE, SOA, Spring (Core, WS, MVC), Web services, SOAP, REST, CXF, JMS, Active MQ, Camel, GWT, EhCache, Hazelcast, Elasticsearch, Tomcat, BPEL, WebLogic, MyBatis, JDev, Oracle SOA Suite, Couchbase

Études et formations

Engineer at National School for computer Sciences Manouba, Tunisia

2010
Mathematics Baccalaureate

2005
Preparatory Institute for Engineering Studies Sfax Tunisia Mathematics Physics National exam

2004

Langues

Anglais - C2

Autres compétences

TECHNICAL SKILLS
Data Elasticsearch (Ops, Elastic Stack, ML), Kafka (Connect, Stream), Flink, Prometheus,
InfluxDB, Splunk, MongoDB, Hazelcast, PostGreSQL NoSQL, Apache Spark, Cassandra,
Oracle (PL/SQL), MySQL, Redis
Ops Docker, Kubernates, Ansible, Gitlab, MAVEN, SBT, Gradle, Git, CVS, SVN, Jenkins, Sonar,
Nexus, Archiva, Artifactory, Liquibase
Langages Java, Python, Scala, Bash, C/C++, Groovy, JavaScript
Java Java EE, Java SE, Hibernate, MyBatis, Spring (Cloud, Boot, Core, MVC, Data, WS, Batch,
Security, JMS, Integration, Rest, Remoting, Test), JSF, Struts, GWT, Play
Scala Akka, Spray, Multithreading, Streaming
Microservices DDD, Spring (Boot, Cloud, Data, Rest), Swagger, Eureka, Consul, Zuul
Cloud AWS, Azure
SOA Web Services, SOAP, REST, JAX-WS, Spring WS, ReadyAPI, Active MQ, BPEL, ESB
Audit java JProfiler, JMeter, VisualVM
Web and Mobile Angular, TypeScript, JavaScript, CSS, HTML, Android, Cordova, Ionic
Test Selenium, JUnit, TestNG, Mockito, dbUnit, Concordion, Cucumber, JBahve, JGiven

TRAINER (NOT EXHAUSTIVE)
Prometheus Grafana Since 2022 Many sessions
Kafka Operations (3 days) Since 2018 Atos, Jems Group, BNPP CIB (Luxamboug, Brussels, Geneva),
Energisme, imsa, …
Kafka Developer (3 days) Since 2019 Michelin, Jems Group, PRO BTP, …
Elasticsearch Operations (2 days) Since 2019 Energisme, …
Elasticsearch Developer (2 days) Since 2015 BNPP Risk AIR, Jems Group, Orange, …
Elastic Stack (3 days) Since 2015 BNPP CIB, BNPP CIB AMER (New York), Orange
Elastic Machine Leaning (2 days) Since 2018 La poste, BNPP CIB
Docker and Kubernetes (18 hours) Since 2021 ESGI engineer school
Amazon Web Services (30 hours) Since 2020 ESGI engineer school
Others 2014-2017 - Java, JEE
- TDD: JUnit, DBUnit, Mokito, Selenium, JMeter, best practices
- Maven
- SOA: Web services, SOAP, REST, MOM, BPEL, ESB, SoapUI, Ready API
- OSGi: specification, Felix implementation
- JPA et Hibernate

AUDIT (NOT EXHAUSTIVE)
Jahia
11/2020 (2 days) - Audit about sizing and configuring Elasticsearch (7.x) cluster
BPI France
6,7,8/2019 (16 days)
- Expert Elasticsearch (7.x): Data modeling, definining mapping, sizing,
configuring
Enedis
6/2019 (2 days)
- Audit Confluent clusters
BNP Fortis Brussels
12/2014 (2 days)
- Audit functional tests and suggest process improvement (Selenium, Maven,
Jenkins)

LANGUAGES SKILLS
French Fluent Arabic Fluent
English Fluent Italian Beginner

Recommandations reçues

Recommander Ahmed

Ahmed n'a pas encore reçu de recommandations.

D'autres freelances
Développeur Elasticsearch

Ces profils pourraient vous intéresser !

Développeur backend

NÎMES

PHP Symfony SQL Docker PostgreSQL GO React.js JavaScript Cloud AWS Elasticsearch CI/CD Git Stripe MySQL Google Cloud Platform Kubernetes

Disponible

Consultant IT

JUVISY-SUR-ORGE

Scala Java Apache Spark Kubernetes Elasticsearch Spring Boot Apache Kafka Cassandra

Technical Leader Java

CACHAN

Java Spring SQL NoSQL Apache Kafka GitLab Elasticsearch Angular Docker Cloud AWS

Senior Developer C#, SQL, .NET / ElasticSearch / AWS

NEUILLY-SUR-MARNE

C# SQL Elasticsearch Cloud AWS API RESTful

Développeur web fullstack orienté backend

MONTPELLIER

JavaScript TypeScript Vue.js PHP React.js Flutter Kotlin Elasticsearch Cloudinary Golang

Ingénieur de développement JAVA

FRANCONVILLE

Java J2EE JavaScript SQL PL/SQL React.js Docker MongoDB Elasticsearch Spring Boot

Data Engineer & Développeur Java -Scala

JUVISY-SUR-ORGE

Scala API RESTful Oracle Apache Spark Elasticsearch

Développeur Vue.js

BOULOGNE-BILLANCOURT

Vue.js JavaScript PHP Node.js SQL NoSQL Docker MongoDB Elasticsearch TypeScript

Bientôt disponible

Développeur JAVA, Angular

GAGNY

Java Angular SQL NoSQL GitLab RabbitMQ Elasticsearch Kafka

Ingénieur de développement JAVA ANGULAR Microservices

SAINT-GRATIEN

Java SQL J2EE Angular SQL Server PL/SQL Kafka Elasticsearch CQRS Spring Boot

Mme

Prénom ^*

Nom ^*

Email ^*

Téléphone ^*

Ville ^*

Avez-vous trouvé une mission ? ^*

J'accepte d'être contacté par nos partenaires, experts en portage salarial et j'accepte la politique de confidentialité du site www.freelance-informatique.fr

Domaines d'expertise liés

CV en rapport

Ahmed - Expert Kafka Elasticsearch ELK

Développeur, Ingénieur réseaux (40 ans)

75014 PARIS

Consultant Elastic Stack Expert: Saudi Arabia

Consultant Data Architect Leader (Team of 20):

Consultant Operations, Leader technique Kafka: Michelin from

Consultant Data Architect, Elasticsearch and Kafka Expert: Accor from

Consultant Elasticsearch Expert: Aramisauto

Data Architect :

Consultant Data Engineer:

Consultant Architect: Ritmx

Consultant DevOps:

Consultant SOA Architect:

Engineer at National School for computer Sciences Manouba, Tunisia

Mathematics Baccalaureate

Preparatory Institute for Engineering Studies Sfax Tunisia Mathematics Physics National exam

D'autres freelances Développeur Elasticsearch