CV/Mission d'Expert elasticsearch freelance

Exemple de missions d'Ahmed,
Expert elasticsearch habitant Paris (75)

Consultant Elastic Stack Expert: Saudi Arabia
Elastic Stack Expert: Saudi Arabia
mars 2024 - aujourd'hui
Tasks:
- Design an Elastic Stack infrastructure architecture
- Define a data lifecycle strategy
- Migration Oracle Cloud to Huawei Cloud
- Cost optimization
Technical environment:
Elasticsearch Cloud (8.x), Logstash, Kibana, Kubernetes, Oracle Cloud

Consultant Data Architect Leader (Team of 20):
BNPP
juillet 2022 - aujourd'hui
Ansible, Prometheus, Grafana, Gitlab, Java (8, 11, 17)
Manage tens of Elasticsearch and Kafka clusters:
- Redesign monitoring and alerting strategy
- Set up, configure, scale, upgrade, monitor
Elasticsearch

- Many clusters in production: various size and architectures (from 3 to 298 nodes)
- Various requirements: throughput (until 15 Tb/day), latency, availability, consistency
- Train Elasticsearch user teams (tuning, ingestion and querying optimization)
- Migration from Beats to Elastic Agent and Fleet.
Kafka
- Many clusters in production: various size and architectures (from 3 to 216 brokers)
- Migration from Zookeeper mode to Kraft
- Redesign Kafka Streams and Flink applications
- Develop a Java app for automatic partitions rebalancing
Technical environment:
Elasticsearch (7.x, 8.x), Logstash, Kibana, Beat, Data Streams, Fleet, Agent, Kafka (Streams, Connect),

Consultant Operations, Leader technique Kafka: Michelin from
janvier 2021 - décembre 2021
Tasks:
- Set up clusters monitoring based on Prometheus and Grafana
- Migrate ansible scripts to cp-ansible (confluent) in production
- Install, manage applications, AKHQ on Kubernetes
- Support Kafka Streams application and Kafka Connectors
- Set up Kafka Connect bound to Kafka cluster in Confluent Cloud
- Set up, configure, operate, scale, upgrade clusters in production (Zookeper, Kafka, Connect and
schema registry)
- Train developers on Kafka Streams
Technical environment:
Confluent Kafka, Kafka Streams, Kafka Connect, Confluent Cloud, Schema Registry, Prometheus, Grafana,
Ansible, Gitlab, Java, Kubernetes

Consultant Data Architect, Elasticsearch and Kafka Expert: Accor from
BNPP
février 2020 - décembre 2022
Tasks:
- Manage (set up, configure, scale, upgrade, monitor) a logs monitoring infrastructure using
Elastic Stack
- Set up a search engine based on Elasticsearch
- Optimise Elasticsearch client Java application
- Manage (set up, configure, scale, upgrade, monitor) Kafka cluster in production
- Security provisioning automation: Users, Acls
- Monitoring: mutualize metrics and Grafana dashboards
- Kafka Connect: develop custom SMT, connectors templates
- Support and investigate stability and performance issues of Kafka Streams applications
- Design and develop Kafka Streams applications
Technical environment:
Elasticsearch (5.x, 6.x, 7.x), Logtash, Kibana, AWS, Kafka (Streams, Connect), Prometheus, Grafana,
Ansible, Gitlab, InfluxDB, Java (11)

Consultant Elasticsearch Expert: Aramisauto
Kafka: Michelin from
janvier 2020 - décembre 2020
Tasks:
- Load data from MySQL database into Elasticsearch
- Create a new search engine for ********
- Set up custom analyzer, customize score computing and develop search algorithm.
- Fuzzy search support and smart products suggestions
Technical environment:
AWS, Elasticsearch (7.x), Kibana, Python, Flask, MySQL

Data Architect :
BNPP CIB
janvier 2018 - décembre 2019
Tasks:
• Expert and trainer Kafka, Kafka Streams
- Perform Ansible playbooks for deploying, upgrading, tuning clusters
- Operate huge clusters in production
• until 36 brokers / 5 nodes zookeeper cross data-centers, 10 Terabytes/day
- Develop micro-services based on Kafka Streams
- Define clusters sizing and scale clusters
- Define architectures : multi-clusters , CQRS-ES
- Set up Zookeeper and Kafka clusters monitoring using Elastic Stack
• Expert and trainer Elasticsearch, Elastic Stack, Machine Learning
- Operate many clusters in prodution
• More than 10 Terabytes/day. 5 Petabytes with one year retention
• More than 700 nodes cross data-centers
- Define clusters sizing and scale clusters
Define architecture for data processing: multi-clusters, hot-Warm
- Set up clusters monitoring using Elastic Stack
- Set up Metricbeats and Filebeats configurations and create Kibana Dashbords
- Components : advanced querying and agges, watchers, curator, recoveries, tasks, indextemplates, watcher, painless, …
Technical environment:
Elasticsearch (version 5.x, 6.x), Logstash, Beats, Kibana, Painless, Machine Learning, Kafka, Kafka Ops,
Kafka Streams, Ansible, Java, Spring, Splunk

Consultant Data Engineer:
JCDecaux
janvier 2017 - octobre 2017
Tasks:
- Upgrade ELK stack from version 2.1 to 5.6
- Develop a Kafka consumer library managing errors, retries …
- Develop a portal for managing, administrating and monitoring Kafka cluster
- Upgrade and extend Kafka cluster
- Connect Kafka to Cassandra and Elasticsearch (Kafka Connect, Kafka Stream)
- Replicate data within and across Kafka cluster (Mirroring) Develop application using Spark
Technical environment:
Elasticsearch (2.x, 5.x), Confluent, Kafka, Java (11), Spring Boot, Rest, Maven, Logstash, Cassandra, Docker

Consultant Architect: Ritmx
août 2016 - janvier 2017
Tasks:
- Enrich data using Spark and index documents in Elasticsearch.
- Train developers on Elasticsearch
- Investigate and improve performances
- Develop prototypes for an application: Spring Core, Spring Data, Spring Rest, Hazelcast,
Elasticsearch, MongoDB, PostGreSQL NoSQL
- Develop data processing batches: Spring (Core, WS, Rest, Cloud, Batch, Remoting), MapStruct,
Swagger, Kryo, Avro, Jackson
- BDD and functional tests: Cucumber, Selenium
Technical environment:
Java 8, JEE, SOAP, REST, Elasticsearch (2.x), Spring (Cloud, Boot, Core, Data, WS, Security, Batch, MVC, Rest),
Hibernate, JProfiler, Git, Angular 2, PostGreSQL NoSQL, Cucumber, Selenium, Docker, Ansible

Consultant DevOps:
RATP
avril 2015 - juillet 2016
Tasks:
- Develop, audit Java applications: Maven, Spring, Hibernate, JSF, SOAP)
- Migrate from SVN to Git
- Develop applications: Git, Maven, Spring, AngularJS
- Set up and configure GitLab
Technical environment:
Java 8, JEE 7, Intellij, Tomcat, Sonar, Jenkins, Artifactory, Play, Selenium, Git, GitLab, Android, Scala,
Maven, Gradle, Spring (Boot, MVC, Rest), Hibernate, JSF, MyFaces

Consultant SOA Architect:
STEF
novembre 2013 - mars 2015
Tasks:
- GWT portal for flow monitoring
- SOA Inter-application integration
- Migrate from Oracle to Couchbase
- Design and develop of heterogeneous flow applications
Technical environment:
JEE, SOA, Spring (Core, WS, MVC), Web services, SOAP, REST, CXF, JMS, Active MQ, Camel, GWT, EhCache,
Hazelcast, Elasticsearch, Tomcat, BPEL, WebLogic, MyBatis, JDev, Oracle SOA Suite, Couchbase