CV/Mission d'Expert elasticsearch freelance

Exemple de missions d'Ahmed,
Expert elasticsearch habitant Paris (75)

• Consultant Elastic Stack Expert: Saudi Arabia

  Elastic Stack Expert: Saudi Arabia
  Jan 2024 - aujourd'hui

  Tasks:
  - Design an Elastic Stack infrastructure architecture
  - Define a data lifecycle strategy
  - Migration Oracle Cloud to Huawei Cloud
  - Cost optimization

  Technical environment: Elasticsearch Cloud (8.x), Logstash, Kibana, Kubernetes, Oracle Cloud

• Consultant Data Architect Leader (Team of 20):

  BNPP
  Jan 2022 - aujourd'hui

  Ansible, Prometheus, Grafana, Gitlab, Java (8, 11, 17)
  Manage tens of Elasticsearch and Kafka clusters:
  - Redesign monitoring and alerting strategy
  - Set up, configure, scale, upgrade, monitor
  Elasticsearch
  
  - Many clusters in production: various size and architectures (from 3 to 298 nodes)
  - Various requirements: throughput (until 15 Tb/day), latency, availability, consistency
  - Train Elasticsearch user teams (tuning, ingestion and querying optimization)
  - Migration from Beats to Elastic Agent and Fleet.
  Kafka
  - Many clusters in production: various size and architectures (from 3 to 216 brokers)
  - Migration from Zookeeper mode to Kraft
  - Redesign Kafka Streams and Flink applications
  - Develop a Java app for automatic partitions rebalancing

  Technical environment: Elasticsearch (7.x, 8.x), Logstash, Kibana, Beat, Data Streams, Fleet, Agent, Kafka (Streams, Connect),

• Consultant Operations, Leader technique Kafka:

  Michelin from
  Jan 2021 - Jan 2021

  Tasks:
  - Set up clusters monitoring based on Prometheus and Grafana
  - Migrate ansible scripts to cp-ansible (confluent) in production
  - Install, manage applications, AKHQ on Kubernetes
  - Support Kafka Streams application and Kafka Connectors
  - Set up Kafka Connect bound to Kafka cluster in Confluent Cloud
  - Set up, configure, operate, scale, upgrade clusters in production (Zookeper, Kafka, Connect and
  schema registry)
  - Train developers on Kafka Streams

  Technical environment: Confluent Kafka, Kafka Streams, Kafka Connect, Confluent Cloud, Schema Registry, Prometheus, Grafana, Ansible, Gitlab, Java, Kubernetes

• Consultant Data Architect, Elasticsearch and Kafka Expert:

  Accor from BNPP
  Jan 2020 - Jan 2022

  Tasks:
  - Manage (set up, configure, scale, upgrade, monitor) a logs monitoring infrastructure using
  Elastic Stack
  - Set up a search engine based on Elasticsearch
  - Optimise Elasticsearch client Java application
  - Manage (set up, configure, scale, upgrade, monitor) Kafka cluster in production
  - Security provisioning automation: Users, Acls
  - Monitoring: mutualize metrics and Grafana dashboards
  - Kafka Connect: develop custom SMT, connectors templates
  - Support and investigate stability and performance issues of Kafka Streams applications
  - Design and develop Kafka Streams applications

  Technical environment: Elasticsearch (5.x, 6.x, 7.x), Logtash, Kibana, AWS, Kafka (Streams, Connect), Prometheus, Grafana, Ansible, Gitlab, InfluxDB, Java (11)

• Consultant Elasticsearch Expert:

  Aramisauto Kafka: Michelin
  Jan 2020 - Jan 2020

  Tasks:
  - Load data from MySQL database into Elasticsearch
  - Create a new search engine for ********
  - Set up custom analyzer, customize score computing and develop search algorithm.
  - Fuzzy search support and smart products suggestions

  Technical environment: AWS, Elasticsearch (7.x), Kibana, Python, Flask, MySQL

• Data Architect :

  BNPP CIB
  Jan 2018 - Jan 2019

  Tasks:
  &#x2022 Expert and trainer Kafka, Kafka Streams
  - Perform Ansible playbooks for deploying, upgrading, tuning clusters
  - Operate huge clusters in production
  &#x2022 until 36 brokers / 5 nodes zookeeper cross data-centers, 10 Terabytes/day
  - Develop micro-services based on Kafka Streams
  - Define clusters sizing and scale clusters
  - Define architectures : multi-clusters , CQRS-ES
  - Set up Zookeeper and Kafka clusters monitoring using Elastic Stack
  &#x2022 Expert and trainer Elasticsearch, Elastic Stack, Machine Learning
  - Operate many clusters in prodution
  &#x2022 More than 10 Terabytes/day. 5 Petabytes with one year retention
  &#x2022 More than 700 nodes cross data-centers
  - Define clusters sizing and scale clusters
  Define architecture for data processing: multi-clusters, hot-Warm
  - Set up clusters monitoring using Elastic Stack
  - Set up Metricbeats and Filebeats configurations and create Kibana Dashbords
  - Components : advanced querying and agges, watchers, curator, recoveries, tasks, indextemplates, watcher, painless, &#x2026

  Technical environment: Elasticsearch (version 5.x, 6.x), Logstash, Beats, Kibana, Painless, Machine Learning, Kafka, Kafka Ops, Kafka Streams, Ansible, Java, Spring, Splunk

• Consultant Data Engineer:

  JCDecaux
  Jan 2017 - Jan 2017

  Tasks:
  - Upgrade ELK stack from version 2.1 to 5.6
  - Develop a Kafka consumer library managing errors, retries &#x2026
  - Develop a portal for managing, administrating and monitoring Kafka cluster
  - Upgrade and extend Kafka cluster
  - Connect Kafka to Cassandra and Elasticsearch (Kafka Connect, Kafka Stream)
  - Replicate data within and across Kafka cluster (Mirroring) Develop application using Spark

  Technical environment: Elasticsearch (2.x, 5.x), Confluent, Kafka, Java (11), Spring Boot, Rest, Maven, Logstash, Cassandra, Docker

• Consultant Architect

  : Ritmx
  Jan 2016 - Jan 2017

  Tasks:
  - Enrich data using Spark and index documents in Elasticsearch.
  - Train developers on Elasticsearch
  - Investigate and improve performances
  - Develop prototypes for an application: Spring Core, Spring Data, Spring Rest, Hazelcast,
  Elasticsearch, MongoDB, PostGreSQL NoSQL
  - Develop data processing batches: Spring (Core, WS, Rest, Cloud, Batch, Remoting), MapStruct,
  Swagger, Kryo, Avro, Jackson
  - BDD and functional tests: Cucumber, Selenium

  Technical environment: Java 8, JEE, SOAP, REST, Elasticsearch (2.x), Spring (Cloud, Boot, Core, Data, WS, Security, Batch, MVC, Rest), Hibernate, JProfiler, Git, Angular 2, PostGreSQL NoSQL, Cucumber, Selenium, Docker, Ansible

• Consultant DevOps:

  RATP
  Jan 2015 - Jan 2016

  Tasks:
  - Develop, audit Java applications: Maven, Spring, Hibernate, JSF, SOAP)
  - Migrate from SVN to Git
  - Develop applications: Git, Maven, Spring, AngularJS
  - Set up and configure GitLab

  Technical environment: Java 8, JEE 7, Intellij, Tomcat, Sonar, Jenkins, Artifactory, Play, Selenium, Git, GitLab, Android, Scala, Maven, Gradle, Spring (Boot, MVC, Rest), Hibernate, JSF, MyFaces

• Consultant SOA Architect:

  STEF
  Jan 2013 - Jan 2015

  Tasks:
  - GWT portal for flow monitoring
  - SOA Inter-application integration
  - Migrate from Oracle to Couchbase
  - Design and develop of heterogeneous flow applications

  Technical environment: JEE, SOA, Spring (Core, WS, MVC), Web services, SOAP, REST, CXF, JMS, Active MQ, Camel, GWT, EhCache, Hazelcast, Elasticsearch, Tomcat, BPEL, WebLogic, MyBatis, JDev, Oracle SOA Suite, Couchbase