Missions Scala : Découvrez les offres de mission déposées

Aperçu des missions de Daniel/Xu,
freelance SCALA habitant les Hauts-de-Seine (92)

• Senior Software Engineer.

  Back Market, Paris, Since
  Jan 2022 - aujourd'hui

  As an engineer in Back market product team, the goal is to provide the best offer to customer from merchants. I participate to transform monolithic architecture tomicroservice, improve service quality and performance, lead technical initiatives and contribute new marketplace opening.
  • Transform and rollout use cases to microservice architecture. Stack : Python, Django, MySQL, FastAPI, PostgreSQL, Celery, RabbitMQ, Redis, Docker,
  Kubernetes.
  • Integrate API schema test to ensure service API contract reliability. Stack : Python, FastAPI, PostgreSQL, Celery, RabbitMQ, Redis, Docker, Kubernetes, CircleCI, mergify, ArgoCD.
  • Lead technical initiative error management to reduce error noise which allows team to identify problem quickly. Stack : Python, Django, FastAPI, MySQL, PostgreSQL, Datadog, Sentry.
  • Lead technical initiative incident detection to reduce the on-call. Stack : Python, Django, FastAPI, MySQL, PostgreSQL, Datadog, Sentry.
  • Improve observability metrics. Stack : Python, Terraform, Datadog, Sentry.
  • Launch load test to identify bottleneck in order to improve performance. Stack : Python, FastAPI, PostgreSQL, Redis.
  • Contribute new marketplace opening. Stack : Python, FastAPI, Kubernetes, Terraform.
  • Knowledge sharing presentation to the team.
  • Participate A/B testing design.
  • Write architecture, feature design and issue analysis documents.
  • Working closely with product manager to have a business related vision to make functionality decision.

• Software Engineer - Project Team Lead.

  Talend, Suresnes
  Jan 2019 - aujourd'hui

  As an enginner in Talend product team, I design and deliver new features to enrich our product. As a part of processing platform team, I design and deliver scalable solution to process important volume of data.
  • Lead frontend and backend team to deliver a new feature context variable which allows user to add values and apply them within a pipeline at processing runtime within Talend Pipeline Designer. Stack : Scala, Akka, Play2, Apache Kafka, Apache Livy, SBT, Jenkins.
  • Optimize Databricks staging time to reduce a talend pipeline execution runtime and develop a new feature to support talend pipeline execution running in Databricks 5.5LTS. Stack : Scala, Apache Livy, Shell script, Docker, Databricks, Flux, Maven, Jenkins.
  • Develop a custom component capable of stream processing in Talend Pipeline Designer. Stack : Apache Beam, Java 8, Maven, Jenkins.
  • Deliver a job queue to handle different pipeline execution priority in processing engine and control job flow to not saturate processing engine. Stack : Scala, Akka, Play2, SBT, Jenkins.
  • Lead frontend and backend team to develop a new feature to allow UI to display processing engine capacity in Talend Pipeline Designer. Stack : Scala, Akka, Play2, Apache Kafka, Apache Livy, SBT, Jenkins.
  • Develop and define application metrics in Talend Pipeline designer to create metric dashboard for product managers. Stack : Scala, Akka, Play2, Kamon, Prometheus, Grafana, SBT, Jenkins.
  • Lead team to design and deliver a new scalable data processing architecture to process pipeline executions, not only leverage Kubernetes to scale processing platform, but also optimize resources usage. Stack : Scala, Apache Livy, HashiCorp Vault, Helm Charts, Flux, Maven, Jenkins.
  • Designed a multi-user processing platform architecture on top of my previous accomplishment of scalable data processing architecture to share compute engine resources for all users. Stack : Scala, Apache Livy, HashiCorp Vault, Helm Charts, Flux, Maven, Jenkins.
  • Automate Talend Livy and live Preview services performance testing for each Github pull request merge in order to deliver high quality services. Stack : Python3, Groovy, Helm Charts, Flux, Jenkins.
  • Drive new features demostrations and presenting new architectures to internal stakeholders.
  • Write architecture and feature design document.
  • Mentor junior software engineers by providing them best practices and knowledge. Ramp up new software engineers with pair programming.
  • Working closely with product managers to have a better product vision in order to help team make right architecture decision.
  • Propose to develop a job launcher to replace Apache Livy in company hackthon aim to simplify technology.

• Tech Lead - Data Engineering.

  Société Générale, Val de Fonteney,
  Jan 2018 - Jan 2019

  As a part of data engineering team, I deliver high quality data processing pipelines.
  I design new API to expose transformed data.
  • Lead data enginner team to deliver bank’s transactions processing pipeline in
  Datalake in order to provide business usage. Stack : Spark, Scala, Hortonworks,
  Apache Oozie, Apache Hive, Shell script.
  • Pilot coninuous integretion and continuous delivery project to automate production deployment transformation. Stack : Jenkins, Python, Ansible, Nexus artifactory.
  • Design new API to provide business user to request humain resource data. Stack : Scala, Akka HTTP, SpringBoot, PostgreSQL, Docker.
  • Working closely with business departement and security departement to drive and design data anonymization in order to adapt GDPR.
  • Host pair programming in order to improve skills and to onboard new data engineers.
  • Lead demostration and presentation to different business departements.
  • Participate interview, Hiring process to valid candidate’s technical skills, evaluate his/her behavior fit to the job.
  • Represent team to participate tech lead community in order to share knowledge, identify the issues, unblock the roadblocks.
  • Document API.

• Software Engineer.

  NeoXam, Paris
  Jan 2016 - Jan 2018

  As a developer in feature team, I develop different financial risk indicators calculation and reporting tool.
  • Develop risk indicators calculation to display in the reporting tools. Stack : Java 8, Scala, SBT, PostgreSQL.
  • Develop batch calculation in order to process historical data. Stack : Java 8, Scala, SBT, PostgreSQL.
  • Optimize algorithm to reduce calculation time.
  • Maintain the reporting tool.

• Junior Software Engineer.

  Guangzhou Factory of Metal Product China
  Jan 2012 - Jan 2013

  As a developer in ERP team, I develop new feature for internal ERP system.
  • Develop a client registry system to facilitate business user to record client information.
  Stack : C, .NET, SQL Server.
  • Deliver new feature exportation data to excel file. Stack : C, .NET, SQL Server.

• Junior Software Engineer.

  Zhejiang Topcheer Information Technology Co.,Ltd, Feb. 2011 - Feb. 2012, Hangzhou, China,
  Jan 2011 - Jan 2012

  As a developer in tax management team, I develop new feature for government tax system.
  • Develop new feature which allows user to interact interface in order to fill client’s information .Stack : JAVA, J2EE, Oracle.
  • Develop tax automate calculation after filling client’s information .Stack : JAVA, J2EE, Oracle.
  • Do the demostration to civil servants in order to transform information system.