CV SCALA : Recherchez votre intervenant freelance

Aperçu des missions de Daniel/Xu,
freelance SCALA habitant les Hauts-de-Seine (92)

EXPERIENCE

Back Market, Paris, Since Oct. 2022,
Senior Software Engineer.
As an engineer in Back market product team, the goal is to provide the best offer to customer from merchants. I participate to transform monolithic architecture tomicroservice, improve service quality and performance, lead technical initiatives and contribute new marketplace opening.
• Transform and rollout use cases to microservice architecture. Stack : Python, Django, MySQL, FastAPI, PostgreSQL, Celery, RabbitMQ, Redis, Docker,
Kubernetes.
• Integrate API schema test to ensure service API contract reliability. Stack : Python, FastAPI, PostgreSQL, Celery, RabbitMQ, Redis, Docker, Kubernetes, CircleCI, mergify, ArgoCD.
• Lead technical initiative error management to reduce error noise which allows team to identify problem quickly. Stack : Python, Django, FastAPI, MySQL, PostgreSQL, Datadog, Sentry.
• Lead technical initiative incident detection to reduce the on-call. Stack : Python, Django, FastAPI, MySQL, PostgreSQL, Datadog, Sentry.
• Improve observability metrics. Stack : Python, Terraform, Datadog, Sentry.
• Launch load test to identify bottleneck in order to improve performance. Stack : Python, FastAPI, PostgreSQL, Redis.
• Contribute new marketplace opening. Stack : Python, FastAPI, Kubernetes, Terraform.
• Knowledge sharing presentation to the team.
• Participate A/B testing design.
• Write architecture, feature design and issue analysis documents.
• Working closely with product manager to have a business related vision to make functionality decision.

Talend, Suresnes, Since Oct. 2019,
Software Engineer - Project Team Lead.
As an enginner in Talend product team, I design and deliver new features to enrich our product. As a part of processing platform team, I design and deliver scalable solution to process important volume of data.
• Lead frontend and backend team to deliver a new feature context variable which allows user to add values and apply them within a pipeline at processing runtime within Talend Pipeline Designer. Stack : Scala, Akka, Play2, Apache Kafka, Apache Livy, SBT, Jenkins.
• Optimize Databricks staging time to reduce a talend pipeline execution runtime and develop a new feature to support talend pipeline execution running in Databricks 5.5LTS. Stack : Scala, Apache Livy, Shell script, Docker, Databricks, Flux, Maven, Jenkins.
• Develop a custom component capable of stream processing in Talend Pipeline Designer. Stack : Apache Beam, Java 8, Maven, Jenkins.
• Deliver a job queue to handle different pipeline execution priority in processing engine and control job flow to not saturate processing engine. Stack : Scala, Akka, Play2, SBT, Jenkins.
• Lead frontend and backend team to develop a new feature to allow UI to display processing engine capacity in Talend Pipeline Designer. Stack : Scala, Akka, Play2, Apache Kafka, Apache Livy, SBT, Jenkins.
• Develop and define application metrics in Talend Pipeline designer to create metric dashboard for product managers. Stack : Scala, Akka, Play2, Kamon, Prometheus, Grafana, SBT, Jenkins.
• Lead team to design and deliver a new scalable data processing architecture to process pipeline executions, not only leverage Kubernetes to scale processing platform, but also optimize resources usage. Stack : Scala, Apache Livy, HashiCorp Vault, Helm Charts, Flux, Maven, Jenkins.
• Designed a multi-user processing platform architecture on top of my previous accomplishment of scalable data processing architecture to share compute engine resources for all users. Stack : Scala, Apache Livy, HashiCorp Vault, Helm Charts, Flux, Maven, Jenkins.
• Automate Talend Livy and live Preview services performance testing for each Github pull request merge in order to deliver high quality services. Stack : Python3, Groovy, Helm Charts, Flux, Jenkins.
• Drive new features demostrations and presenting new architectures to internal stakeholders.
• Write architecture and feature design document.
• Mentor junior software engineers by providing them best practices and knowledge. Ramp up new software engineers with pair programming.
• Working closely with product managers to have a better product vision in order to help team make right architecture decision.
• Propose to develop a job launcher to replace Apache Livy in company hackthon aim to simplify technology.

Société Générale, Val de Fonteney, Apr. 2018 - Oct. 2019,
Tech Lead - Data Engineering.
As a part of data engineering team, I deliver high quality data processing pipelines.
I design new API to expose transformed data.
• Lead data enginner team to deliver bank’s transactions processing pipeline in
Datalake in order to provide business usage. Stack : Spark, Scala, Hortonworks,
Apache Oozie, Apache Hive, Shell script.
• Pilot coninuous integretion and continuous delivery project to automate production deployment transformation. Stack : Jenkins, Python, Ansible, Nexus artifactory.
• Design new API to provide business user to request humain resource data. Stack : Scala, Akka HTTP, SpringBoot, PostgreSQL, Docker.
• Working closely with business departement and security departement to drive and design data anonymization in order to adapt GDPR.
• Host pair programming in order to improve skills and to onboard new data engineers.
• Lead demostration and presentation to different business departements.
• Participate interview, Hiring process to valid candidate’s technical skills, evaluate his/her behavior fit to the job.
• Represent team to participate tech lead community in order to share knowledge, identify the issues, unblock the roadblocks.
• Document API.

NeoXam, Paris, Apr. 2016 - Feb. 2018,
Software Engineer.
As a developer in feature team, I develop different financial risk indicators calculation and reporting tool.
• Develop risk indicators calculation to display in the reporting tools. Stack : Java 8, Scala, SBT, PostgreSQL.
• Develop batch calculation in order to process historical data. Stack : Java 8, Scala, SBT, PostgreSQL.
• Optimize algorithm to reduce calculation time.
• Maintain the reporting tool.

Guangzhou Factory of Metal Product, Sep. 2012 - Apr. 2013, Guangzhou, China,
Junior Software Engineer.
As a developer in ERP team, I develop new feature for internal ERP system.
• Develop a client registry system to facilitate business user to record client information.
Stack : C, .NET, SQL Server.
• Deliver new feature exportation data to excel file. Stack : C, .NET, SQL Server.

Zhejiang Topcheer Information Technology Co.,Ltd, Feb. 2011 - Feb. 2012, Hangzhou, China,
Junior Software Engineer.
As a developer in tax management team, I develop new feature for government tax system.
• Develop new feature which allows user to interact interface in order to fill client’s information .Stack : JAVA, J2EE, Oracle.
• Develop tax automate calculation after filling client’s information .Stack : JAVA, J2EE, Oracle.
• Do the demostration to civil servants in order to transform information system.