Data Engineering Team Lead / Architect

Описание

Alexander Kochurin – Solution Architect / Tech lead / Lead Software Engineer

Contacts

email: alexander.kochurin@gmail.com  

Telegram: @alexandercoffee

Phone: +7-965-816-34-13

Skype: darkengiller

Summary

* Proven IT professional with 10+ years of experience

* Has strong experience leading software development teams

* Strong knowledge of Java and Multithreading and java libraries

* Knowledge and experience of Python

* Has experience with Cloud

Azure: HDInsight, Databricks, EventHub, KeyVault, Blob Stograge, Azure Table API, MS queue, Kubernetes, Docker, Redis

GCP: Kubernetes, BigQuery, PubSub, GCP Storage

* Has experience with Big Data technologies: Hadoop, HDFS, MapReduce, Hive, Storm, Spark, Kafka

* Has experience with Data Bases: PostgreSQL, MySQL

* Knowledge of Aglie and Waterfall

* Has experience working in multinational and distributed teams

* Comfortable working alone and within a team

Skilled in Scrum, Java Programming Languages, Core Java Development, Gitflow, Asynchronous programming and multithreading, Cluster computing & Multithreading, Kanban, Data Solution Architecture, Cloud, Ingestion Pipelines

Skills

Work experience

Mar-2022 - Till now (Aug-2023) - Lead Software Engineer, EPAM Systems

Customer: EPAM Systems, Inc

Customer Description: Software & Hi-Tech

EPAM Project Description: Design, build and deliver components for AI Data Platform

Team Size: Dev Team: 1 - 3

DevOps team: 1 -3

Delivery Manager: 1

Architect: 1 - 3

Project Roles: Key Developer

Responsibilities:

• General implementation different kind of services
• MVP
• Architecture improvements and discussion

Tools and Technologies: GCP Big Query, GCP, Big Query, Pub/Sub, Kubernetes, Prometheus + Alert manager + push gate way, Grafana

Mar-2021 - Jan-2022 – Tech Lead / Lead Software Engineer, EPAM Systems, https://www.epam.com/

Customer: AS Watson

Customer Description: Retail & Distribution

EPAM Project Description: Data Enablement Accelerator to enable applications access to the AS Watson Enterprise Data Platform

Team Size: Dev Team:  3 - 5

DevOps team: 3 - 5

Delivery Manager: 1

Architect: 1

Project Roles: Architect / Tech Lead / Development Team Lead

Responsibilities:

• * Implementation / support custom tool for ML
• * Implementation / support custom tool for calculation tree of ETL parts
• * Used Jenkins and gradle for CI
• * Coordination development activities within the team
• * Communication with product owner and architects
• * Reported team progress to delivery manager and customer

Tools and Technologies: MS SQL, PostgreSql, Java 8, Python 2 and 3, Scala, Azure cloud, Gradle, HDInsight, Databricks, Hive, Spark, Spring, Airflow, ML, Custom tool for calculation tree of ETL parts

Sep-2017 - Feb-2021 - Lead Software Engineer / Delivery manager, EPAM 

Customer: Tengiz-Chevroil

Project Description: TCO TOP management requested to look at the data of vehicle management system, 5000 trucks which are equipped with GPS systems recording speed, acceleration, break roughly, time etc. And they want to Analyze the data in terms of how injury risk can be decreased, (find hot spots, change the route etc.)

Team Size: 5 Developers

2 QA

1 DevOps

Project Roles: Development Team Lead / Architect

Responsibilities:

• involved in design, build, and deployment of new systems
• works with the Project Manager to assess goals
• interpret client requests and construct a plan for meeting deadlines

Tools and Technologies: MS SQL, Java 8, Scala, Azure Cloud, Maven, GIT, MS Azure, Apache AirFlow

May-2017 - Feb-2021 - Lead Big Data Developer, EPAM, www.epam.com

Customer: EPAM

Project Description: EPMC-BDCC, The goal of the project is to build an analytical platform for eCommerce platform that can boost sales based on analyzing users behavior and doing automatic items promotion in the advertisement networks. To achieve that, user's behavior can be used to generate appropriate recommendations or even bargain a price (dynamic pricing). Also, all users are tagged by the system and then these tags are linked to the most efficient keywords for product advertisements which increase a targeting quality of campaigns. The system was deployed on HDP cluster

Team Size: 2 Architects, 20 developers, 10 QA, 2 DevOps

Project Roles: Lead Big Data Developer

Responsibilities:

• * Implemented analisys of data stored in HDFS with HIVE and MapReduce on Java
• * Implemented real time data pipeline with Spark and Spark SQL using Scala and Kafka
• * Used Jenkins and Maven for CI
• * Coordinated development activities within the team i lead
• * Communicated with product owner and architects
• * Reported team progress to delivery manager

Tools and Technologies: Hive, Git, Maven, Jenkins, Java 8, Hive, HDFS, MapReduce, Spark, Scala, Kafka, AirFlow

Aug-2017 - Aug-2017 - Key Developer , EPAM Systems

Customer: Ernst & Young

Customer Description: E&Y

EPAM Project Description: EYC-6X2

Team Size: Dev \ DevOps: ~7+

Architect: 2

PM: 1

Project Roles: Key Developer

Responsibilities:

• involved in design, build, and deployment of new systems
• works with the Project Manager to assess goals
• interpret client requests and construct a plan for meeting deadlines

Tools and Technologies: Hive, Java 8, Maven, GIT, Intellij Idea, HDP (Spark, Hive), ETL

Jul-2017 - Aug-2017 - Key Developer, EPAM Systems

Customer: VTB

Customer Description: VTB

EPAM Project Description: VTB-DBO

Team Size: Dev / DevOps: ~ 10+

Architect: 1

PM: 1

Project Roles: Key Developer

Responsibilities:

• involved in design, build, and deployment of new systems
• works with the Project Manager to assess goals
• interpret client requests and construct a plan for meeting deadlines

Tools and Technologies: Maven, GIT, Intellij idea IDE, JIRA, Java EE, ML

Oct-2016 - May-2017 - Java Team Lead / Group Manager, Luxoft 

Customer: DB

Project Description: Business Sector: Banks and credit

High load system

Team Size: Dev: 4 members

QA auto: 1 member

QA manual: 1 member

Analyst: 1 member

Project Roles: Java Team lead, SCRUM master

Responsibilities:

• Product development
• Analyse, decompose and assign tasks
• Plan, estimate activities
• Status monitoring and reporting
• Requirement analysis, solution prototyping
• Dealing with and resolving problems and issues which arise
• Motivating the team to achieve high results
• Involved in the recruitment of new staff
• Plan, estimate, coordinate and conduct software engineering activities

Tools and Technologies: Mark Logic, Intelij idea, mvn, SCRUM, Agile, Maven, GIT, Java 8, JIRA, Apache Storm, Multi-threading, XML/XSD, TeamCity

May-2016 - Sep-2016 - Senior Java Developer, Luxoft

Customer: DB

Project Description: Business Sector: Banks and credit

High load system

Team Size: Dev: 4 members

QA auto: 1-2 member

QA manual: 1-2 member

Analyst: 1-2 member

Project Roles: Developer, SCRUM master, QA

Responsibilities:

• Product development
• Analyse and decompose tasks
• Plan, estimate activities
• Status monitoring and reporting
• Requirement analysis, solution prototyping
• Dealing with and resolving problems and issues which arise

Tools and Technologies: Mark Logic, Intellij Idea, mvn, SCRUM, Maven, GIT, Java 8, JIRA, Apache Storm, Multi-threading, XML/XSD, TeamCity

Sep-2011 - Apr-2016 - Senior java developer, Close Joint-Stockcompany "S&TC "RADAR" - "SPB CGT"

Customer: CSRI EISU, FGUP

Project Description: Custom software development

Based on Eclipse platform

GIS oriented project(s)

Custom map layer with own formats, interactive objects and tools for managing them

Team Size: Dev team: 6-10  members

QA team: 1 - 3 members

Analyst team: 1 - 4 members

Project Roles: Developer, Architect, Tech Consultant

Responsibilities:

• Designed high level and low level diagramms (UML)
• Developed end-to-end process
• Prototyped new solutions

Tools and Technologies: Postgre SQL, Eclipse IDE, Ant, Intellij Idea, jMeter, ArcGIS, Eclipse platform, Eclipse rcp, Java 6,7,8, Multi-threading, Ant, RedMine, Hudson, jMetter, XSD/XML, Swing, JFace

Mar-2011 - Sep-2011 - Java developer, CSRI EISU, FGUP

Customer: CSRI EISU, FGUP

Project Description: Custom software development

Team Size: Dev team: 7 members

Project Roles: Java developer

Responsibilities:

• Developed submodules with string comparison algorithms and xml data analyzing

Tools and Technologies: SQL, Eclipse IDE, ant, mvn, ant, mvn, Eclipse platform, Eclipse RCP, Java 6

Mar-2008 - Jan-2009 - System administrator, Rosselhoznadzor Managment

Customer: Rosselhoznadzor Managment

Project Description: Network assembling. Support

- PC hardware and software support

- Website development

Team Size: Anykey team (2 members)

Project Roles: System administrator

Responsibilities:

• Developed/supported end-to-end process regarding website
• Tech support for users

Tools and Technologies: MySql, Zend studio, Php, Apache tomcat, MySql