Tools: Spark, Hive, Trino (Presto), Cascading, Python, Scala, Java, Airflow, Superset

• Receive Pinterest Data Engineering Awards 2022 for automating migration processes for entire global engineering department
• Migrate and optimize 6k+ data jobs from Hive to Spark to reduce the runtime of data workflows by a factor of 2, and reduce compute cost by $4 million dollars/year
• Lead 3 company-wide data education sessions with the developer community to share data processing best practices and optimizing Spark jobs with 15-48 attendees visiting each session
• Developed a workflow scheduling platform used for large data validation pipelines using Java Fork Join Pool framework. It outperformed Airflow and allowed reducing the scheduling time of select workflows from 5 hours to 15 minutes, accelerating the development process for data engineers
• Implemented data-anomaly detection framework used for validation during rewriting a number of data workflows and during migrating services from Ruby to Java
• Initiated development program for internal/external hires by creating relevant coursework and projects to upskill individuals interested in data engineering, Java or Python. 20 new employees went through this educational program

Tools: Hive, Impala, MapR, Cloudera, HBase, PostgreSQL, GreenPlum, Redis, Java 8, Ruby, Python, Ansible

• Built a secure cluster configuration vault using JCA (AES). The solution allowed company to fulfill its GDPR obligations and allowed usage of the product in European market
• Developed an automation tool to migrate installation scripts from in-house solution to Ansible allowing to reduce the scope of the project from 18 to 6 months
• Migrated data analytics jobs from Oracle, PostgreSQL and GreenPlum to Hadoop stack (Hive, Tez, Impala) unblocking release of the product

Tools: Java 8, Java 11, Spring, Spring MVC, Hibernate, PostgreSQL, Lucene, Elasticsearch, Logstash

• Created ecommerce project from zero to fully developed functional product, with 1,000 MAU
• Management:
  • Technical team of two engineers and one designer;
  • Creative team of one marketing specialist and four content creators;
  • Logistic and supply chain: working with overseas partners to select, package and ship produce;
  • Distribution: warehousing and delivery;

Clients: Lubkin Consulting LLC, Helen-Marlen, Chasopys

Tools: Java, JavaFX, Spring, Hibernate, Android, iOS, PostgreSQL, Lucene, JS, HL7

• Managed a team that successfully developed a CRM and client web portal for one of the clinics in NY driving digital transformation of client operations
• Created an “Uber for clinics” iOS and Android mobile application for the US market
• Developed interactive display application for Mercedes-Benz Fashion Week contest for 15k users
• Implemented a time-based ticketing system, CRM tool, financial reporting, marketing tools for the coworking space using JavaFX, Spring, Hibernate, serving 700k visitors over the next 9 years

Tools: Java, Swing, Hibernate, Spring, HtmlUnit, Selenium, Ruby

• Accelerated marketing department efficiency by developing a tool to manage and automate user social media and web 2.0 campaigns