Kseniia Samarina

Worked at Russian social network Odnoklassniki. • Created Data Detail Store for video events log data and migrated about 10 data pipelines to this data source; • Wrote more than 15 complex ETL-pipelines with custom transformations using Apache Spark's Java API; • Integrated with several data sources: MySQL, ClickHouse, hdfs; • Researched and verified data with Spark SQL and DataFrame API using Apache Zeppelin. Technologies: Java, Apache Spark, hdfs, hive, ClickHouse, Apache Zeppelin.

Worked on Traffic Analytics: tool to benchmark your website traffic against competitors. • Migrated Scala written clickstream data parser into Java using Apache Spark’s Java API. • Performed clickstream data validation with analytical metrics calculation and statistical hypothesis testing in Jupyter Lab. • Created about 5 new ETL-pipelines in Python with Luigi. Technologies: Python, Java, Apache Spark, ClickHouse, numpy, pandas, GCP.

Worked at huge Fintech project. • Created BI-reports using Tableau. Reduced reports rendering time from minutes to seconds; • Developed new Data Marts with Apache Airflow using multiple data sources: Vertica, PostgreSQL, ClickHouse; • Wrote and optimized complex analytical SQL queries; • Performed data preprocessing and statistical hypothesis testing in Jupyter Lab with Python packages: numpy, pandas, statsmodels. Technologies: Python, SQL, Apache Airflow, Tableau, Vertica, PostgreSQL, ClickHouse.