cv

Here is my CV. You can download a pdf version at the right.

Basics

Name Egor Petrov
Label PhD Student in Computer Science, Columbia University
Email edprussia@gmail.com
Url https://moderntalker.github.io
Summary PhD student at Columbia University (DAP Lab), advised by Eugene Wu and Kostis Kaffes. Research on efficient large-scale LLM training: pretraining and post-training, parallelisms, optimization, and scaling laws.

Work

  • 2026.09 - Present

    New York, NY

    PhD Researcher, Post-Training Efficiency
    DAP Lab, Columbia University
    Advised by Eugene Wu and Kostis Kaffes.
    • Studying optimization dynamics in RL post-training (RLVR): benchmarking optimizer behavior and loss-landscape changes relative to pretraining, and their effect on downstream tasks.
    • Developing staleness-mitigation methods for asynchronous post-training with parallel rollout generation, co-designing algorithms and systems to maximize GPU throughput.
  • 2025.07 - 2026.08

    Moscow

    ML Researcher, Pretraining
    Yandex Research
    • Led research on asynchronous pipeline parallelism for efficient large-scale LLM pretraining; first-author paper accepted to ICML 2026.
    • Designed and analyzed novel algorithms for distributed training systems, improving scalability and hardware utilization.
  • 2025.01 - 2026.06

    Moscow

    Teaching Assistant
    Central University
    Introduction to AI, Scientific Studio, Python for Data Analysis.
    • Held consultations, graded assignments, and mentored student research projects.
  • 2024.09 - 2025.06

    Moscow

    Teaching Assistant
    Moscow Institute of Physics and Technology (MIPT)
    Algorithms and Data Structures.
    • Held consultations and graded assignments for the Department of Algorithms and Programming Technologies.
  • 2024.08 - 2025.01

    Moscow

    ML Engineer, Personalization Quality R&D Group
    Yandex
    • Engineered a production pipeline integrating Vowpal Wabbit-based online features into a large-scale CatBoost model, achieving a 0.1% uplift in core ranking metrics (AUC, nDCG).
    • Implemented a parallelized, MapReduce-style data converter that accelerated data processing by 20x, reducing model training time from hours to minutes.
  • 2024.02 - 2026.08

    Moscow

    ML Researcher
    Basic Research in AI Laboratory (BRAIn Lab)
    • Pioneered memory-efficient zeroth-order optimization methods for LLM fine-tuning, achieving a 50% reduction in memory footprint (ICML Workshop 2025).
    • Developed and theoretically analyzed novel stochastic and zeroth-order algorithms for decentralized optimization, validated across multiple domains (UAI 2025, ICLR 2026).
    • Derived a full second-order (Hessian) characterization of the Transformer block with implications for scaling laws.

Education

  • 2026.09 - 2031.05

    New York, NY

    PhD
    Columbia University
    Computer Science
    • SEAS Graduate Student Fellowship.
    • Expected graduation: May 2031.
  • 2022.09 - 2026.06

    Moscow

    B.S.
    Moscow Institute of Physics and Technology (MIPT)
    Applied Mathematics and Physics
    • Data Science Track (MIPT & Yandex School of Data Analysis).
    • ML, DL, RL, CV, NLP, RecSys, Bayesian Statistics, Time Series.

Awards

Publications

Skills

Programming
Python
C++
SQL
ML / DL
PyTorch
Transformers (HF)
NumPy
Pandas
Scikit-learn
TensorFlow
Distributed Training
Data / tensor / pipeline / sequence / expert parallelism
FSDP-style sharding
Memory-efficient optimizers
Tools & Infrastructure
Git
Docker
Apache Hadoop
Kafka
Airflow
Vowpal Wabbit
CMake

Languages

Russian
Native speaker
English
Fluent (TOEFL 102)

Interests

Efficient Large-Scale LLM Training
Pretraining
Post-training
Parallelisms
Scaling laws
Optimization
Optimizer design
Memory-efficient and zeroth-order methods
Loss landscapes
Algorithm-Systems Co-Design
Asynchronous pipeline parallelism
RL post-training (RLVR)
GPU throughput

Projects

  • 2025.01 - Present
    ZO-Library, Lead Developer
    Open-source library of state-of-the-art zeroth-order optimization algorithms with a torch.optim-style API, enabling memory-efficient fine-tuning with up to 50% memory reduction.
    • Related paper: Leveraging Coordinate Momentum in SignSGD and Muon (ICML Workshop on Tiny Titans, 2025).
  • 2024.01 - Present
    Aboba, Maintainer
    Python library for A/B testing: statistical tests plus CUPED and linearization via an intuitive API.
  • - Present
    Rethinking Memory-Efficient Optimizers for LLM Pre-Training
    Systematic study of structured optimizer-state compression vs. state quantization under matched memory budgets; peak-memory and communication analysis of optimizer states under sharding (FSDP-style).
    • In submission to ICLR 2027.
  • - Present
    Hyperparameter Transfer and Scaling Laws for Asynchronous Pretraining
    Theoretical and practical transfer rules (learning rate, momentum, batch size, weight decay) and scaling laws in models and tokens for asynchronous pipeline-parallel training; extends our ICML 2026 results.
    • Experiments in progress.
  • - Present
    Optimization in RL Post-Training (RLVR)
    Benchmarking optimizer behavior, loss-landscape changes, and downstream-task effects when moving from pretraining to RL post-training.
    • Early stage.
  • - Present
    Asynchronous Post-Training
    Mitigating policy staleness from parallel rollout generation; algorithm-systems co-design for maximizing GPU throughput in RL post-training.
    • Early stage.