About Me
I am a Ph.D. student at the IT University of Copenhagen (ITU), Denmark. My research focuses on resource-aware data systems, developing mechanisms for improving the efficiency of the hardware resources for machine learning workloads, specially deep learning training tasks.
I acquired my master's degree in computer architecture from the Sharif University of Technology (SUT), Tehran, Iran. During my master's, I worked on improving the GPU energy-efficiency by redesigning their on-chip memories in microarchitectural level.
My primary field of interest is computer organization, system and architecture, particularly GPUs, parallel computing systems, energy-efficient designs, and heterogeneous systems.
My resume can be downloaded from here.
Education
Ph.D.
IT University of Copenhagen
Copenhagen, Denmark
November 2021 - Present
Currently, I am a Ph.D. student working on resource-aware data systems under prof. Pınar Tözün's supervison. The focus is on developing mechanisms for higher utilization and efficiency of underlying hardware infrastructures for data science, especially for deep learning applications.
Current ECTS requirements: 25/30
M.Sc.
Sharif University of Technology
Tehran, Iran
September 2016 - September 2018
Working under the supervision of prof. Hamid Sarbazi-Azad, my research's focus was to introduce an energy efficeint on-chip memories design with negligible performance overhead for GPUs. I experienced working with GPGPU-sim, and further developed c and Python codes for evaluation goals.
GPA: 17.20/ 20
B.Sc.
University of Tabriz
Tabriz, Iran
September 2012 - June 2016
During my bachelor's, my focus was on learning and understanding the basics of computer science through taking courses and conducting extensive self-study.
GPA: 18.42/ 20
Skill Set
Programming
Intel x86 and MIPS Assembly C/C++ CUDA Java Python MATLAB HTML CSS PHP
Frameworks
Keras PyTorch TensorFlow Laravel
Simulation Experience
Altera Quartus II Mentor Modelsim Proteus Design Suite GPGPU-Sim
HDLs
Verilog
Honors and Rewards
Sharif University of Technology
Tehran, Iran
September 2016 - September 2018
Admitted to the M.Sc. program at Sharif University of Technology as an Exceptional Talented Student.
University of Tabriz
Tabriz, Iran
September 2012 - June 2016
Ranked 1st in terms of cumulative GPA (18.42) among 50 Computer Hardware Engineering Students.
Projects
⬗ OSM: Off-chip Shared Memory for GPUs
– Contribution to the design and implementation of a innovative on-chip memory handling both the shared memory and L1 data cache accesses. First, Shared memory accesses got logged, which were generated within the GPGPU-Sim simulator, and then studied their locality, liveness, and read-after-write frequency charactersitics. Finally, based on the observations, the proposed mechanism was implemented by changing the source code of GPGPU-Sim simulator. The project resulted in an publication that can be accessed here.
⬗ Cache with different configs
– Implementation of direct-mapped and set-associative caches. The goal was experimenting with different replacement policies and their effect on hit/ miss rate. It can be accessed here.
⬗ Morris Mano's book basic computer
– Implementation of Mano's basic computer in Verilog HDL. It can be accessed here.
⬗ Knowledge dissimenation projects
– As one of my hobbies, I work on design and developing high quality tutorials for those who want to learn fast and easily. You can check them out on my GitHub, my Medium, and my YouTube pages.
⬗ Web Development Projects
– Experience of being a part of two web development teams as a back-end developer. My tasks were mainly about developing queries for feeding the UI forms with correct data. In addition, I experienced developing APIs for sending data in JSON format. URL Shortener API in Go programming language
⬗ Automizing an archiving system and multiple other processes in Microsoft Office with VB
– Design, implementation of an efficient archiving system in Excel with VBA regarding the documents type and their transactions.
Talks and presentations
⬗ Profiling and Monitoring Deep Learning Training Tasks
Workshop: The 3rd Workshop on Machine Learning and Systems (EuroMLSys) - May 2023
– This #presentation was prepared for the accepted paper to the EuroMLSys workshop. The #poster version of the presentation can be accessed here.
⬗ Orchestration of Deep Learning Tasks on CPU-GPU Co-Processors for Multi-Tenant Settings
Workshop: EuroSys Doctoral Workshop 2023 (EuroDW '23) - May 2023
– The #presentation and the #poster were prepared for the accepted paper to the EuroDW workshop.
⬗ Overprovisioning GPUs in the age of AI
Courses: Large Scale Data Analysis - November 2022
– This #lecture was prepared for computer science master students at the ITU. It reviews machine learning, deep learning and GPUs as the primary general-purpose processors for deep learning training tasks, then the underuitlizatoin challenge of GPUs is discussed and three potential solutions of workload collocation for Nvidia GPUs (multi-stream, MPS, MIG) are discussed.
⬗ Processors
Courses: Large Scale Data Analysis - April 2022/ Big Data Management - November 2022
– This #lecture was prepared for data science bachelor students at the ITU. It reviews computing, processor, transformation hierarchy, tradeoffs of different processors, CPU (simple in-order processor, cache hierarchy, pipelining), GPU, FPGA, ASIC accelerator. A recorded version of the talk can be accessed here.
⬗ GPU Efficiency throguh Intelligent Collocation
6th International Summer School on Resource-Aware Machine Learning (REAML 2022) - September 2022
This #poster was prepared for presenting the undergoing work in the students' corner of the TU Dortmund's summer school. It discusses the underutilization problem of GPUs, especially for deep learning training tasks, the causes of the problem, available collocation options and their performance comparison, and finally next steps.
Teaching and Supervision Experience
IT University of Copenhagen
Supervising experiences
- "Intelligent GPU Utilization Estimation", master level, (Fall 2020, Spring 2023), co-supervised with prof. Pınar Tözün
Teaching and teaching assistant experiences
- "Advanced Data Intensive Systems", master level, Fall 2022, teacher: prof. Pınar Tözün
- "Deep Learning: A Computational Efficiency Perspective", Ph.D. and master's level, (Spring 2022), teacher: prof. Pınar Tözün
★ ★ ★
Sharif University of Technology
Teaching and teaching assistant experiences
- "Microprocessor lab", bachelor level, (Spring 2018, Summer 2018), supervisor: prof. Amir-Hossein Jahangir
- "Computer architecture lab", bachelor level, (Spring 2018, Summer 2018), supervisor: prof. Amir-Hossein Jahangir
- "Computer architecture", bachelor level, (Spring 2018), teacher: prof. Amir-Hossein Jahangir
- "Microprocessor lab", bachelor level, (Fall 2017), supervisor: prof. Hamid Sarbazi-Azad
- "Computer architecture lab", bachelor level, (Summer 2017), supervisor: prof. Hamid Sarbazi-Azad
★ ★ ★
University of Tabriz
Teaching assistant experiences
- "Logic Circuit Design", bachelor level, (Spring 2016), teacher: prof. Mina Zolfy
★ ★ ★
Tutoring experineces
- "Fundamentals of Programming with C", bachelor level, (Spring 2018, Summer 2018)
Language Skills
- English, Fluent (TOEFL July 2021 (100/120))
- Azarbayjani Mother tongue
- Persian (Farsi) Native
- Turkish Intermediate
- DanishElementary
My Interests
⬗ Self-Learning
– I enjoy learning and developing new skills. This helps me to feel more confident and better about myself and my life. In my free time, I enjoy watching tutorial videos and reading good books.
⬗ Reading
– I cannot get enough of reading novels. My favorite authors are Anton Chekhov, Fyodor Dostoevsky, Mitch Albom, Orhan Pamuk, George Orwell, Albert Camus, and Abbas Maroufi. Some of the books that I liked them:
– The Red-Haired Woman, by Orhan Pamuk
– Nineteen Eighty-Four (1984), by George Orwell
– Animal Farms, by George Orwell
– The Duel, by Anton Chekhov
– Three Years, by Anton Chekhov
– The Huntsman, by Anton Chekhov
– The Gambler, by Fyodor Dostoevsky
– White Nights, by Fyodor Dostoevsky
– Symphony of the Dead, by Abbas Maroufi
– The Five People You meet in Heaven, by Mitch Albom
– Tuesdays with Morrie, by Mitch Albom
– For one day more, by Mitch Albom
– The Stranger, by Albert Camus
– The Comfort Book, by Matt Haig