Hpc

Note to reader I do not include large code snippets as this was an assignment for my parallel computing course at Northwestern and I don’t want future students copying it. It exists in a private repo of mine containing my school assignments. I will try to do my best to illustrate the work I did with fewer code examples Github Link Private url Overview This project parallelizes a contrast stretching algorithm using MPI to enable high-performance image processing on distributed systems. The final implementation achieved approximately a 10× speedup over the sequential baseline. ...

View Presentation https://youtu.be/7fSQUjhvmt0 Overview This is a non-technical, passion-driven presentation that explores the foundations of distributed deep learning. I explain key concepts such as data parallelism and model parallelism, and then dive into a research paper that caught my attention: ZeRO (Zero Redundancy Optimizer). The presentation is conceptual in nature—no code was used—focusing instead on the ideas and motivations behind distributed approaches to training deep learning models.