Skip to main content

Week 1 - Work Summary Report

Project: Distributed Neural Network Training and Prediction
Mentors: Roger Dev, Lili Xu

Week 1: Weekly Work Summary (May 22-May 26)


This week, I focused on deepening my understanding of the ECL and GNN frameworks. The week started with a welcome meeting hosted by Hugo Watanuki and Roger Dev. During the meeting, Roger provided an overview of the internship expectations, while Hugo familiarized us with the typical workflow. I dedicated time to educating myself with the ECL language and GNN workflow to kickstart my learning process.

Roger kindly offered a walkthrough of the GNN code, which greatly facilitated my learning journey. However, I encountered a challenge while loading HPCC system virtual box file. The beta release of the virtual box for Mac m1 didn't support version 8 of the HPCC virtual box file, which posed a compatibility issue. Consequently, I resorted to using the university.us-hpccsystems-dev.azure.lnrsg.io:8010 endpoint to execute my code. Though this workaround allowed me to proceed, I did encounter occasional complications with seemingly straightforward code not functioning as expected.

I sought Hugo's guidance to address this issue, and he informed me about the limitation of running just one job at a time for THOR and HTHOR in the university cluster. There were some jobs that were running for 15 hours, and due to that, all the jobs I tried were in the queue. In addition, Hugo told me that the display of stream results in Visual Studio Code isn’t similar to that of ECL IDE for window OS. This discrepancy caused inconsistencies in the Visual Studio Code streamed output compared to the output from ECL IDE for Windows OS.

In summary, my week primarily revolved around setting up the development environment, delving deeper into the ECL/GNN framework, and becoming acquainted with the schedule and expectations of the internship.

May 26, 2023 Friday
Labels:

Comments

Post a Comment

Popular posts from this blog

Enhancing Performance of Distributed Neural Network with GNN Bundle - Project Poster and Videos

Poster contents Background Deep learning implementation demands are rising in various fields, including manufacturing, medicine, art, history, etc. The high demand for powerful graphics cards has led to shortages. Generalized Neural Network (GNN) being one of the choices for distributed neural network training; we want to improve it to have better control over machine utilization and optimize its performance. Within GNN, during backpropagation, the time required for each iteration is equal to the time for the weakest node due to the aggregation of loss required at the end of every iteration Research Questions Can we improve resource usage reduce training time required for deep neural network training using the more powerful machine? Method Adopted the notion of training with a restricted node count Enhanced the Fit function to accommodate nodeNumber parameter. Extracted data aligned with the chosen node count. Conducted training and weight synchronization on chosen nodes. Redistributed...
Post a Comment
Read more

Week 9: Weekly work summary

Project: Distributed Neural Network Training and Prediction Mentors: Roger Dev, Lili Xu Week 9: Weekly work summary (July 17-21) During this week, my primary focus was on conducting a comparative study between nNode and single node optimization methods. To carry out this analysis, I performed training for both classification and mnist tasks with different node configurations, specifically using node=all, 1, 2, and 3. However, upon reviewing the training time data from my local ubuntu machine and university cluster machine, it became evident that the recorded times did not align with our initial expectations. Roger and I collaborated to investigate this issue, but unfortunately, we were unable to pinpoint the exact cause. This matter remains unresolved and requires further attention. Alongside the comparative study, I dedicated time to explore an alternative approach for multi-node neural network training. Our current implementation involves a functional library for multi-node neural ne...
Post a Comment
Read more

Week 10: Weekly work summary

Project: Distributed Neural Network Training and Prediction Mentors: Roger Dev, Lili Xu Week 10: Weekly work summary (July 24-28) During this week, I participated in a short demo on utilizing ecl watch for code analysis, specifically focusing on analyzing time for each segment of the code. Gordon Smith provided us with a helpful walkthrough on effectively using Filters and Cross Tab from Metrics page to gather valuable analytics information. Additionally, he demonstrated the ECL tab, offering a brief overview of the time associated with each code block and its color code. I learned that we have the capability to update graph labels through the Options -> Graph tab. This session was highly informative and enhanced my understanding of the analytics available on ECL Watch. Following the demonstration, I devoted my time to analyzing the performance of the single node and nNodeFit Functions. Notably, I observed that FitBatch did not exhibit any time for a single node. To address this, I ...
Post a Comment
Read more