Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

problem on training(first epoch take a long time more than 4 hours )using colab and fastai

I have a problem on training (first epoch takes a long time more than 4 hours) using colab and fastai. It takes me about 5 hours only for the first epoch which is not useful using google colab because the limitation using of GPU I'm using 'efficientnet-b4' and about 52k training photos after data augmentation and 11k valid photos.

The problem is shown on the photo:

Epoch training times

like image 913
Firas Zarai Avatar asked Nov 16 '25 19:11

Firas Zarai


1 Answers

Colab takes alot of time fetching the data from google drive as it is not indexed efficiently and thus makes the first epoch very long. For large datasets, I would recommend using google cloud storage and importing data from there.

like image 199
Jodh Singh Avatar answered Nov 18 '25 19:11

Jodh Singh



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!