Hi what is the best way, if any, to stream ATLAS Top Tagging Open Data Set | CERN Open Data Portal | CERN Open Data Portal into a colab notebook, with some persistent storage ?
The idea is to run the dataset training using a local machine on a colab GPU
Pl let me know if this approach has any major issues
I have tried cernopenclient in colab, there’s still persistence storage issue of data
Hi @abdullam ,
I’m glad to hear about your interest in the Open Data! Using the cernopendataclient is a good way to get URLs for the files, I think. How are you then trying to move or read the data?
Cheers,
Zach
Thanks for your response Zach
When I read the files using request.get into my colab folder, they just vanish after a session refreshing. This is the main issue - to counter it I want to shift them to google drive