I need help downloading a .gz file in Google colab. The file is here but I can’t download it on my local drive due to the size, it’s 8 GB. I have tried to different ways to do it but I’m stuck.
Any help would be greatly appreciated!
file https://mcfp.felk.cvut.cz/publicDatasets/IoT-23-Dataset/iot_23_datasets_small.tar.gz
Advertisement
Answer
You can use curl to download and tar to extract it.
url = 'https://mcfp.felk.cvut.cz/publicDatasets/IoT-23-Dataset/iot_23_datasets_small.tar.gz'
!curl {url} | tar xz
It should take around 15 minutes. The files will be extracted here
/content/opt/Malware-Project/BigDataset/IoTScenarios
See this example notebook