Quickly upload data sets and other files to Google colab ------ solve the problem of slow uploading colab files

Method ：

Can use github perhaps gitee Indirectly upload batch datasets to colab

If you want to quickly upload files to google drive , You can also try this way , Treat the data set mentioned below as the file you want to upload .

Because if directly from github/gitee If the platform uploads data sets , There is a limit on the number of files uploaded at one time . Here, local api Upload , With the help of git To upload .
Be careful gitee A single warehouse is the largest 500M, Single file is the largest 200M;github A single warehouse is the largest 5G, Please select the appropriate one according to the data set size .

Recommend to use gitee, The server is in China , Upload faster , With gitee For example , Explain the process ：

1, stay gitee New warehouse .

2. Set to public

3. download git And install （ Jump to the next step ）

Official website ：https://git-scm.com/

windows edition

4. Set the folder to upload to git Warehouse

4.1 git bash here

4.2 Configure user name and mailbox

git config --global user.name "xxx"
git config --global user.email "xxx"

4.3 Turn the project into a project that can be git Managed warehouse , Add all files under the project

git init
git add .

4.4 Add files to the warehouse

git commit -m ' This is the dataset '

4.5 Associate a local code base with a remote code base

git remote add origin https://gitee.com/moluggg/datasets

The format is ：git remote add origin https://gitee.com/gitee user name / Warehouse,

4.6 Force the remote warehouse to update to the current branch

ps: If the warehouse is empty, you can skip this step

git pull --rebase origin master

4.7 Push the local code to the specified remote repository

git push -u origin master

5. stay google colab upload

from google.colab import drive
drive.mount('/content/drive')

colab Mounted on google drive, And select the location you will upload to ：

!ls
%cd /content/drive/MyDrive/XX

upload gitee Warehouse dataset

!git clone https://gitee.com/moluggg/datasets.git