Maxcompute remote connection, uploading and downloading data files

MaxCompute Remote connection

Document address

https://help.aliyun.com/document_detail/27971.html#section-7ce-cnh-euq

Buy MaxCompute

agree!

Opening DataWorks

Then it will automatically let you open DataWorks, Choose to open the basic version for free

Create project

Fill in information

Wait until the build is complete

Remote connection

Note that there needs to be Java Environmental Science

Download client

Remote client download

Unpack the open

Enter the configuration odps_config.ini

The specific configuration is as follows ：

project_name=
access_id=
access_key=
end_point=
log_view_host=
https_check=
# confirm threshold for query input size(unit: GB)
data_size_confirm=
# this url is for odpscmd update
update_url=
# download sql results by instance tunnel
use_instance_tunnel=
# the max records when download sql results by instance tunnel
instance_tunnel_max_record=
# IMPORTANT:
#   If leaving tunnel_endpoint untouched, console will try to automatically get one from odps service, which might charge networking fees in some cases.
#   Please refer to Endpoint
# tunnel_endpoint=

# use set.<key>=
# e.g. set.odps.sql.select.output.format=

Copy project name

obtain AccessKey

Click Create

To verify

Connection address cross reference table （ To configure end_point and tunnel_endpoint）

Double-click to open

Successful connection

See the table

tunnel file

https://help.aliyun.com/document_detail/27833.html

tunnel Upload files

tunnel Download the file

Create a partition table

With gender For the district

create test02_p(id int,name string) partitioned by(gender string);
alter table test02_p add if not exists partition (gender='male');

Partition table upload

tunnel upload D:\2020-2024 University study \ Big data research \ experimental data \ODPS_DEMO\Resources\02-DataTransfer\t_tunnel_p.csv test02_p/gender='male';

Partition table query

select * from test02_p where gender='male';