How to Upload Your Data to the ThanoSQL Workspace¶

The ThanoSQL workspace's users can upload data in two ways, as shown below.

To upload data

Uploading your local data into your workspace environment
Uploading local data by SFTP server connection using a private key

1. Uploading your local data into a workspace environment¶

Follow these steps to upload local data to the ThanoSQL workspace:

Log into the ThanoSQL console
Click the Upload button. (Same as the Jupyter Lab method)
Select the file to upload.

Uploading Precaution

Uploading a large number of files with multiple selections can cause problems since multiple connection requests occur at once. When processing large amounts of data, be sure to upload it as a zip file.

2. Uploading local data by SFTP server connection using a private key¶

What is SFTP(Secure File Transfer Protocol)?

An interactive file transfer program with a user interface similar to File Transfer Protocol(FTP). However, SFTP uses SSH File Transfer Protocol(FTP) to create a secure connection to the server.

SFTP supports only ubuntu linux
Though, most commands available for the linux cli are usable with SFTP, some commands are unavailable.

Follow these steps to connect to the remote server and upload data.

STEP 1. Verify your private key and ID¶

SFTP connection requires a private key and ID. If you enter 'My Profile' at the top of the webpage, you can check or reissue your private key. Enter the workspace name for the ID required for SFTP connection.

The private key follows the format below:

STEP 2. Register private key locally - creating a pem file¶

Create a file called 'key.pem' using the vim command in your local environment. Paste the private key issued in the previous step to the generated file.

$ vim key.pem

STEP 3. Change the permission of the pem file¶

Change the permission of the private key registered pem file in your local environment to read.

$ chmod 400 key.pem

STEP 4. Connect to SFTP server¶

After changing the permission of the file from your local environment, Connect to SFTP server.

To connect to the SFTP server, you need the path of the pem file and the workspace name you checked in STEP 1.

sftp -i [path of the pem file] [name of workspace]@engine.thanosql.com

Once connected, you will get a screen as shown below.

STEP 5. Access data files¶

Once the SFTP connection is complete, locate the current location and access the authorized 'drive' folder. (You cannot access any other folder because you only have authority over the 'drive' folder.)

sftp> pwd
sftp> cd /drive

STEP 6. Transfer folders or files¶

Check the remote working directory and the local working directory, and transfer the file.

put image_folder

By following the above steps, you can transfer image files in the local working directory 'image_folder' to the remote working directory '/drive'.

(Optional) SFTP Command table¶

Command	description
sftp remote-system	Control sftp connection of remote system.
sftp remote-system: file	Copy the named file from remote-system.
bye	End the sftp session.
help	List all sftp commands
ls	List the contents of the remote working directory.
lls	List the contents of the local working directory.
pwd	Display the name of the remote working directory.
cd	Change the remote working directory.
lcd	Change the local working directory.
mkdir	Create a directory on the remote computer.
rmdir	Delete the directory from the remote computer.
get	Copy files from the remote working directory to the local working directory.
put	Copy files from the local working directory to the remote working directory.
delete	Delete files from remote working directories.

Last update: 2024-06-05