Skip to main content

S3 Parquet Import

Credentials and Configuration​

To read data from S3, set up the credentials and S3 region:

SQL
CREATE SECRET (    TYPE s3,    KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩',    SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩',    REGION '⟨us-east-1⟩');

Querying​

Once the S3 configuration is set correctly, Parquet files can be read from S3 using the following command:

SQL
SELECT * FROM read_parquet('s3://⟨bucket⟩/⟨file⟩');
 id | name  | value
----+-------+-------
  1 | alpha |    10
  2 | beta  |    20

Google Cloud Storage (GCS) and Cloudflare R2​

SereneDB can also handle Google Cloud Storage (GCS) and Cloudflare R2 via the S3 API. See the relevant guides for details.