Invention Grant
- Patent Title: Data ingestion using file queues
-
Application No.: US16943251Application Date: 2020-07-30
-
Publication No.: US10997163B2Publication Date: 2021-05-04
- Inventor: Benoit Dageville , Varun Ganesh , Jiansheng Huang , Jiaxing Liang , Haowei Yu , Scott Ziegler
- Applicant: Snowflake Inc.
- Applicant Address: US CA San Mateo
- Assignee: Snowflake Inc.
- Current Assignee: Snowflake Inc.
- Current Assignee Address: US CA San Mateo
- Agency: Schwegman Lundberg & Woessner, P.A.
- Main IPC: G06F17/00
- IPC: G06F17/00 ; G06F16/23 ; G06F16/22 ; G06F16/25

Abstract:
The subject technology at a data system, an ingest request to ingest one or more files into a table. The subject technology, after obtaining the ingest request and prior to the ingesting of the one or more files, persists the one or more files in a first file queue that corresponds to the table, the first file queue further corresponding to a client account, and the data system further comprising a second file queue that corresponds to both a second client account and a second table. The subject technology ingests, by one or more execution nodes, the one or more files into one or more micro-partitions of the table, each of the one or more micro-partitions comprising contiguous units of storage of a storage device.
Information query