U-SQL - Table design, incremental data load, and partition management
U-SQL - Table design, incremental data load, and partition management
Important! Selecting a language below will dynamically change the complete page content to that language.
Version:
1.0
Date Published:
15/07/2024
File Name:
U-SQL - Table design, incremental data load, and partition management.pdf
File Size:
887.8 KB
Azure Data Lake Analytics (U-SQL) originates from the world of Big Data, in which data is processed in a scale-out manner by using multiple nodes. These nodes can access the data in several formats, from flat files to U-SQL tables. This document focuses on U-SQL tables, with details about table design strategy, different types of partitions that can be created on U-SQL tables and how they differ from each other, the process for incrementally loading data into a partitioned table, and how to manage partitions.Supported Operating Systems
Windows 10, Windows 11
none- Azure Data Lake Analytics (U-SQL) originates from the world of Big Data, in which data is processed in a scale-out manner by using multiple nodes. These nodes can access the data in several formats, from flat files to U-SQL tables. This document focuses on U-SQL tables, with details about table design strategy, different types of partitions that can be created on U-SQL tables and how they differ from each other, the process for incrementally loading data into a partitioned table, and how to manage partitions.