Found 51 bookmarks
Newest
Choose a real-time and stream processing solution on Azure
Choose a real-time and stream processing solution on Azure
Learn about how to choose the right real-time analytics and streaming processing technology to build your application on Azure.
Built-in temporal operators, such as windowed aggregates, temporal joins, and temporal analytic functions. Native Azure input and output adapters Support for slow changing reference data (also known as a lookup tables), including joining with geospatial reference data for geofencing. Integrated solutions, such as Anomaly Detection Multiple time windows in the same query Ability to compose multiple temporal operators in arbitrary sequences.
·docs.microsoft.com·
Choose a real-time and stream processing solution on Azure
Process real-time IoT data streams with Azure Stream Analytics
Process real-time IoT data streams with Azure Stream Analytics
IoT sensor tags and data streams with stream analytics and real-time data processing
Stream Analytics Query Language (SAQL)
How to write different Queries in Azure Stream Analytics
·docs.microsoft.com·
Process real-time IoT data streams with Azure Stream Analytics
Conditional split transformation in mapping data flow - Azure Data Factory & Azure Synapse
Conditional split transformation in mapping data flow - Azure Data Factory & Azure Synapse
Split data into different streams using the conditional split transformation in a mapping data flow in Azure Data Factory or Synapse Analytics
The conditional split transformation routes data rows to different streams based on matching conditions. The conditional split transformation is similar to a CASE decision structure in a programming language.
disjoint is false because the data goes to the first matching condition.
·docs.microsoft.com·
Conditional split transformation in mapping data flow - Azure Data Factory & Azure Synapse
Prepare and transform data with Azure Synapse Analytics - Learn
Prepare and transform data with Azure Synapse Analytics - Learn
Prepare and transform data with Azure Synapse Analytics
Azure Blob Storage (JSON, Avro, Text, Parquet) Azure Data Lake Storage Gen1 (JSON, Avro, Text, Parquet) Azure Data Lake Storage Gen2 (JSON, Avro, Text, Parquet) Azure Synapse Analytics Azure SQL Database Azure CosmosDB
·docs.microsoft.com·
Prepare and transform data with Azure Synapse Analytics - Learn
Flatten transformation in mapping data flow - Azure Data Factory & Azure Synapse
Flatten transformation in mapping data flow - Azure Data Factory & Azure Synapse
Denormalize hierarchical data using the flatten transformation in Azure Data Factory and Synapse Analytics pipelines.
Use the flatten transformation to take array values inside hierarchical structures such as JSON and unroll them into individual rows. This process is known as denormalization.
·docs.microsoft.com·
Flatten transformation in mapping data flow - Azure Data Factory & Azure Synapse
Create schedule triggers - Azure Data Factory & Azure Synapse
Create schedule triggers - Azure Data Factory & Azure Synapse
Learn how to create a trigger in Azure Data Factory or Azure Synapse Analytics that runs a pipeline on a schedule.
Specify the start datetime of the trigger for Start Date. It's set to the current datetime in Coordinated Universal Time (UTC) by default.
When creating a schedule trigger, you specify a schedule (start date, recurrence, end date etc.) for the trigger, and associate with a pipeline. Pipelines and triggers have a many-to-many relationship. Multiple triggers can kick off a single pipeline. A single trigger can kick off multiple pipelines.
Specify Recurrence for the trigger. Select one of the values from the drop-down list (Every minute, Hourly, Daily, Weekly, and Monthly). Enter the multiplier in the text box. For example, if you want the trigger to run once for every 15 minutes, you select Every Minute, and enter 15 in the text box.
·docs.microsoft.com·
Create schedule triggers - Azure Data Factory & Azure Synapse
Copy activity - Azure Data Factory & Azure Synapse
Copy activity - Azure Data Factory & Azure Synapse
Learn about the Copy activity in Azure Data Factory and Azure Synapse Analytics. You can use it to copy data from a supported source data store to a supported sink data store.
·docs.microsoft.com·
Copy activity - Azure Data Factory & Azure Synapse
Copy data from/to a file system - Azure Data Factory & Azure Synapse
Copy data from/to a file system - Azure Data Factory & Azure Synapse
Learn how to copy data from file system to supported sink data stores (or) from supported source data stores to file system using an Azure Data Factory or Azure Synapse Analytics pipelines.
·docs.microsoft.com·
Copy data from/to a file system - Azure Data Factory & Azure Synapse
Shared database - Azure Synapse Analytics
Shared database - Azure Synapse Analytics
Azure Synapse Analytics provides a shared metadata model where creating a Lake database in an Apache Spark pool will make it accessible from its serverless SQL pool engine.
·docs.microsoft.com·
Shared database - Azure Synapse Analytics
Shared metadata tables - Azure Synapse Analytics
Shared metadata tables - Azure Synapse Analytics
Azure Synapse Analytics provides a shared metadata model where creating a table in serverless Apache Spark pool will make it accessible from serverless SQL pool and dedicated SQL pool without duplicating the data.
·docs.microsoft.com·
Shared metadata tables - Azure Synapse Analytics
Design a scalable partitioning strategy for Azure Table storage (REST API) - Azure Storage
Design a scalable partitioning strategy for Azure Table storage (REST API) - Azure Storage
This article discusses partitioning a table in Azure Table storage and strategies you can use to ensure efficient scalability.
Azure Table storage is designed to store structured data.
PartitionKey: The PartitionKey property stores string values that identify the partition that an entity belongs to.
Table entities represent the units of data that are stored in a table. Table entities are similar to rows in a typical relational database table. Each entity defines a collection of properties. Each property is defined as a key/value pair by its name, value, and the value's data type.
Timestamp: The Timestamp property provides traceability for an entity.
RowKey: The RowKey property stores string values that uniquely identify entities within each partition. The PartitionKey and the RowKey together form the primary key for the entity.
·docs.microsoft.com·
Design a scalable partitioning strategy for Azure Table storage (REST API) - Azure Storage