DP 203 学习笔记

考试内容总览

|------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Learning Objects: | 工具 |
| Designing and implementing data storage | 1. Storage Azure Synapse Analytics Azure Databricks Azure Data Lake Storage Gen2(ADLS2,可代替Hadoop Distributed File System也就是HDFS) 2. Shard Partition data store in to multiple shards。分块技术提高效率 3. Serving Layer |
| Designing and developing data processing | 1. Investing and transforming data Transform data: Apache Spark和SQL Transform feature: Azure Data Factory(ADF) 可以从storage A导入数据,transform,存入storage B; Azure Synapse Pipelines是ADF的子集,集成在Azure Synapse Analytics里; Stream Analytics老,用SQL语句 2. Batch Processing Azure Data Factory(ADF) Azure Synapse Pipelines Azure Databricks Azure Data Lake Storage Gen2(ADLS2) 3. Stream Processing Stream Analytics Azure Databricks Azure Event Hubs 4. Manage batches and Pipelines Azure Data Factory(ADF) Azure Synapse Pipelines |
| Designing and implementing data security | 加密等等 |
| Monitoring and optimizing data storage and data processing | 1. Monitor Azure Monitor 2. Optimize Azure Data Factory(ADF) Azure Databricks Azure Synapse Analytics |

Storage方案

|------------------------|------------------------------------------------------------------------------------|
| Raw Storage | Azure Blob Storage Azure File Storage Azure Data Lake Storage Gen2 (ADLS2) |
| Relational DBs Storage | Azure SQL Database Azure DB for MySQL Azure DB for MariaDB Azure DB for PostgreSQL |
| NoSQL DBs | Azure Cosmos DB Azure Cache for Redis |

相关推荐
老唐7775 分钟前
常见经典十大大机器学习算法分类与总结
人工智能·深度学习·神经网络·学习·算法·机器学习·ai
烟雨孤舟24 分钟前
python 基础学习文档
学习
ECT-OS-JiuHuaShan1 小时前
渡劫代谢,好事多磨
数据库·人工智能·科技·学习·算法·生活
Wyc724091 小时前
软考笔记放大发
笔记
2301_780943842 小时前
第三阶段:Gem5-GPU集成学习
学习
~kiss~2 小时前
quantizers 学习
学习
暖阳之下2 小时前
学习周报四十二
学习
wubba lubba dub dub7502 小时前
第四十四周 学习周报
学习
SHARK_pssm3 小时前
【数据结构——顺序表】
c语言·数据结构·经验分享·笔记
智者知已应修善业3 小时前
【51单片机ADC-MAX1241/ADC0832驱动】2023-6-6
c++·经验分享·笔记·算法·51单片机