Coursera, Big Data 3, Integration and Processing (week 1/2/3)

时间:2023-03-09 03:31:01
Coursera, Big Data 3, Integration and Processing (week 1/2/3)

This is the 3rd course in big data specification courses.

Data model reivew

  1, data model 的特点: Structured, operations on it, constrains.

  2. different types of data modelCoursera, Big Data 3, Integration and Processing (week 1/2/3)

Retrieving data (week 1/2)

Querying data from ralational DB.

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

query data from mongodb

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

   Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

输出如下,注意第3条记录  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

Big data integration (week3)

infomation integration 就是从多个infomation source 取数据来完成一个task

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

big data 主要的问题是 many sources, 两个solution 是pay-as-you-go, probabilistic schema mapping.

probabilitistic schema mapping 感觉是一种自动计算出 integration schema 的方法.

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  

Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

  Coursera, Big Data 3, Integration and Processing (week 1/2/3)

Industry examples for big data integration and processing

using Splunk and Datameer(used in digital music industry)