Data Management and Visualization (2024-25)

Data Management and Visualization (2024-25)

General Information

Lecturers: Daniele Apiletti, Diego Monti

Teaching staff: Simone Monaco

SSD: ING-INF/05 – CFU: 8 – course details from the official student guide

Q&A teaching assistance on Piazza: piazza.com/polito.it/fall2024/01txasm


πŸ“° News

  • We are using Piazza for class discussion. We invite all students to join the course Piazza. Piazza is highly suggested to get help fast and efficiently from classmates and teachers. Rather than emailing questions to the teaching staff, students are invited to post their questions on Piazza.

πŸ“’ Teaching material

Course introduction (slides)

  • Introduction (slides)
  • Conceptual and logical design (slides)
  • Data analysis, OLAP, extended SQL (slides)
  • ETL process (slides)
  • Data Lakes and ELT (slides)
  • Materialized view (slides)
  • Data warehousing in Oracle (slides)
  • Data warehousing: physical design (slides)
  • Conceptual schema: textual formalism (slides)
  • Non-relational databases for data management – introduction (slides)
  • Introduction to MongoDB, collections, create, delete, GUI (slides)
  • MongoDB, querying data, find operator, aggregation pipeline (slides)
  • MongoDB aggregation examples, indexes (slides)
  • Distributed Data Management, replication, and the CAP theorem (slides)
  • MongoDB replica set (slides, updated Nov 18)
  • Distributed transactions (slides)
  • Distributed data processing and Map Reduce (slides)
  • NoSQL design recipe (slides)
  • MongoDB design patterns part 1 (slide)
  • MongoDB design patterns part 2 (slide)

πŸ—’οΈ Exercises

  • Exercise extended SQL, customers (text)
  • Exercise extended SQL, rentals (text)
  • Exercise DW design, hotels (text)
  • Exercise DW design, storehouses (text)
  • Exercise DW design, rentals (text)
  • Exercise DW design, parcels (text)
  • Exercise DW design, computer (text)
  • Exercise DW design, vehicle rental (text)
  • Exercise DW design, versioning services (text)
  • Exercise DW design, craft beer (text)
  • Exercise DW design, tickets (text)
  • Exercise DW design, food delivery (text)
  • Exercise DW design, winery (text)
  • MongoDB query exercises (slides)
  • MongoDB query exercises IMDB (slides,Β IMDB database)
  • MongoDB design pattern exercises 1 (slide)
  • MongoDB design pattern exercises 2 (slide)

πŸ’» Laboratory material

Students groupTimeRoom
TEAM 1 (FROM A TO K)Tuesday, 13:00 – 14:30LAIB3B
TEAM 2 (FROM L TO Z)Tuesday, 14:30 – 16:00LAIB3B

For Labs 1 and 2, you must run Extended SQL on Oracle databases. The suggested tool for these Labs is Oracle Live SQL. To configure the environment you can add tables using SQL scripts. A short guide on how to import them and query the DB is available (pdf)

Lab 1: Extended SQL

Text (πŸ“„pdf)
Data warehouse tables (πŸ—ƒοΈCSV, πŸ—ƒοΈSQL)
Solution (πŸ“„star schema, πŸ“„queries)

Lab 2: Extended SQL

Text – Additional queries (πŸ“„pdf)
Solution (πŸ“„pdf)

Lab 3: Looker Studio

Text (πŸ“„pdf)

Lab 3: NoSQL with PyMongo

Text (πŸ“„pdf)
Data (πŸ—‚οΈlink)
Notebook (πŸ“’colab)

Solution (πŸ“’colab)

Lab 5: MongoDB replica set

Text (πŸ“„pdf)
Notebook (πŸ“’colab)
Docker Compose (πŸ“œfile)

Lab 6: Visualization analysis

Text (πŸ“„pdf)
Data (πŸ—‚οΈxlsx)

Solution (πŸ—‚οΈxlsx)


πŸ“„ Past Exams

TitleTextSolutions
September 20th, 2023πŸ“Text + DW and NoSQL solutions
June 21th, 2023πŸ“Text + DW and NoSQL solutions
February 22th, 2023πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solutions
πŸ“‘Conceptual design
February 7th, 2023πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solutions
πŸ“‘Conceptual design
June 29th, 2022πŸ“Text + DW and NoSQL solutions
February 17th, 2022πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solutions
πŸ“‘Conceptual design
January 28th, 2022πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solutions
September 1st, 2021πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solutions
June 17th, 2021πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solution
Feb 15th, 2021πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solutions
Feb 1st, 2021πŸ“Text + DW and NoSQL solutionsπŸ“‘Data visualization solutions