Lecture (2V+1Ü, 4 ECTS-LP) "Distributed Data Management" (Module Description), Course Number INF-24-53-V-7
- Level: Master
- Language: English
Here is the link to the Mattermost chat for this course: https://teamwork.rarp-kl.de/signup_user_complete/?id=snikrxan1jgy9n33pwpnoyze5y
The lecture content and exercises will be organized via OLAT. The corresponding link will be shared in Mattermost, latest on Monday 19.04.2021.
This course addresses fundamental concepts of distributed data management. Emphasis is put on novel approaches/paradigms to managing Big Data. The course aims at a mixture of system issues and hands on experience (like Hadoop/HDFS) and on fundamental algorithms and techniques (such as consistent hashing or Bloom filters).
- Big Data, Cloud Computing
- MapReduce (Hadoop, HDFS, …)
- Various algorithms on top of MR
- NoSQL Stores (MongoDB, Amazon Dynamo, Riak, ...)
- (State Machine) Replication, Paxos
- (Eventual) Consistency Models
- Synopses: Bloomfilter, count-min sketch, KMV, ...
- Distributed Data Stream Processing: STREAM, Storm, ...
- Gossip protocols, consistent hashing
|12.04.2021||Mattermost invite link published.|
|03.03.2021||Website is online.|
Please read carefully.
Students need to successfully participate in the exercise sessions, according to the regulations below, in order to get admitted to the final exam.
- There will be 6 exercise sheets.
- The teaching assistant presents the solutions and answers questions.
- There is no mandatory attendance of the exercise sessions; still, we would be happy to see a lively participation.
- Each sheet consists of 3 assignments on average, which makes 18 assignments in total. Each assignment is equivalent to one point.
- A student needs to reach a total of at least 13 points throughout the semester to qualify for the final exam.
- Solutions to exercise sheets have to be submitted in OLAT.
- Students can work alone or in groups of max. two. In order to submit solutions you have to enrol to a group in the OLAT course.
- Students need to mark in OLAT which individual assignments they have managed to solve correctly (individually, not per group).
- Students can only mark an assignment as solved, if they have managed to fully complete the assignment in a reasonable manner. In other words, for every part of the assignment the submitted solution has to present an in-depth approach, which does not necessarily have to include every detail of a correct solution.
- In addition, only if the solution of an assignment is done correctly to an extent of ½ or more, the point for that assignment will be given.
- If it is obvious that the mark has been placed in a dishonest attempt to obtain a point without proper engagement with the assignment, the entire sheet is assessed with zero points. For instance, if the marked exercise or parts of it are not done at all.
- Copying solutions from other groups or taking solutions from previously published solution sheets, if clearly identifiable, will cause all involved groups to get immediately disqualified from the course, independent of the number of points accomplished regularly.