Credits
4.5
Types
Elective
Requirements
This subject has not requirements
, but it has got previous capacities
Department
CS
Most areas in science, engineering and business are becoming increasingly data dependent. Clear examples of this are, to name a few, bioinformatics, medicine, or electronic commerce.
Data analysis techniques are needed to deal with these data and generate usable knowledge out of them. Amongst them, IDA techniques are one of the most promising approaches. This theme is at the core of the contents of this course.
Teachers
Person in charge
- Alfredo Vellido Alcacena ( avellido@cs.upc.edu )
Others
- Carlos Cano Domingo ( carlos.cano.domingo@upc.edu )
- Caroline König ( caroline.leonore.konig@upc.edu )
Weekly hours
Theory
2.9
Problems
0
Laboratory
0
Guided learning
0.1
Autonomous learning
4.6
Competences
Generic
Academic
Professional
Information literacy
Reasoning
Analisis y sintesis
Objectives
-
Presenting DM as a process that should involve a methodology id applied at its best.
Related competences: CEA7, CEP5, CT4, CT6, -
Introducing the students to the new concept of DM for processes, called Process Mining.
Related competences: CEA7, CG3, CEP1, CEP5, CT4, CT6, -
Delving into some detail in one of the stages of DM: data exploration.
Related competences: CEA4, CG3, CEP1, CT4, -
Dealing in detail with the problem of data visualization for exploration as a key issue in DM.
Related competences: CEA11, CG3, CEP1, CEP5, CT4, CT6, -
Introducing the students to the basics of probability theory as applied in Intelligent Data Analysis (IDA)
Related competences: CEP1, CT4, CT6, CT7, -
Introducing the students to the probabilistic variant of IDA in the form of Statistical Machine Learning, both for supervised and unsupervised learning models.
Related competences: CEA11, CG3, CT4, CT6, CT7, -
Dealing in detail with different unsupervised models for data visualization, including case studies.
Related competences: CEA11, CG3, CEP1, CEP5, CT4, CT6, CT7, -
Approaching the multi-faceted concept of data mining (DM) from different perspectives.
Related competences: CEA7, CG3, CEP5, CT4, CT6, CT7,
Contents
-
Introduction to the concept of data mining (DM).
DM is a multi-faceted concept that requires discussion and clarification. We will do this at the beginning of the course. -
DM as a methodology.
We argue that DM should not be focused on the concept of data analysis/modeling, but, instead, should be treated as a methodology with diverse inter-related stages. -
DM for processes: Process Mining.
A new development in DM methodologies is that which deals with one specifically suited for processes. It is called Process Mining and will be described and discussed in this course. -
Data exploration in DM.
One of the main stages of well-structures DM methodologies is Data exploration. It will be discussed as a preamble to data visualization. -
Basics of probability theory in Intelligent Data Analysis (IDA)
For a long time in the last half-century, multivariate statistics and artificial intelligence (mostly in the field of machine learning) have developed in parallel without fully meeting. Statistical machine learning has bridged that field over the last two decades. We introduce it by first providing some basic principles of probability theory (Bayesian inference). -
Data visualization for exploration.
One of the aspects of the problem of data exploration is data visualization. It has a research 'life' of its own as it involves not only computer-based mathematical models, but also natural perception and processing. -
Statistical Machine Learning for IDA: supervised models.
Once the basics of Bayesian inference are set, we will delve into the field of Statistical Machine Learning for IDA, starting with supervised learning models, with an emphasis on feed-forward artificial neural networks. -
Statistical Machine Learning for IDA: unsupervised models.
Once the basics of Bayesian inference and of Statistical Machine Learning for IDA in supervised models are set, we will continue with unsupervised models, focusing on self-organizing maps and related models. -
Unsupervised models for data visualization, with case studies.
In the final item of the contents of the course, we will bring statistical machine learning and data visualization together by discussing some probabilistic unsupervised learning models for data visualization, including some case studies as an example.
Activities
Activity Evaluation act
Essay on IDA for DM
Students will have to write a research essay on the topic of IDA for DM, with different options: 1. State of the art on an specific IDA-DM topic 2. Evaluation of an IDA-DM software tool with original experiments 3. Pure research essay, with original experimental contentObjectives: 8 1 2 3 4 5 6 7
Week: 15
Theory
0h
Problems
0h
Laboratory
0h
Guided learning
0h
Autonomous learning
0h
Introduction to Data Mining and its Methodologies
Introduction to Data Mining as a general concept and to its methodologies for practical implementation- Theory: presential seminars dealing with the theory of this topic
- Guided learning: Students' directed learning, related to the topic.
- Autonomous learning: Students' autonomous learning, related to the topic.
Contents:
Theory
6h
Problems
0h
Laboratory
0h
Guided learning
0h
Autonomous learning
9h
Process Mining
Introduction to the novel concept of Process Mining and its application within the DM framework.- Guided learning: Students' directed learning, related to the topic.
- Autonomous learning: Students' autonomous learning, related to the topic.
Contents:
Theory
3h
Problems
0h
Laboratory
0h
Guided learning
0h
Autonomous learning
6h
Data Visualization
As part of the DM stage of Data Exploration, we focus in the problem of Data Visualization.- Theory: presential seminars dealing with the theory of this topic
- Guided learning: Students' directed learning, related to the topic.
- Autonomous learning: Students' autonomous learning, related to the topic.
Contents:
Theory
6h
Problems
0h
Laboratory
0h
Guided learning
0h
Autonomous learning
9h
Basics of probability theory for intelligent data analysis
Introduction to probability theory for intelligent data analysis, with a focus on Bayesian statistics- Theory: presential seminars dealing with the theory of this topic
- Guided learning: Students' directed learning, related to the topic.
- Autonomous learning: Students' autonomous learning, related to the topic.
Contents:
Theory
6h
Problems
0h
Laboratory
0h
Guided learning
0h
Autonomous learning
9h
Statistical Machine Learning methods
The meeting of statistics and machine learning: Statistical Machine Learning methods, from the point of view of both supervised and supervised learning- Theory: presential seminars dealing with the theory of this topic
- Guided learning: Students' directed learning, related to the topic.
- Autonomous learning: Students' autonomous learning, related to the topic.
Theory
12h
Problems
0h
Laboratory
0h
Guided learning
0h
Autonomous learning
16h
SML in data visualization, with case studies
We merge the topics of SML and data visualization, illustrating its use with some real case studies- Theory: presential seminars dealing with the theory of this topic
- Guided learning: Students' directed learning, related to the topic.
- Autonomous learning: Students' autonomous learning, related to the topic.
Contents:
Theory
6h
Problems
0h
Laboratory
0h
Guided learning
0h
Autonomous learning
9h
Teaching methodology
This course will build on different teaching methodology (TM) aspects, including:TM1: Expositive seminars
TM2: Expositive-participative seminars
TM3: Orientation for individual assignments (essays)
TM4: Individual tutorization
Evaluation methodology
The course will be evaluated through a final essay that will take one of these three modalities:1. State of the art on an specific IDA-DM topic
2. Evaluation of an IDA-DM software tool with original experiments
3. Pure research essay, with original experimental content
Bibliography
Basic
-
Information theory, inference, and learning algorithms
- MacKay, D.J.C,
Cambridge University Press,
2003.
ISBN: 0521642981
https://discovery.upc.edu/discovery/fulldisplay?docid=alma991002876809706711&context=L&vid=34CSUC_UPC:VU1&lang=ca -
Principles of data mining
- Hand, D.; Mannila, H.; Smyth, P,
MIT Press,
2001.
ISBN: 026208290X
https://discovery.upc.edu/discovery/fulldisplay?docid=alma991002287109706711&context=L&vid=34CSUC_UPC:VU1&lang=ca -
Pattern recognition and machine learning
- Bishop, C.M,
Springer,
2006.
ISBN: 0387310738
https://discovery.upc.edu/discovery/fulldisplay?docid=alma991003157379706711&context=L&vid=34CSUC_UPC:VU1&lang=ca
Complementary
-
Statistics: a very short introduction
- Hand, D.J,
Oxford University Press,
2008.
ISBN: 9780199233564
https://discovery.upc.edu/discovery/fulldisplay?docid=alma991003868839706711&context=L&vid=34CSUC_UPC:VU1&lang=ca -
Information visualization: an introduction
- Spence, R,
Springer,
2020.
ISBN: 9783319073408
https://discovery.upc.edu/discovery/fulldisplay?docid=alma991004193539706711&context=L&vid=34CSUC_UPC:VU1&lang=ca -
Visualize this: the flowing data guide to design, visualization, and statistics
- Yau, N,
Wiley,
2011.
ISBN: 9780470944882
https://discovery.upc.edu/discovery/fulldisplay?docid=alma991003948649706711&context=L&vid=34CSUC_UPC:VU1&lang=ca
Previous capacities
Students are expected to have at least some basic background in the area of artificial intelligence and, more specifically, with the areas of Machine Leaning and Computational Intelligence.Some basic knowledge of probability theory and statistics would be beneficial.
Other than this, the course is open to students and researchers of all types of background