Course Syllabus
Course Description and Objectives
MAT555E is a graduate level course which aims to provide an introduction to commonly used statistical methods for inference and prediction problems in data analysis. The course will harmonize statistical theory and data analysis through examples. This course is designed such that:
- To provide the fundamental mathematical, statistical, and computational concepts behind supervised and unsupervised statistical learning methods and algorithms for inference and prediction.
- To provide extensions of these methods to high-dimensional settings.
- To provide the applications of these methods in real life data sets.
- To provide the implementation of these methods in Python.
Course Type
This is a graduate-level elective course open to all graduate students at ITU.
Course Credits
3 local credits.
Course Prerequisites
Since the course also touches on the mathematical and statistical theory behind the methods and uses Python for implementation, this course requires the following background:
- Knowledge of linear algebra, probability, statistics, and optimization,
- Familiarity with Python’s Numpy, Pandas, Matplotlib, Seaborn, Statsmodels, and Scikit-Learn libraries,
- Familiarity with at least one computational document such as Jupyter Notebook, Google Colab, Visual Studio Code, or RStudio Quarto, and
- Familiarity with Git commands and GitHub interface.
Class Schedule
CRN 23955: Tuesdays between 14:30-17:30 at TBA.
Course Logistics
- Course related all announcements will be done through Ninova.
- Lecture materials (lecture slides, code scripts, assignments etc) will be uploaded on GitHub organization of the course.
- Students are expected to bring their own portable computer to the class.
Course Workload
3 homework, 1 paper presentation with a written-report, 1 project presentation with a written-report, and in-class performance (see details below).
Course Tentative Plan
We will closely follow the weekly schedule given below. However, weekly class schedules are subject to change depending on the progress we make as a class.
Week 1. Course introduction. Simple linear regression.
Week 2. Multiple linear regression.
Week 3. Multiple linear regression continu’ed
Week 4. Regression as a supervised learning problem.
Week 5. Regularization methods for regression problems. Ridge regression and lasso.
Week 6. Cross-validation. Unsupervised pre-processing. Grid search and hyper-parameter tuning.
Week 7. Remaining topics for regression problems.
Week 8. Introduction to classification. Logistic regression.
Week 9. Linear discriminant analysis. Quadratic discriminant analysis.
Week 10. Naive Bayes. K-nearest neighbors.
Week 11. Tree based methods. Bagging, Random forests, and Boosting.
Week 12. Unsupervised learning. Principal component analysis. Factor analysis.
Week 13. Clustering methods.
Week 14. Final review and examples.
Student Learning Outcomes
A student who completed this course successfully is expected:
- To be fluent in the fundamental concepts and principles behind supervised and unsupervised statistical learning methods,
- To be able to identify which method(s) might be suitable for conducting data analysis on specific real life data sets,
- To get familiar with Python Scikit-Learn library, and
- To be prepared for more advanced coursework or scientific research in machine learning and related fields.
immediately following the course, and/or a few months after the course.
Textbook
All lecture materials.
Recommended Primary Bibliography
Students are encouraged to consult the following sources on their own:
- Hastie, T., Tibshirani, R., Friedman, J.H., and Friedman, J.H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer. [Hard copy available at ITU Mustafa Inan Library with CALL #Q325.5 .H37 2009] [Available online at https://hastie.su.domains/ElemStatLearn/]
- James, G., Witten, D., Hastie, T., and Tibshirani, R. (2021). An Introduction to Statistical Learning: With Applications in R. New York: Springer. [Available online at https://www.statlearning.com/ ].
- Fan, J., Li, R., Zhang, C.H., and Zou, H. (2020). Statistical Foundations of Data Science. Chapman and Hall/CRC.
- Deisenroth, M.P., Faisal, A.A., and Ong, C. S. (2020). Mathematics for Machine Learning. Cambridge University Press. [Available online at https://mml-book.github.io/].
- VanderPlas, J. (2016). Python Data Science Handbook: Essential Tools for Working with Data. O’Reilly Media, Inc. [Available online at https://jakevdp.github.io/PythonDataScienceHandbook/].
- Müller, A.C., and Guido, S. (2016). Introduction to Machine Learning with Python: A Guide for Data Scientists. O’Reilly Media, Inc. [Available online at https://github.com/amueller/introduction_to_ml_with_python].
Supplementary Readings
- Murphy, K.P. (2022). Probabilistic Machine Learning: An Introduction. MIT Press. [Available online at https://probml.github.io/pml-book/book1.html].
- Bishop, C.M., Nasrabadi, N. M. (2006). Pattern Recognition and Machine Learning. New York: Springer. [Hard copy available at ITU Mechanical Eng. Library with CALL #Q327 .B52 2006]
Off-Campus Access to the ITU Library E-sources
Access to library e-sources remotely is possible with a library account. Users without a library account should apply for the library registration at Library register. After setting the web configurations given at Proxy only once on your computer, you will able to have an access to ITU Library e-sources.
Selected Important Dates
For the official ITU Fall 2022-2023 academic calendar, please visit:
Here are some selected important dates in Spring 2023 semester:
February 20, 2023: First day of classes.
February 20-24, 2023: Add-drop week.
March 27-31, 2023: ITU Spring Break (No classes).
April 21-23, 2023: Ramadan Feast Holiday (Friday-Sunday).
April 23, 2023: National Sovereignty and Children’s Day (Sunday).
May 1, 2023: Labor and Solidarity Day (Monday).
May 19, 2023: Commemoration of Atatürk, Youth and Sports Day (Friday)
May 26, 2023: Last day of classes.
May 29-June 11, 2023: Final exam week.
I also honor other national and religious holidays. Students, who needs flexibility on individual-based studies overlapping with these special days, can inform me.
Course Policies
Please read the information below as a reference for how this class will be conducted.
Grading Policy
| Assessment Method | Contribution to Final Grade |
|---|---|
| In-class performance | 5% |
| Homework | 10% Each |
| Paper presentation | 25% |
| Data analysis project presentation | 40% |
Paper resentation (along with report submission) date and coverage
- The paper presentation will be on
TBA. - When the semester starts, I will suggest a journal name for you to a pick a paper published in that journal within nearly past three years (2022, 2021, and 2020).
- The main aim of paper presentations (along with a report submission) is to asses whether you are able to read and understand a research problem recently carried out, and suggest an improvement (e.g., mathematical or computational) as an extension of the paper.
- The presentation duration is 30 minutes (25 min. talk + 5 min. Q.A.).
Data analysis project presentation (along with report submission) date and coverage
The project presentation and report submission date is the final exam date that will be announced by ITU SIS later in May 2023.
In the data analysis project you are asked to develop a data analysis project from zero.
You need to find a data and define a research problem around this data. Then, you have to apply the algorithms covered as well as the ones not covered in the course to find answers to your research problem.
Final Exam Attendance Policy
There is no VF rule to attend or not to attend the final exam.
Make-Up Exam Policy
- The students who miss either paper presentation, or data analysis project presentation due to a health problem can take a make-up exam/presentation day as long as they have a valid medical report taken on the exam day.
- The medical report should be handed in immediately (within two days of its expiration).
- There will be NO make-up for missed in-class activities.
Class Attendance Policy
The students must attend at least 70% of classes and are deemed responsible to manage his/her absences.
Participation Policy
The students are expected to ask and answer questions, participate in in-class activities, and show their interest and engagement in the class.
E-mail Policy
Please:
- Use a proper descriptive subject line (which may consist of the course number MAT555E followed by a short phrase summarizing the subject of your e-mail).
- Start off your e-mail with a proper greeting, introduce yourself (give your name), then state your problem as short as possible.
- Finally, use a proper closing and then finish your e-mail with your first name and so on.
Feel free to send me e-mails. But be sure you that give me enough time to get back to you.
- E-mail messages sent after business hours and at weekends will be responded at the closest business hour.
- Lastly, e-mails asking for grade grubbing at the end of the semester are not welcomed.
Academic Honesty Policy
At every stage of the academic life, every ITU student is responsible for obeying the academic honesty policy of ITU stated below:
https://odek.itu.edu.tr/en/code-of-honor/ethics-in-university-life.
Equity, Diversity, and Inclusion
In this class, I am committed to cultural and individual differences and diversity as including, but not limited to, age, disability, ethnicity, gender, gender identity, language, national origin, race, religion, culture, and socioeconomic status and I acknowledge the value of differences.
Student with Special Needs
I truly care about that every student in my class feels that she/he involved in this class equally. If you are a student with special needs, please, let me know that how we can adjust the course environment, materials, and course assessment methods in accordance with your needs. Furthermore, you are also invited to contact the office of students with special needs at: