{"id":9927,"date":"2024-09-23T13:28:19","date_gmt":"2024-09-23T11:28:19","guid":{"rendered":"https:\/\/dbdmg.polito.it\/dbdmg_web\/?p=9927"},"modified":"2025-06-25T13:35:12","modified_gmt":"2025-06-25T11:35:12","slug":"large-language-models-2024-25","status":"publish","type":"post","link":"https:\/\/dbdmg.polito.it\/dbdmg_web\/2024\/large-language-models-2024-25\/","title":{"rendered":"Large Language Models (2024\/25)"},"content":{"rendered":"\n<h2 class=\" wp-block-heading eplus-wrapper\">General information<\/h2>\n\n\n\n<p class=\" eplus-wrapper\"><strong>Lecturer:<\/strong> Flavio Giobergia<br><strong>Co-lecturer:<\/strong> Riccardo Coppola<\/p>\n\n\n<ul class=\" wp-block-list eplus-wrapper eplus-styles-uid-23044d\">\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/09\/00-course-introduction.pdf\">Course introduction<\/a><\/li>\n<\/ul>\n\n\n<p class=\" eplus-wrapper\">\ud83d\udcc6 <strong>Mondays<\/strong><br>\ud83d\udd63 8:30 \u2013 11:30 (3h)<br>\ud83d\udccd Room 19A<\/p>\n\n\n\n<p class=\" eplus-wrapper\">\ud83d\udcc6 <strong>Wednesdays<\/strong><br>\ud83d\udd66 11:30 \u2013 13:00 (1.5h)<br>\ud83d\udccd Room 9S<\/p>\n\n\n\n<h2 class=\" wp-block-heading eplus-wrapper\">Course material<\/h2>\n\n\n\n<h3 class=\" wp-block-heading eplus-wrapper\">LLM Foundations<\/h3>\n\n\n<ul class=\" wp-block-list eplus-wrapper eplus-styles-uid-69ac58\">\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/09\/01-Language-Models-Intro.pdf\">Introduction to Language Models<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/09\/02-DL-Intro.pdf\">Introduction to deep learning<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/09\/03-WordEmbeddings.pdf\">Word embeddings<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/09\/04-RNN.pdf\">Recurrent Neural Networks<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/10\/05-Transformers.pdf\">Transformers<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/10\/06-LLM-1.pdf\">LLM 1 &#8211; A brief histort of LLMs<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/10\/06-LLM-2-tasks.pdf\">LLM 2 &#8211; Metrics, Tasks, Benchmarks<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/10\/08-LLM-3-alignment.pdf\">LLM 3 &#8211; Instruction tuning and model alignment<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/10\/09-LLM-4-PEFT.pdf\">LLM 4 &#8211; Efficient fine-tuning and inference<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/10-LLM-5-potpourri.pdf\">LLM 5 &#8211; Potpourri<\/a><\/li>\n<\/ul>\n\n\n<p class=\" eplus-wrapper\"><strong>LLM for Software Engineering<\/strong><\/p>\n\n\n<ul class=\" wp-block-list eplus-wrapper eplus-styles-uid-b9dc26\">\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/01_software_engineering_introduction.pdf\">Introduction to Software Engineering<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/02_llmse.pdf\">LLM4SE<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/03_prompt_engineering.pdf\">Prompt Engineering<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/04_agent_architectures_v2.pdf\">Agent Architectures<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/05_evaluations.pdf\">Evaluation<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2025\/01\/Sample-questions-%E2%80%93-part-2.pdf\">Sample exam questions<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2025\/06\/06_ethical_issues.pdf\">Ethical issues<\/a><\/li>\n<\/ul>\n\n\n<h3 class=\" wp-block-heading eplus-wrapper\">Other material<\/h3>\n\n\n<ul class=\" wp-block-list eplus-wrapper eplus-styles-uid-731686\">\n<li class=\" eplus-wrapper\">GitHub repository (<a href=\"https:\/\/github.com\/dbdmg\/llm\" target=\"_blank\" rel=\"noreferrer noopener\">link<\/a>)<\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2025\/01\/LLM-project-cards-1.pdf\">Project Cards<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\">Project teams sheet (<a href=\"https:\/\/docs.google.com\/spreadsheets\/d\/1SRntBPtHONhRIPhkoRlobD4lQ9GvpfPKuRbyAw4C8Hw\/edit?usp=sharing\">link<\/a>) <\/li>\n\n\n\n<li class=\" eplus-wrapper\">More in-depth surveys:<ul class=\" wp-block-list eplus-wrapper eplus-styles-uid-3156e3\">\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/survey_llmse.pdf\">LLM4SE<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/survey_prompt_engineering.pdf\">Prompt Engineering<\/a><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2024\/11\/survey_multi_agent_systems.pdf\">Agentic Architectures<\/a><\/li>\n<\/ul><\/li>\n\n\n\n<li class=\" eplus-wrapper\"><strong>Invited talks<\/strong><ul class=\" wp-block-list eplus-wrapper eplus-styles-uid-ee32dc\">\n<li class=\" eplus-wrapper\"><span style=\"text-decoration: underline;\">January 8, 2025<\/span> &#8211; Vittorio Di Tomaso &#8211; <em>Linguistic Foundations of LLMs<\/em> (<a href=\"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-content\/uploads\/2025\/01\/flyer-vittorio-di-tomaso-linguistic-foundations-llms.pdf\">flyer<\/a>)<\/li>\n<\/ul><\/li>\n<\/ul>\n\n\n<h3 class=\" wp-block-heading eplus-wrapper\">News<\/h3>\n\n\n<ul class=\" wp-block-list eplus-wrapper eplus-styles-uid-5d1d8d\">\n<li class=\" eplus-wrapper\">27\/11\/2024 &#8211; Updated <em>Agent Architecture <\/em>slides; uploaded <em>Evaluations <\/em>slides, and reference surveys for more details<\/li>\n\n\n\n<li class=\" eplus-wrapper\">20\/11\/2024 &#8211; Uploaded <em>Agent Architectures<\/em> slides<\/li>\n\n\n\n<li class=\" eplus-wrapper\">13\/11\/2024 &#8211; Uploaded <em>Prompt Engineering<\/em> slides<\/li>\n\n\n\n<li class=\" eplus-wrapper\">06\/11\/2024 &#8211; Uploaded <em>Introduction to Software Engineering<\/em>, <em>LLM4SE <\/em>slides<\/li>\n\n\n\n<li class=\" eplus-wrapper\">28\/10\/2024 &#8211; Uploaded <em>LLM4<\/em> slides, lab 04 text+solution (GitHub)<\/li>\n\n\n\n<li class=\" eplus-wrapper\">21\/10\/2024 &#8211; Uploaded <em>LLM2\/3<\/em>, labs 02\/03 (GitHub)<\/li>\n\n\n\n<li class=\" eplus-wrapper\">14\/10\/2024 &#8211; Uploaded <em>LLM1<\/em> slides, lab 01 text+solutions (GitHub)<\/li>\n\n\n\n<li class=\" eplus-wrapper\">09\/10\/2024 &#8211; Uploaded an updated version of the <em>Transformers<\/em> slides<\/li>\n\n\n\n<li class=\" eplus-wrapper\">30\/09\/2024 &#8211; Uploaded <em>Transformers <\/em>slides<\/li>\n\n\n\n<li class=\" eplus-wrapper\">28\/09\/2024 &#8211; Uploaded lab 01&#8217;s solution (GitHub), <em>Word embeddings, Recurrent Neural Networks<\/em><\/li>\n\n\n\n<li class=\" eplus-wrapper\">23\/09\/2024 &#8211; Uploaded lab 01&#8217;s text (GitHub)<\/li>\n\n\n\n<li class=\" eplus-wrapper\">22\/09\/2024 &#8211; Uploaded <em>Intro to Language models, Intro to deep learnin<\/em>g<\/li>\n<\/ul>","protected":false},"excerpt":{"rendered":"<p>General information Lecturer: Flavio GiobergiaCo-lecturer: Riccardo Coppola \ud83d\udcc6 Mondays\ud83d\udd63 8:30 \u2013 11:30 (3h)\ud83d\udccd Room 19A \ud83d\udcc6 Wednesdays\ud83d\udd66 11:30 \u2013 13:00 (1.5h)\ud83d\udccd Room 9S Course material LLM Foundations LLM for Software Engineering Other material News<\/p>\n","protected":false},"author":15,"featured_media":9928,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"editor_plus_copied_stylings":"{}","footnotes":""},"categories":[37],"tags":[],"class_list":["post-9927","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-courses"],"_links":{"self":[{"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/posts\/9927","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/comments?post=9927"}],"version-history":[{"count":26,"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/posts\/9927\/revisions"}],"predecessor-version":[{"id":12460,"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/posts\/9927\/revisions\/12460"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/media\/9928"}],"wp:attachment":[{"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/media?parent=9927"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/categories?post=9927"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dbdmg.polito.it\/dbdmg_web\/wp-json\/wp\/v2\/tags?post=9927"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}