SAVE the DATE | 6-8 November - Short Course on LLMs4Physics - PLEASE NOTE THAT THE FIRST LESSON STARTS AT 2:30 pm

Infopoint infopoint at ictp.it
Wed Nov 6 13:29:29 CET 2024


TODAY Wednesday 6 November, we will host, at ICTP, the first lesson of a 
short course titled *Large Language Models for Physics, *taught by Dr. 
Cristiano De Nobili. This activity is part of the ICOMP's initiatives 
for the new academic year. The course is designed for young researchers 
in applied/theoretical physics and climate science, who are interested 
in applying large language models (LLMs) in their research. All the 
interested postdocs are very welcome!

Below you can find more info.


*Short description of the  course*

To warm up, we will review the basics of deep learning and PyTorch. Then 
the Transformer architecture and its Self-attention Mechanism will be 
introduced and coded. A simple, small but complete autoregressive 
generative language model such as GPT-2 will be built. This will allow 
us to understand several relevant aspects of more sophisticated 
pre-trained LLMs, such as GPT4, Mistral or Llama. Afterwards, we will 
play with open-source pre-trained LLMs and, if possible, fine-tune one 
of them. In the last part of the course, we will explore some 
interesting, also from a physical point of view, emerging abilities of 
LLMs, touch upon multi-agent systems and their collective behaviour.


*Lecturer: *Cristiano De Nobili 
<https://www.linkedin.com/in/cristiano-de-nobili/>

*Schedule and rooms*
*
*
Wednesday  (6/11/24): 14.30 - 18.00,  lecture room Giambiagi
Thursday     (7/11/24):   9.00 - 13.00,  lecture room Stasi
Friday          (8/11/24):   9.00 - 13.00,  lecture room Stasi

For people that cannot be present in person and would like to follow 
from remote, please connect via Zoom
using the link below:
https://zoom.us/j/99968323117

ID meeting: 999 6832 3117
Passcode: 101357


Best regards,

Serafina Di Gioia





<https://www.ictp.it/home/ictps-60th-anniversary>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ictp.it/pipermail/ictp-announcements/attachments/20241106/3b228d8f/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ICTP_60_Logo_primary_pos_RGB-10.png
Type: image/png
Size: 10570 bytes
Desc: not available
URL: <https://lists.ictp.it/pipermail/ictp-announcements/attachments/20241106/3b228d8f/attachment-0001.png>


More information about the Ictp-announcements mailing list