SAVE the DATE | 6-8 November - Short Course on LLMs4Physics - PLEASE NOTE THAT THE FIRST LESSON STARTS AT 2:30 pm
Infopoint
infopoint at ictp.it
Wed Nov 6 13:29:29 CET 2024
TODAY Wednesday 6 November, we will host, at ICTP, the first lesson of a
short course titled *Large Language Models for Physics, *taught by Dr.
Cristiano De Nobili. This activity is part of the ICOMP's initiatives
for the new academic year. The course is designed for young researchers
in applied/theoretical physics and climate science, who are interested
in applying large language models (LLMs) in their research. All the
interested postdocs are very welcome!
Below you can find more info.
*Short description of the course*
To warm up, we will review the basics of deep learning and PyTorch. Then
the Transformer architecture and its Self-attention Mechanism will be
introduced and coded. A simple, small but complete autoregressive
generative language model such as GPT-2 will be built. This will allow
us to understand several relevant aspects of more sophisticated
pre-trained LLMs, such as GPT4, Mistral or Llama. Afterwards, we will
play with open-source pre-trained LLMs and, if possible, fine-tune one
of them. In the last part of the course, we will explore some
interesting, also from a physical point of view, emerging abilities of
LLMs, touch upon multi-agent systems and their collective behaviour.
*Lecturer: *Cristiano De Nobili
<https://www.linkedin.com/in/cristiano-de-nobili/>
*Schedule and rooms*
*
*
Wednesday (6/11/24): 14.30 - 18.00, lecture room Giambiagi
Thursday (7/11/24): 9.00 - 13.00, lecture room Stasi
Friday (8/11/24): 9.00 - 13.00, lecture room Stasi
For people that cannot be present in person and would like to follow
from remote, please connect via Zoom
using the link below:
https://zoom.us/j/99968323117
ID meeting: 999 6832 3117
Passcode: 101357
Best regards,
Serafina Di Gioia
<https://www.ictp.it/home/ictps-60th-anniversary>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ictp.it/pipermail/ictp-announcements/attachments/20241106/3b228d8f/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ICTP_60_Logo_primary_pos_RGB-10.png
Type: image/png
Size: 10570 bytes
Desc: not available
URL: <https://lists.ictp.it/pipermail/ictp-announcements/attachments/20241106/3b228d8f/attachment-0001.png>
More information about the Ictp-announcements
mailing list