Students should build a generative large language model. Identify an application

Students should build a generative large language model. Identify an application domain such as papers by Hinton. Use transfer learning i.e. retraining some parameters of a pre-trained model. As before, the recommended platform is: Python, Jupyter Notebook, Tensorflow. The grader will take into account correctness of the experiment, clarity of the code and explanation, rigor with which the model was evaluated, and cleverness in trying things.