Natural Language Processing course resources
This github contains practical assignments for Natural Language Processing course by Higher School of Economics: https://www.coursera.org/learn/language-processing. In this course you will learn how to solve common NLP problems using classical and deep learning approaches.
From a practical side, we expect your familiarity with Python, since we will use it for all assignments in the course. Two of the assignments will also involve TensorFlow. You will work with many other libraries, including NLTK, Scikit-learn, and Gensim. You have several options on how to set it up.
1. Running on Google Colab
Google has released its own flavour of Jupyter called Colab, which has free GPUs!
Here's how you can use it:
- Open https://colab.research.google.com, click Sign in in the upper right corner, use your Google credentials to sign in.
- Click GITHUB tab, paste https://github.com/hse-aml/natural-language-processing and press Enter
- Choose the notebook you want to open, e.g. week1/week1-MultilabelClassification.ipynb
- Click File -> Save a copy in Drive... to save your progress in Google Drive
- If you need a GPU, click Runtime -> Change runtime type and select GPU in Hardware accelerator box
- Execute the following code in the first cell that downloads dependencies (change for your week number):
! wget https://raw.githubusercontent.com/hse-aml/natural-language-processing/master/setup_google_colab.py -O setup_google_colab.py
import setup_google_colab
# please, uncomment the week you're working on
# setup_google_colab.setup_week1()
# setup_google_colab.setup_week2()
# setup_google_colab.setup_week3()
# setup_google_colab.setup_week4()
# setup_google_colab.setup_project()
# setup_google_colab.setup_honor()
- If you run many notebooks on Colab, they can continue to eat up memory, you can kill them with
! pkill -9 python3and check with! nvidia-smithat GPU memory is freed.
Known issues:
- No support for
ipywidgets, so we cannot use fancytqdmprogress bars. For now, we use a simplified version of a progress bar suitable for Colab. - Blinking animation with
IPython.display.clear_output(). It's usable, but still looking for a workaround. - If you see an error "No module named 'common'", make sure you've uncommented the assignment-specific line in step 6, restart your kernel and execute all cells again
2. Running locally
Two options here:
-
Use the Docker container of our course. It already has all libraries, that you will need. The setup for you is very simple: install Docker application depending on your OS, download our container image, run everything within the container. Please, see this detailed Docker tutorial.
-
Manually install all the libraries depending on your OS (each task contains a list of needed libraries in the very beginning). If you use Windows/MacOS you might find useful Anaconda distribution which allows to install easily most of the needed libraries. However, some tools, like StarSpace for week 2, are not compatible with Windows, so it's likely that you will have to use Docker anyways, if you go for these tasks.
It might take a significant amount of time and resources to run the assignments code, but we expect that an average laptop is enough to accomplish the tasks. All assignments were tested in the Docker on Mac with 8GB RAM. If you have memory errors, that could be caused by not tested configurations or inefficient code. Consider reporting these cases or double-checking your code.
If you want to run the code of the course on the AWS machine, we've prepared the AWS tutorial here.
14 Dec 19, 2022
726 Dec 30, 2022
1 Feb 01, 2022
4 Jul 20, 2022
9 Oct 13, 2022
94 Dec 30, 2022
14 Dec 15, 2021
10 Oct 13, 2022
8 Apr 13, 2022
2.9k Jan 02, 2023
20 Dec 13, 2022
41 Dec 27, 2022
1 Feb 02, 2022
3.2k Dec 31, 2022
605 Jan 02, 2023
17 Dec 14, 2022
1.1k Jan 03, 2023
4 Dec 09, 2021
163 Dec 23, 2022
231 Nov 18, 2022