HuggingFace Workshop

This workshop is designed for GDSC AI Team & NetAI Lab.

check Usage for setting up the environment

Workshop

This workshop covers the following topics:

Pipeline API for NLP tasks (transformers_pipeline.ipynb)
Diffuser API for text-to-image generation (diffuser.ipynb)
How to fine-tune a bert-base model on a custom dataset (transformers_finetune.ipynb)
How to use the LLM(Llama) (llama.ipynb)

create a virtual environment via conda

conda create -n huggingface-api python=3.12

conda activate huggingface-api

conda install nvidia/label/cuda-12.1.0::cuda-toolkit

conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

pip install huggingface_hub transformers datasets

Name		Name	Last commit message	Last commit date
Latest commit History 22 Commits
.gitignore		.gitignore
README.md		README.md
app.py		app.py
diffuser.ipynb		diffuser.ipynb
llama.ipynb		llama.ipynb
requirements.txt		requirements.txt
transformers_finetune.ipynb		transformers_finetune.ipynb
transformers_pipeline.ipynb		transformers_pipeline.ipynb