Currently, the disk space is limited, so please check the disk space before running any ETL jobs.
This section will be deprecated if we no longer encounter out-of-disk issues.
- Find the largest folders:
du -a /var/lib/docker/overlay2 | sort -n -r | head -n 20
- Show the folder size:
du -hs xxxx
- Delete the large folders identified.
- Check disk space:
df -h
Some API tokens might expire, so please check them regularly.
Please refer to Dev Data Team - Year to Year Jobs - HackMD for more details.