Creating a list of every link on privacyguides.org

[jonaharagon]

It's too late at night for me to think about how to do this now, but what I want to do is somehow generate a list of every external link on privacyguides.org, which could then be loaded into an archiver tool like ArchiveBox or the Internet Archive just so we're sure a copy of everything exists somewhere (ArchiveBox for example accepts .txt files with one link per line).

If anyone has any thoughts on how to create such a list, or any tools that could do so based on the generated site or the Markdown files in this repo, I would appreciate any suggestions 🙏

[idk-r-n]

what stops you from grepping "https://"? arent you on macOS

[dngray]

I was able to do this with:

grep -Eorh '(http|https)://[a-zA-Z0-9./?=_-]*' . | sort -u

[dngray]

Moved to issue privacyguides/privacyguides.org#2003