From 76b31ff4a52da2410fe3b5703eb015ca1a6de975 Mon Sep 17 00:00:00 2001 From: Tzahi12345 Date: Sat, 18 Jun 2022 21:00:53 -0400 Subject: [PATCH] Created Archive (markdown) --- Archive.md | 28 ++++++++++++++++++++++++++++ 1 file changed, 28 insertions(+) create mode 100644 Archive.md diff --git a/Archive.md b/Archive.md new file mode 100644 index 0000000..d04d26a --- /dev/null +++ b/Archive.md @@ -0,0 +1,28 @@ +# What? + +youtube-dl's [archive](https://github.com/ytdl-org/youtube-dl/blob/master/README.md#how-do-i-download-only-new-videos-from-a-playlist) feature allows you to skip downloading already-downloaded videos. + +We use the `--download-archive ` arg, where we modify depending on how the video is being downloaded. We keep separate archives because different users shouldn't use the same archive (otherwise they could not download the same video). + +The following table summarizes where we store the archive: + +| | Single-user mode | Multi-user mode | +|-----------------------|-----------------------------------|----------------------------------------------------| +| **One-off download** | appdata/archives | users/\/archives | +| **Subscription download** | subscriptions/archives/\ | users/\/subscriptions/archives/\ | + +In each folder you can find 3 types of text files: +* archive_\.txt + * Running list of downloaded files +* blacklist_\.txt + * "Blacklisted" videos go here, where they are removed from the archive_\.txt but inserted into here. This allows you to keep a clean archive but still avoid redownloading a video (most useful for subscriptions) +* merged_\.txt + * This file is autogenerated, and simply a combination of the archive and blacklist + +# Why? + +There's a few reasons why you may want to use the archive. + +If you delete a subscription video without archiving functionality, that video will be downloaded again as long as that video is within the time scope of the subscription. + +This may also be useful if you primarily use YoutubeDL-Material as a downloader rather than a library.