Perun: Difference between revisions
(add updatefeeds.sh) |
(add syncrepo) |
||
| Line 1: | Line 1: | ||
LXC container, connected to the internet and used for downloading everything. It has readwrite access to relevant mountpoints and has <code>wget</code>, <code>youtube-dlp</code> and <code>lftp</code> as download software installed. | LXC container, connected to the internet and used for downloading everything. It has readwrite access to relevant mountpoints and has <code>wget</code>, <code>youtube-dlp</code>, <code>rsync</code> and <code>lftp</code> as download software installed. | ||
== /video/lectures/updatefeeds.sh == | == /video/lectures/updatefeeds.sh == | ||
Completely automatic ETHZ-video lecture recording downloader. It reads <code>dir;url</code> lines from <code>urls.csv</code> where <code>dir</code> is a directory under <code>/video/lectures</code> and <code>link</code> is a RSS feed of an ETHZ video lecture series. It fetches the RSS feed through the <code>feed2exec</code> python module, that converts every item to a csv line. Those are internally interpreted to extract the published date in <code>%Y-%m-%d</code> format and the video url is then downloaded to <code>{dir}/%Y-%m-%d.mp4</code>. It prints a last line reporting the work done : amount of feeds fetched, files detected (which are mentioned in the feeds but also already downloaded) and new files downloaded. | Completely automatic ETHZ-video lecture recording downloader. It reads <code>dir;url</code> lines from <code>urls.csv</code> where <code>dir</code> is a directory under <code>/video/lectures</code> and <code>link</code> is a RSS feed of an ETHZ video lecture series. It fetches the RSS feed through the <code>feed2exec</code> python module, that converts every item to a csv line. Those are internally interpreted to extract the published date in <code>%Y-%m-%d</code> format and the video url is then downloaded to <code>{dir}/%Y-%m-%d.mp4</code>. It prints a last line reporting the work done: amount of feeds fetched, files detected (which are mentioned in the feeds but also already downloaded) and new files downloaded. | ||
== /software/git_clone.sh == | |||
Fetches archived git repositories, ran automatically. | |||
== /software/syncrepo-template.sh == | |||
Fetches, through <code>rsync</code>, archlinux and artixlinux (depending on <code>$1</code>) entire package repositories. Also fetches database files allowing completely functional package mirror operations in Lada. | |||
Revision as of 10:55, 8 April 2022
LXC container, connected to the internet and used for downloading everything. It has readwrite access to relevant mountpoints and has wget, youtube-dlp, rsync and lftp as download software installed.
/video/lectures/updatefeeds.sh
Completely automatic ETHZ-video lecture recording downloader. It reads dir;url lines from urls.csv where dir is a directory under /video/lectures and link is a RSS feed of an ETHZ video lecture series. It fetches the RSS feed through the feed2exec python module, that converts every item to a csv line. Those are internally interpreted to extract the published date in %Y-%m-%d format and the video url is then downloaded to {dir}/%Y-%m-%d.mp4. It prints a last line reporting the work done: amount of feeds fetched, files detected (which are mentioned in the feeds but also already downloaded) and new files downloaded.
/software/git_clone.sh
Fetches archived git repositories, ran automatically.
/software/syncrepo-template.sh
Fetches, through rsync, archlinux and artixlinux (depending on $1) entire package repositories. Also fetches database files allowing completely functional package mirror operations in Lada.
