Simply pass the URL of an archive.org details page you want to download and ia-get will automatically get the XML metadata and download all files to the current working directory.
ia-get https://archive.org/details/<identifier>
Why? ๐ค๐ญ
I wanted to download high-quality scans of ZZap!64 magazine and some read-only memory from archive.org.
Archives of this type often include many large files, torrents are not always provided and when they are available they do not index all the available files in the archive.
Archive.org publishes XML documents for every page that indexes every file available.
So I co-authored ia-get to automate the download process.
Features โจ
๐ฝ Reliably download files from the Internet Archive
๐ณ Preserves the original directory structure
๐ Automatically resumes partial or failed downloads
๐ Hash checks to confirm file integrity
๐ฑ Can be run multiple times to update existing downloads
๐ฆ๏ธ Available for Linux ๐ง macOS ๐ and Windows ๐ช
A.I. Driven Development ๐ค
This program is an experiment ๐งช and has been (mostly) written using AI.
When I started this project I had no experience ๐ถ with Rust and was curious to see if I could use AI tools to assist in developing a program in a language I do not know.
The initial version of the program was created using ChatGPT-4.
I discussed that process in Episode 16 of Linux Matters.
Since that initial MVP, Iโve used Unfold.ai to add features and improve the code ๐งโ๐ป
All commits since Oct 27, 2023 that were co-authored by AI have full details of the AI contribution in the commit message.
Iโve picked up some Rust along way, and some refactoring came directly from my own brain ๐ง