I use wget all the time on my Linux machines, but was surprised to find it missing on my MacBook Pro. Since Mac OS is based on BSD, it uses cURL instead. Here’s a good way to scrape files from a remote server.
curl -O http://www.gutenberg.org/files/21171/mp3/21171-[01-24].mp3
Man page is available at: http://curl.haxx.se/docs/manpage.html
{ 3 comments… read them below or add one }
Kevin Korb 07.22.09 at 3:04 pm
Or you could just download and install wget.
Step 1 and 2 deal with that here: http://kevinkorb.com/post/24
Install PHP 5.3, Apache2, GD, MySQL 5.1 on OSX Leopard (10.5.7)
dongcalmada 06.13.10 at 5:04 am
Thanks for the tip. That -O parameter worked for me
Big Dan 12.09.11 at 11:53 am
Thanks for the tip. For quite some time, I’ve been installing Xcode in order to install wget on OS X. It seemed like a waste to use 1.5GB of space just to get wget as I have no other use for X code but I could never get curl to work. Now, I know to use -O parameter.