1 Version 5.3a (win32 only)
4 - Corrected a win32 bug in the environment variable part.
8 Gilbert Ramirez Jr. (21 Dec 1998)
9 - I have implemented the "quote" function of FTP clients. It allows you to
10 send arbitrary commands to the remote FTP server. I chose the -Q/--quote
11 command-line arguments.
13 You can have more than one quoted string, and curl will apply them in
14 order. This is what I use for my MVS upload:
16 curl -B --crlf -Q "site lrecl=80" -Q "site blk=8000" -T file ftp://os390/test
18 Curl will send the two quoted "site" commands in the proper order.
20 - Made it compile smoothly on AIX.
22 Gilbert Ramirez Jr. (18 Dec 1998)
23 - Brought an MVS patch: -3/--mvs, for ftp upload to the MVS ftp server.
25 Troy Engel (17 Dec 1998)
26 - Brought a correction that fixes the win32 curl bug.
29 - A bug, pointed out to me by Dr H. T. Leung, caused curl to crash on the -A
30 flag on certain systems. Actually, all systems should've!
32 - Added a few defines to make directories/file names get build nicer (with _
33 instead of . and \ instead of / in win32).
35 - steve <fisk at polar.bowdoin.edu> reported a weird bug that occured if the
36 ftp server response line had a parenthesis on the line before the (size)
37 info. I hope it works better now!
41 Steven G. Johnson (Dec 14, 1998)
42 - Brought a fix that corrected a crash in 5.2 due to bad treatment of the
43 environment variables.
47 Daniel Stenberg (Dec 14, 1998)
48 - Rewrote the mkhelp script and now, the mkhelp.pl script generates the
49 hugehelp.c file from the README *and* the man page file curl.1. By using
50 both files, I no longer need to have double information in both the man
51 page and the README as well. So, win32-users will only have the hugehelp.c
52 file for all info, but then, they download the plain binary most times
55 - gcc2.8.1 with the -Wall flag complaints a lot on subscript has type `char'
56 if I don't explicitly typecast the argument to isdigit() or isspace() to
57 int. So I did to compile warning free with that too.
59 - Added checks for 'long double' and 'long long' in the configure script. I
60 need those for the mprintf.c source to compile well on non long long
63 Version 5.1 (not publicly released)
65 Daniel Stenberg (Dec 10, 1998)
66 - I got a request for a pre-compiled NT Alpha version. Anyone?
68 - Added Lynx/CERN www lib proxy environment variable support. That means curl
69 now reads and understands the following environment variables:
71 HTTP_PROXY, HTTPS_PROXY, FTP_PROXY, GOPHER_PROXY
73 They should be set for protocol-specific proxies. General proxy should be
78 And a comma-separated list of host names that shouldn't go through any
79 proxy is set in (only an asterisk, '*' matches all hosts).
83 The usage of the -x/--proxy flag overrides the environment variables.
85 - Proxy can now be specified with a procotol:// prefix.
87 - Wrote the curl.1 man page.
89 - Introduced a whole new dynamic buffer system for all sprintf()s. It is
90 based on the *printf() package by yours truly and Bjorn Reese. Hopefully,
91 there aren't that many buffer overflow risks left now.
93 - Ah, I should mention I've compiled and built curl successfully under
94 solaris 2.6 with gcc now, gcc 2.7.2 won't work but 2.8.1 did ok.
96 Oren Tirosh (Dec 3, 1998)
97 - Brought two .spec files, to use when creating (Linux) Redhat style RPM
98 packages. They're named curl.spec and curl-ssl.spec.
101 - Supplied the src/Makefile.vc6 for easy compiling with VC++ under Win32.
105 Daniel Stenberg (Dec 1, 1998)
106 - Not a single bug report in ages.
107 - Corrected getpass.c and main.c to compile warning and error free with the
112 Daniel Stenberg (Nov 20, 1998)
114 HOW TO BUILD A RELEASE ARCHIVE:
116 * Pre-requisite software:
117 What To build what Reads data from
118 ==== ============= ===============
119 GNU automake Makefile.in, aclocal.m4 configure.in
122 GNU autoconf configure configure.in
123 GNU autoheader(2) config.h.in configure.in, acconfig.h
125 * Make sure all files that should be part of the archive are put in FILES.
127 * Run './maketgz' and enter version number of the new to become archive.
131 - Enters the newly created version number in url.h.
132 - (If you don't have automake, this script will warn about that, but unless
133 you have changed the Makefile.am files, that is nothing to care about.)
134 If you have it, it'll run it.
135 - If you have autoconf, the configure.in will be edited to get the newly
136 created version number and autoconf will be run.
137 - Creates a new directory named curl-<version>. (Actually, it uses the base
138 name of the current directory up to the first '-'.)
139 - Copies all files mentioned in FILES to the new directory. Saving
140 permissions and directory structure.
141 - Uses tar to create an archive of it all, named curl-<version>.tar.gz
143 - Removes the new directory and all its contents.
145 * When done, you have an archive stored in your directory named
146 curl-<version>.tar.gz.
150 (1) They're required to make automake run properly.
151 (2) It is distributed as a part of the GNU autoconf archive.
153 Daniel Stenberg (Nov 18, 1998)
154 - I changed the TAG-system. If you ever used urlget() from this package in
155 another product, you need to recompile with the new headers. I did this
156 new stuff to better deal with different compilers and system with different
157 variable sizes. I think it makes it a little more portable. This proves
158 to compile warning free with the problematic IRIX compiler!
159 - Win32 compiled with a silly error. Corrected now.
160 - Brian Chaplin reported yet another problem in
161 multiline FTP responses. I've tried to correct it. I mailed him a new
162 version and I hope he gets back soon with positive feedback!
163 - Improved the 'maketgz' to create a temporary directory tree which it makes
164 an archive from instead of the previous renaming of the current one.
165 - Mailing list opened (see README).
166 - Made -v more verbose on the PASV section of ftp transfers. Now it tells
167 host name and IP of the new host (and port number). I also added a section
168 about PORT vs PASV in the README.
172 Angus Mackay (Nov 15, 1998)
173 - Introduced automake stuff.
175 Daniel Stenberg (Nov 13, 1998)
176 - Just made a successful GET of a document from an SSL-server using my own
177 private certificate for authentication! The certificate has to be in PEM
178 format. You do that the easiest way (although not *that* easy) by
179 downloading the SSLyeay PKCS#12-patch by Dr Stephen N. Henson from his site
180 at: http://www.drh-consultancy.demon.co.uk/. Using his tool, you can
181 convert any modern Netscape or (even) MSIE certificate to PEM-format. Use
182 it with 'curl -E <certificate:password> https://site.com'. If this isn't a
183 cool feature, then I don't know what cool features look like! ;-)
184 - Working slowly on telnet connections. #define TRY_TELNET to try it out.
185 (curl -u user:passwd "telnet://host.com/cat .login" is one example) I do
186 have problem to define how it should work. The prime purpose for this must
187 be to get (8bit clean) files via telnet, and it really isn't that easy to
188 get files this way. Still having problems with \n being converted to \r\n.
190 Angus Mackay (Nov 12, 1998)
191 - Corrected another bug in the long parameter name parser.
192 - Modified getpass.c (NOTE: see the special licensing in the top of that
195 Daniel Stenberg (Nov 12, 1998)
196 - We may have removed the silly warnings from url.c when compiled under IRIX.
197 Thanks again to Bjorn Reese and Martin Staael.
198 - Wrote formfind.pl which is a new perl script intended to help you find out
199 how a FORM submission should be done. This needs a little more work to get
202 Daniel Stenberg (Nov 11, 1998)
203 - Made the HTTP header-checker accept white spaces before the HTTP/1.? line.
204 Appearantly some proxies/sites add such at times (my test proxy did when I
205 downloaded a gopher page with it)!
206 - Moved the former -h to -M and made -h show the short help text instead. I
207 had to enable a forced help text option. Now an even shorter help text will
208 be presented when an unknown option and similar, is used.
209 - stdcheaders.h didn't work with IRIX 6.4 native cc compiler. I hope my
210 changes don't make other versions go nuts instead.
212 Daniel Stenberg (Nov 10, 1998)
213 - Added a weird check in the configure script to check for the silly AIX
214 warnings about my #define strcasecmp() stuff. I do that define to prevent
215 me and other contributors to accidentaly use that function name instead
217 - I bugfixed Angus's getpass.c very little.
218 - Fixed the verbose flag names to getopt-style, i.e 'curl --loc' will be
219 sufficient instead of --location as "loc" is a unique prefix. Also, anything
220 after a '--' is treated as an URL. So if you do have a host with a weeeird
221 name you can do 'curl -- -host.com'.
222 - Another getopt-adjust; curl now accepts flags after the URL on the command
223 line. 'curl www.foo.com -O' is perfectly valid.
224 - Corrected the .curlrc parser so that strtok() is no longer used and I
225 believe it works better. Even URLs can be specified in it now.
227 Angus Mackay (Nov 9, 1998)
228 - Replaced getpass.c with a newly written one, not under GPL license
229 - Changed OS to a #define in config.h instead of compiler flag
230 - Makefile now uses -DHAVE_CONFIG_H
232 Daniel Stenberg (Nov 9, 1998)
233 - Ok, I expanded the tgz-target to update the version string on each occation
234 I build a release archive!
235 - I reacted on Angus Mackay's initiative and remade the parameter parser to
236 be more getopt compliant. Curl now supports "merged" flags as in
237 curl -lsv ftp.site.com
238 Do note that I had to move three short-names of the options. Parameters
239 that needs an additional string such as -x must be stand-alone or the
240 last in a merged sequence:
241 curl -lsx my-proxy ftp.site.com
242 is ok, but using the flags in a different order like '-lxs' would cause
243 unexpected results (as the 's' option would be skipped).
244 - I've changed the headers in all files that are subject to the MozPL
245 license, as they are supposed to look like when conforming.
246 - Made the configure script make the config.h. The former config.h is now
248 - The RESOURCES and TODO files have been added to the archive.
250 Angus Mackay (Nov 5, 1998)
251 - Fixed getpass.c and various configure stuff
253 Daniel Stenberg (Nov 3, 1998)
254 - Use -H/--header for custom HTTP-headers. Lets you pass on your own
255 specified headers to the remote server. I wouldn't recommend trying to use
256 a header with a defined usage according to standards. Use this flag once
257 for every custom header you want to add.
258 - Use -B/--ftp-ascii to force ftp to use ASCII mode when transfering files.
259 - Corrected the 'getlinks.pl' script, I accidentally left my silly proxy
260 usage in there! Since the introduction of the .curlrc file, it is easier to
261 write scripts that use curl since proxies and stuff should be in the
263 - Introducing the new -F flag for HTTP POST. It supports multipart/form-data
264 which means it is gonna be possible to upload files etc through HTTP POST.
265 Shiraz Kanga asked for the feature and my brother,
266 Björn Stenberg helped me design the user
267 interface for this beast. This feature requires quite some docs,
268 since it has turned out not only quite capable, but also complicated! :-)
269 - A note here, since I've received mail about it. SSLeay versions prior to
270 0.8 will *not* work with curl!
271 - Wil Langford reported a bug that occurred since curl
272 did not properly use CRLF when issuing ftp commands. I fixed it.
273 - Rearranged the order config files are read. .curlrc is now *always* read
274 first and before the command line flags. -K config files then act as
275 additional config items.
276 - Use -q AS THE FIRST OPTION specified to prevent .curlrc from being read.
277 - You can now disable a proxy by using -x "". Useful if the .curlrc file
278 specifies a proxy and you wanna fetch something without going through
280 - I'm thinking of dropping the -p support. Its really not useful since ports
281 could (and should?) be specified as :<port> appended on the host name
282 instead, both in URLs and to proxy host names.
283 - Martin Staael reports curl -L bugs under Windows NT
284 (test with URL http://come.to/scsde). This bug is not present in this
286 - Added support for the weird FTP URL type= thing. You can download a file
287 using ASCII transfer by appending ";type=A" to the right of it. Other
288 available types are type=D for dir-list (NLST) and type=I for binary
289 transfer. I can't say I've ever seen anyone use this kind of URL though!
291 - Troy Engel pointed out a bug in my getenv("HOME")
292 usage for win32 systems. I introduce getenv.c to better cope with
293 this. Mr Engel helps me with the details around that...
294 - A little note to myself and others, I should make the win32-binary built
296 - Ryan Nelson sent me comments about building curl
297 with SSL under FreeBSD. See the Makefile for details. Using the configure
298 script, it should work better and automatically now...
299 - Cleaned up in the port number mess in the source. No longer stores and uses
300 proxy port number separate from normal port number.
301 - 'configure' script working. Confirmed compiles on:
305 SunOS 5.6 no cc (with gcc, it has the "gcc include files" problem)
306 SunOS 4.1.3 no gcc (without ANSI C headers)
307 SunOS 4.1.2 no gcc (native compiler failed)
310 Linux 2.0.35 no gcc (with glibc)
311 IRIX 6.2 no gcc (cc compiles generate a few warnings)
312 IRIX 6.4 no cc (generated warnings though)
316 - Ooops. The 5beta (and 4.10) under win32 failed if the HOME variable wasn't
318 - When using a proxy, curl now guesses and uses the protocol part in cases
320 curl -x proxy:80 www.site.com
321 Proxies normally go nuts unless http:// is prepended to the host name, so
322 if curl is used like this, it guesses protocol and appends the protocol
323 string before passing it to the proxy. It already did this when used
325 - Better port usage with SSL through proxy now. If you specified a different
326 https-port when accessing through a proxy, it didn't use that number
327 correctly. I also rewrote the code that parses the stuff read from the
328 proxy when you wanna connect through it with SSL.
329 - Bjorn Reese helped me work around one of the compiler
330 warnings on IRIX native cc compiles.
332 Version 4.10 (Oct 26, 1998)
334 - John A. Bristor suggested a config file switch,
335 and since I've been having that idea kind of in the background for a long
336 time I rewrote the parameter parsing function a little and now I introduce
337 the -K/--config flag. I also made curl *always* (unless -K is used) try to
338 load the .curlrc file for command line parameters. The syntax for the
339 config file is the standard command line argument style. Details in 'curl
341 - I removed the -k option. Keep-alive isn't really anything anyone would
342 want to enable with curl anyway.
343 - Martin Staael helped me add the 'irix' target. Now
344 "make irix" should build curl successfully on non-gcc SGI machines.
345 - Single switches now toggle behaviours. I.e if you use -v -v the second
346 will switch off the verbose mode the first one enabled. This is so that
347 you can disable a default setting a .curlrc file enables etc.
349 Version 4.9 (Oct 7, 1998)
351 - Martin Staael suggested curl would support cookies.
352 I added -b/--cookie to enable free-text cookie data to be passed. There's
353 also a little blurb about general cookie stuff in the README/help text.
354 - dmh <dmh at jet.es> suggested HTTP resume capabilities. Although you could
355 manually get curl to resume HTTP documents, I made the -c resume flag work
356 for HTTP too (unless -r is used too, which would be very odd anyway).
357 - Added checklinks.pl to the archive. It is a still experimental perl script
358 that checks all links of a web page by using curl.
359 - Rearranged the archive hierarchy a little. Build the executable in the
360 src/ dir from now on!
361 - Version 4.9 and hereafter, is no longer released under the GPL license.
362 I have now updated the LEGAL file etc and now this is released using the
363 Mozilla Public License to avoid the plague known as "the GPL virus". You
364 must make the source available if you decide to change and/or redistribute
365 curl, but if you decide to use curl within something else you do not need
366 to offer the world the source to that too.
367 - Curl did not like HTTP servers that sent no headers at all on a GET
368 request. It is a violation of RFC2068 but appearantly some servers do
369 that anyway. Thanks to Gordon Beaton for the report!
370 - -L/--location was added after a suggestion from Martin Staael. This makes
371 curl ATTEMPT to follow the Location: redirect if one is present in the HTTP
372 headers. If -i or -I is used with this flag, you will see headers from all
373 sites the Location: points to. Do note that the first server can point to a
374 second that points to a third etc. It seems the Location: parameter (said
375 to be an AbsoluteURI in RFC2068) isn't always absolute.. :-/ Anyway, I've
376 made curl ATTEMPT to do the best it can to deal with the reality.
377 - Added getlinks.pl to the archive. getlinks.pl selectively downloads
378 files that a web page links to.
382 - As Julian Romero Nieto reported, curl reported wrong version number.
383 - As Teemu Yli-Elsila pointed out, the win32 version of 4.8 (and probably all
384 other versions for win32) didn't work with binary files since I'm too used
385 to the UNIX style fopen() where binary and text don't differ...
386 - Ralph Beckmann brought me some changes that lets curl compile error and
387 warning free with -Wall -pedantic with g++. I also took the opportunity to
388 clean off some unused variables and similar.
389 - Ralph Beckmann made me aware of a really odd bug now corrected. When curl
390 read a set of headers from a HTTP server, divided into more than one read
391 and the first read showed a full line *exactly* (i.e ending with a
392 newline), curl did not behave well.
396 - I was too quick to release 4.8.2 with too little testing. One of the
397 changes is now reverted slightly to the 4.8.1 way since 4.8.2 couldn't
398 upload files. I still think both problems corrected in 4.8.2 remain
399 corrected. Reported by Julian Romero Nieto.
403 - Bernhard Iselborn reported two FTP protocol errors curl did. They're now
404 corrected. Both appeared when getting files from a MS FTP server! :-)
408 - Added a last update of the progress meter when the transfer is done. The
409 final output on the screen didn't have to be the final size transfered
410 which made it sometimes look odd.
411 - Thanks to David Long I got rid of a silly bug that happened if a HTTP-page
412 had nothing but header. Appearantly Solaris deals with negative sizes in
413 fwrite() calls a lot better than Linux does... =B-]
417 - Continue FTP file transfer. -c is the switch. Note that you need to
418 specify a file name if you wanna resume a download (you can't resume a
419 download sent to stdout). Resuming upload may be limited by the server
420 since curl is then using the non-RFC959 command SIZE to get the size of
421 the target file before upload begins (to figure out which offset to
422 use). Use -C to specify the offset yourself! -C is handy if you're doing
423 the output to something else but a plain file or when you just want to get
425 - recursiveftpget.pl now features a maximum recursive level argument.
429 - Added support to abort a download if the speed is below a certain amount
430 (speed-limit) bytes per second for a certain (speed-time) time.
431 - Wrote a perl script 'recursiveftpget.pl' to recursively use curl to get a
432 whole ftp directory tree. It is meant as an example of how curl can be
433 used. I agree it isn't the wisest thing to do to make a separate new
434 connection for each file and directory for this.
438 - Added a first attempt to optionally parse the .netrc file for login user
439 and password. If used with http, it enables user authentication. -n is
441 - Removed the extra newlines on the default user-agent string.
442 - Corrected the missing ftp upload error messages when it failed without the
443 verbose flag set. Gary W. Swearingen found it.
444 - Now using alarm() to enable second-precision timeout even on the name
445 resolving/connecting phase. The timeout is although reset after that first
446 sequence. (This should be corrected.) Gary W. Swearingen reported.
447 - Now spells "Unknown" properly, as in "Unknown option 'z'"... :-)
448 - Added bug report email address in the README.
449 - Added a "current speed" field to the progress meter. It shows the average
450 speed the last 5 seconds. The other speed field shows the average speed of
451 the entire transfer so far.
455 - SSL through proxy fix
456 - Added -A to allow User-Agent: changes
459 - Made the -A work when SSL-through-proxy.
463 - More SSL corrections
464 - I've added a port to AIX.
465 - running SSL through a proxy causes a chunk of code to be executred twice.
466 one of those blocks needs to be deleted.
469 - Made -i and -I work again
473 - -x can now also specify proxyport when used as in 'proxyhost:proxyport'
478 - Adjusted to compile under win32 (VisualC++ 5). The -P switch does not
479 support network interface names in win32. I couldn't figure out how!
482 Linas Vepstas / Sampo Kellomaki
483 - Added SSL / SSLeay support (https://)
484 - Added the -T usage for HTTP POST.
487 - Bugfixed the SSL implementation.
488 - Made -P a lot better to use other IP addresses. It now accepts a following
489 parameter that can be either
490 interface - i.e "eth0" to specify which interface's IP address you
492 IP address - i.e "192.168.10.1" to specify exact IP number
493 host name - i.e "my.host.domain" to specify machine
494 "-" - (any single-letter string) to make it pick the machine's
496 - The Makefile is now ready to compile for solaris, sunos4 and linux right
498 - Better generated version string seen with 'curl -V'
502 - The IP number returned by the ftp server as a reply to PASV does no longer
503 have to DNS resolve. In fact, no IP-number-only addresses have to anymore.
504 - Binds better to available port when -P is used.
505 - Now LISTs ./ instead of / when used as in ftp://ftp.funet.fi/. The reason
506 for this is that exactly that site, ftp.funet.fi, does not allow LIST /
507 while LIST ./ is fine. Any objections?
509 Version 4 (1998-03-20)
511 - I took another huge step and changed both version number and project name!
512 The reason for the new name is that there are just one too many programs
513 named urlget already and this program already can a lot more than merely
514 getting URLs, and the reason for the version number is that I did add the
515 pretty big change in -P and since I changed name I wanted to start with
517 - The --style flags are working better now.
518 - Listing directories with FTP often reported that the file transfer was
519 incomplete. Wrong assumptions were too common for directories, why no
520 size will be attempted to get compared on them from now on.
521 - Implemented the -P flag that let's the ftp control issue a PORT command
522 instead of the standard PASV.
523 - -a for appending FTP uploads works.
525 ***************************************************************************
527 Version 3.12 (14 March 1998)
529 - End-of-header tracking still lacked support for \r\n or just \n at the
530 end of the last header line.
532 - Added PROXY authentication.
534 - Fixed some little bugs.
538 - The header parsing was still not correct since the 3.2 modification...
542 - 3.7 and 3.9 were simultaneously developed and merged into this version.
543 - FTP upload did not work correctly since 3.2.
547 - Added the "-e <url> / --referer <url>" option where we can specify
548 the referer page. Obviously, this is necessary only to fool the
553 - Now checks the last error code sent from the ftp server after a file has
554 been received or uploaded. Wasn't done previously.
555 - When 'urlget <host>' is used without a 'protocol://' first in the host part,
556 it now checks for host names starting with ftp or gopher and if it does,
557 it uses that protocol by default instead of http.
561 - Silly mistake made the POST bug. This has now also been tested to work with
566 - Highly inspired by Rafael Sagula's changes to the 3.1 that added an almost
567 functional POST, I applied his changes into this version and made them work.
568 (It seems POST requires the Content-Type and Content-Length headers.) It is
569 now usable with the -d switch.
572 Passed to avoid confusions
576 - Major rewrite of two crucial parts of this code: upload and download.
577 They are both now using a select() switch, that allows much better
578 progress meter and time control.
579 - alarm() usage removed completely
580 - FTP get can now list directory contents if the path ends with a slash '/'.
581 Urlget on a ftp-path that doesn't end with a slash means urlget will
582 attempt getting it as a file name.
583 - FTP directory view supports -l for "list-only" which lists the file names
585 - All operations support -m for max time usage in seconds allowed.
586 - FTP upload now allows the size of the uploaded file to be provided, and
587 thus it can better check it actually uploaded the whole file. It also
588 makes the progress meter for uploads much better!
589 - Made the parameter parsing fail in cases like 'urlget -r 900' which
590 previously tried to connect to the host named '900'.
594 - Pointed out how to correct the 3 warnings in win32-compiles.
597 - Removed all calls to exit().
598 - Made the short help text get written to stdout instead of stderr.
599 - Made this file instead of keeping these comments in the source.
600 - Made two callback hooks, that enable external programs to use urlget()
601 easier and to grab the output/offer the input easier.
602 - It is evident that Win32-compiles are painful. I watched the output from
603 the Borland C++ v5 and it was awful. Just ignore all those warnings.
607 - Added FTP upload capabilities. The name urlget gets a bit silly now
608 when we can put too... =)
609 - Restructured the source quite a lot.
610 Changed the urlget() interface. This way, we will survive changes much
611 better. New features can come and old can be removed without us needing
612 to change the interface. I've written a small explanation in urlget.h
614 - New flags include -t, -T, -O and -h. The -h text is generated by the new
619 - Added a fix to make it compile smoothly on Amiga using the SAS/C
623 - Believe it or not, but the STUPID Novell web server seems to require
624 that the Host: keyword is used, so well I use it and I (re-introduce) the
625 urlget User-Agent:. I still have to check that this Host: usage works with
626 proxies... 'Host:' is required for HTTP/1.1 GET according to RFC2068.
630 - some little modifications
634 - Removed the -l option and introduced the -f option instead. Now I'll
635 rewrite the former -l kludge in an external script that'll use urlget to
636 fetch multipart files like that.
637 - '-f' is introduced, it means Fail without output in case of HTTP server
638 errors (return code >=300).
639 - Added support for -r, ranges. Specify which part of a document you
640 want, and only that part is returned. Only with HTTP/1.1-servers.
641 - Split up the source in 3 parts. Now all pure URL functions are in
642 urlget.c and stuff that deals with the stand-alone program is in main.c.
643 - I took a few minutes and wrote an embryo of a README file to explain
648 - Made the -l (loop) thing use the new CONF_FAILONERROR which makes
649 urlget() return error code if non-successful. It also won't output anything
650 then. Now finally removed the HTTP 1.0 and error 404 dependencies.
651 - Added -I which uses the HEAD request to get the header only from a
656 - Made the progress meter use HHH:MM:SS instead of only seconds.
660 - Added progress meter. It appears when downloading > BUFFER SIZE and
661 mute is not selected. I found out that when downloading large files from
662 really really slow sites, it is desirable to know the status of the
663 download. Do note that some downloads are done unawaring of the size, which
664 makes the progress meter less thrilling ;) If the output is sent to a tty,
665 the progress meter is shut off.
666 - Increased buffer size used for reading.
667 - Added length checks in the user+passwd parsing.
668 - Made it grok user+passwd for HTTP fetches. The trick is to base64
669 encode the user+passwd and send an extra header line. Read chapter 11.1 in
670 RFC2068 for details. I added it to be used just like the ftp one. To get a
671 http document from a place that requires user and password, use an URL
674 http://user:passwd@www.site.to.leach/doc.html
676 I also added the -u flag, since WHEN USING A PROXY YOU CAN'T SPECIFY THE
677 USER AND PASSWORD WITH HTTP LIKE THAT. The -u flag works for ftp too, but
678 not if used with proxy. To do the same as the above one, you can invoke:
680 urlget -u user:passwd http://www.site.to.leach/doc.html
684 - Added "-o" option (output file)
685 - Added URG_HTTP_NOT_FOUND return code.
687 Perhaps we should detect all kinds of errors and instead of writing that
688 custom string for the particular 404-error, use the error text we actually
689 get from the server. See further details in RFC2068 (HTTP 1.1
690 definition). The current way also relies on a HTTP/1.0 reply, which newer
691 servers might not do.
692 - Looping mode ("-l" option). It's easier to get various split files.
694 Use it like 'urlget -l 1 http://from.this.site/file%d.html', which will
695 make urlget to attempt to fetch all files named file1.html, file2.html etc
696 until no more files are found. This is only a modification of the
697 STAND_ALONE part, nothing in the urlget() function was modfified for this.
699 - Changed the -h to be -i instead. -h should be preserved to help use.
700 - Bjorn Reese indicated that Borland _might_ use '_WIN32' instead of the
701 VC++ WIN32 define and therefore I added a little fix for that.
705 - The urlget function didn't set the path to url when using proxy.
706 - Fixed bug with IMC proxy. Now using (almost) complete GET command.
709 - Made it compile on Solaris. Had to reorganize the includes a bit.
710 (so Win32, Linux, SunOS 4 and Solaris 2 compile fine.)
711 - Made Johan's keepalive keyword optional with the -k flag (since it
712 makes a lot of urlgets take a lot longer time).
713 - Made a '-h' switch in case you want the HTTP-header in the output.
716 Daniel Stenberg and Kjell Ericson
718 - No more global variables
719 - Mute option (no output at all to stderr)
720 - Full range of return codes from urlget(), which is now written to be a
721 function for easy-to-use in [other] programs.
722 - Define STAND_ALONE to compile the stand alone urlget program
723 - Now compiles with gcc options -ansi -Wall -pedantic ;)
726 - Introducing ftp GET support. The FTP URL type is recognized and used.
727 - Renamed the project to 'urlget'.
728 - Supports the user+passwd in the FTP URL (otherwise it tries anonymous
729 login with a weird email address as password).
733 - The skip_header() crap messed it up big-time. By simply removing that
734 one we can all of a sudden download anything ;)
735 - No longer requires a trailing slash on the URLs.
736 - If the given URL isn't prefixed with 'http://', HTTP is assumed and
738 - 'void main()' is history.
742 - The gopher source used the ppath variable instead of path which could
747 - Well, I added a lame text about the time it took to get the data. I also
748 fought against Johan to prevent his -f option (to specify a file name
749 that should be written instead of stdout)! =)
750 - Made it write 'connection refused' for that particular connect()
752 - Renumbered the version. Let's not make silly 1.0.X versions, this is
757 - Discovered and fixed the problem with getting binary files. puts() is
758 now replaced with fwrite(). (Daniel's note: this also fixed the buffer
759 overwrite problem I found in the previous version.)
762 - Let "-p" before "-x".
765 - Bugfixed the proxy usage. It should *NOT* use nor strip the port number
766 from the URL but simply pass that information to the proxy. This also
767 made the user/password fields possible to use in proxy [ftp-] URLs.
768 (like in ftp://user:password@ftp.my.site:8021/README)
771 - Implemented HTTP proxy support.
772 - Receive byte counter added.
775 - Implemented URLs (and skipped the old syntax).
776 - Output is written to stdout, so to achieve the above example, do:
777 httpget http://143.54.10.6/info_logo.gif > test.gif
781 - Adjusted it slightly to accept named hosts on the command line. We
782 wouldn't wanna use IP numbers for the rest of our lifes, would we?
786 - Wrote the initial httpget, which started all this!