Language Selection

English French German Italian Portuguese Spanish

CLI Magic: Use cURL to measure Web site statistics

Filed under
HowTos

cURL is a handy command-line network tool whose name stands for "client for URLs," but think of it as a "copy for URLs" -- it can copy to or from a given URL in any of nine different protocols.

Although cURL is sometimes misconceived as an updated wget, that's wrong. The two utilities do share some features and options, but are distinctly different tools; wget is for downloading files from the Web, and is best used to mirror entire sites or parts of sites -- which is something that cURL alone can't do.

cURL's job is to copy data to or from a given set of URLs; along with HTTP it recognizes the FTP, TFTP, GOPHER, TELNET, DICT, LDAP, FILE, HTTPS, and FTPS protocols. Other features include support for proxies, forms, cookies, SSL, client-side certificates, URL globbing, and very large files. Along with the curl command-line tool is a counterpart library, libcurl, that you can use to get cURL's functionality from within your own programs.

You can do a lot of neat tricks with curl. Here's a look at how you can copy to and from URLs, and then use cURL's reporting facilities to get simple Web server metrics from your operations.

Full Story.

More in Tux Machines

LILO Boot-Loader Development To Cease At End Of Year

While most of you probably haven't used the LILO bootloader in years in place of GRUB(2), the developer of "LInux LOader" intends to cease development at the end of the year. This summer's intern, Eric Griffith, pointed out today an undated message on the LILO homepage about the bootloader project planning to end development at the end of 2015. Read more

Systemd Takes Over su, FCC Bans Open Source Firmware

Paul Carroty posted Friday of the news that Lennart Poettering merged an 'su' command replacement into systemd and Fedora Rawhide - coming to a Linux system near you next. Elsewhere, Hackaday.com's Brian Benchoff said new FCC regulations just killed Open Source firmware replacement and Phoronix.com today reported that LILO is being abandoned. Several polls caught my eye today as did the new Linux workstation security checklist. Read more

Accelerating Scientific Analysis with the SciDB Open Source Database System

Science is swimming in data. And, the already daunting task of managing and analyzing this information will only become more difficult as scientific instruments — especially those capable of delivering more than a petabyte (that’s a quadrillion bytes) of information per day — come online. Tackling these extreme data challenges will require a system that is easy enough for any scientist to use, that can effectively harness the power of ever-more-powerful supercomputers, and that is unified and extendable. This is where the Department of Energy’s (DOE) National Energy Research Scientific Computing Center’s (NERSC’s) implementation of SciDB comes in. Read more

Open Source GPU now out

Hoping that MIAOW is not a catastrophe An open saucy general-purpose graphics processor (GPGPU) has been unveiled at the Hot Chips event. The GPGPU is relatively crude and is part of another piece of an emerging open-source hardware platform called MIAOW. Read more Also: Nvidia Linux Video Driver 355.11 Adds Experimental OpenGL Support to EGL