Curl multiple URLs

October 23rd, 2006 toydi Posted in curl, Network, xargs | Hits: 87600 | 5 Comments »

A previous post talked about the usage of curl to request a single URL and display its response header fields. It’s good to know that curl also accepts multiple URLs as arguments.

To display response header information of several URLs:

curl -I http://linuxbyexample.co.nr http://lne.blogdns.com/lbe

When there is a long URL list in a file, use xargs instead:

xargs curl -I < url-list.txt
Related Posts
sending HTTP POST using curl command
Recently I was having fun with libcurl, discovered that with curl command I capable of doing HTTP POST with specified Us...

using curl to access ftp server
The title doesn't sound interesting if you have no idea what is curl. Why we need to use curl to access ftp server, if w...

What is my Public IP Address?
What is my public IP address? There is a lots of website can provide you the information. What if I wanna grep it for my...

5 Responses to “Curl multiple URLs”

  1. ry Says:
    February 16th, 2013 at 7:58 am

    xargs: unterminated quote

  2. mithril knight Says:
    March 6th, 2015 at 3:36 am

    around two years later but.

    write the urls with ”

    “http://page1.com”
    “http://page2.com”
    “http://page3.com”

    and so on.

  3. www.ie.kmutnb.ac.th Says:
    March 11th, 2016 at 2:41 am

    Wow, this story is good my sister namely analyzing these kinds of things, so I am going apt let know her.

  4. www.kingid.ee Says:
    March 14th, 2016 at 1:03 am

    Obviously lofty resolution movie quality includes much memory, that why it gives you improved quality.

  5. Rebecca Bextel Mountain Business Center Says:
    March 2nd, 2017 at 10:45 am

    de wordpress org plugins thinkermedia cross posting

Leave a Reply