write a online manga downloader using bash

November 29th, 2007 mysurface

There are plenty of site that allows you to read manga online, but you have to tolerate for the slow access and ton’s of heavy loaded ads. You can’t download the manga directly using batch download provided by wget or any download manager. but if you know how to do bash script, you could somehow [...]

Posted in Bash, seq, Text Manipulation, wget | Hits: 84732 | 9 Comments »

What is my Public IP Address?

August 22nd, 2007 mysurface

What is my public IP address? There is a lots of website can provide you the information. What if I wanna grep it for my script? We can use curl and grep for this purpose. First, lets pick few websites that provide the service to reveal my public IP. http://www.ipchicken.com/ – the chicken looks so [...]

Posted in curl, egrep, grep, Misc, Text Manipulation, wget | Hits: 115224 | 15 Comments »

how to wget flv from youtube

August 1st, 2007 mysurface

To strip flv from youtube links, you have to complete two steps. Firstly extract the encrypted string from a youtube link, next append to get_video.php and download through wget. The youtube links, that people distribute around will looks something like below http://www.youtube.com/watch?v=B6fnR–IDKc Step one, download it and extract the encrypted strings using grep. wget -O [...]

Posted in Network, wget | Hits: 126383 | 41 Comments »

wget files based on the links in a file.

October 3rd, 2006 mysurface

Let say I store all my links into a file call url2dl.txt and separate each link by newline. I can do this wget -i url2dl.txt This is a short example, actually I think of put it in as comment of post xargs use stardard output as parameter for another command But i think a new [...]

Posted in Network, wget | Hits: 37213 | 1 Comment »

xargs use stardard output as parameter for another command

October 2nd, 2006 mysurface

xargs is a command line of findutils package. It is not so common for new user, but it is a very useful tools, let me pick an example to show the usage. Bare in mind, xargs is a kind of combo command use together with other command through pipeline. I have a list of links [...]

Posted in cat, pipeline, Text Manipulation, wget, xargs | Hits: 60242 | 10 Comments »

Performs a batch download using wget

July 31st, 2006 mysurface

If I want to download all files in a directory of a website, i have to perform a long wget command, they is what I do at first: wget -nd -r -l1 –no-parent http://www.foo.com/mp3/ This works fine, but sometimes it gives some silly index.@xx files that wish I do not want. To make your directory [...]

Posted in Network, wget | Hits: 114978 | 11 Comments »

wget, a powerful downloader

July 31st, 2006 mysurface

If you think wget is only a command line downloader, you are wrong. wget is capable of doing a lots of download. Bellow I gonna show few simple examples: Let say you want to download a file from a site. wget http://www.dummy.com/foo.tar.gz Sometimes lost connection might be happen in the middle of downloads, can I [...]

Posted in Network, wget | Hits: 101048 | 3 Comments »