Comments on: Fetch and Parse HTML Web Page Content From Bash. Wow. http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/ Matt Wynne taking it one tea at a time Fri, 27 Jan 2012 08:31:34 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Wim http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/comment-page-1/#comment-1235 Wim Thu, 17 Feb 2011 18:59:20 +0000 http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/#comment-1235 <p>Great stuff, it was exactly what I needed for a script I am working on wright now!</p> <p>see: http://forum.nedlinux.nl/viewtopic.php?pid=354120#p354120</p> Great stuff, it was exactly what I needed for a script I am working on wright now!

see: http://forum.nedlinux.nl/viewtopic.php?pid=354120#p354120

]]> By: Eoin McCarthy http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/comment-page-1/#comment-834 Eoin McCarthy Mon, 19 Oct 2009 01:19:03 +0000 http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/#comment-834 <p>Great stuff! I have to admit I wasn't aware of curl before. However I couldn't track down w3m for the mac and ended up downloading lynx instead. </p> <p>lynx --dump gives you very similar results.</p> Great stuff! I have to admit I wasn’t aware of curl before. However I couldn’t track down w3m for the mac and ended up downloading lynx instead.

lynx –dump gives you very similar results.

]]> By: Pete http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/comment-page-1/#comment-820 Pete Mon, 05 Oct 2009 06:39:34 +0000 http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/#comment-820 <p>Geez... my formatting is horrible...</p> <p>On the *nix boxes... I got the scripts combined... Windows.... well... uhhh.... batch files have lost their appeal many moon's ago.</p> Geez… my formatting is horrible…

On the *nix boxes… I got the scripts combined… Windows…. well… uhhh…. batch files have lost their appeal many moon’s ago.

]]> By: Pete http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/comment-page-1/#comment-819 Pete Mon, 05 Oct 2009 06:36:56 +0000 http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/#comment-819 <p>Well there are a few things you can do with with curl, w3m, html2text</p> <p>Currently I have a few things in my bag o' scripts:</p> <p>1) Command line wikipedia script 2) Zipcode look up script 3) NPA IE: Area code lookup script (telco thing) 4) NPA-NXX Area code and prefix lookup script. (telco thing) 5) NPA-NXX-XXXX phone number lookup script. (telco thing). 6) Dictionary lookup script using curl. Since curl understands the dict protocol. 5) acronyms lookup script (curl again) 6) soundslike script that looks words up in the soundex database (helps for misspelled words that your word processor or text editor doesn't catch.</p> <p>Ahhhh what the heck; here is the windows version of curl with the dictionary script:</p> <p>curl -s dict://dict.org/d:%1:gcide & curl. -s dict://dict.org/d:%1:wn & curl. -s dict://dict.org/d:%1:web1913 &</p> <p>Replace the %1 on windows to a $1 in OSX, Linux, BSD, Solaris and your golden.</p> <p>Here is the scripts for the soundex database (IE: word sounds like):</p> <p>curl.-s dict://dict.org/m:%1::soundex curl. -s dict://dict.org/m:%1::soundex:1</p> <p>Script for a thesaurus</p> <p>curl. -s dict://dict.org/d:%1:moby-thes</p> <p>check out dict.org for the protocol and a list of database that they have accessible to the public.</p> <p>Here is the script for the wiktionary look up script. Check out the database to see what other data formats can be outputted. Text, html, etc. Wikitionary is dictionary side of the house of Wikipedia. They are making a free dictionary.</p> <p>curl. -s dict://dict.hewgill.com/d:%1:en-brief &</p> <p>curl --manual | grep dict</p> <p>Don't forget to read the RFC on the dict protocol. </p> <p>I would post the others but those scripts are quite long and their on my nix boxes.</p> <p>PS: You can use the dump option in w3m and look into the column option . On a related note; check out "html2text" Options -ascii -style pretty</p> <p>html2text is part curl and part w3m. More options exist when using curl and html2text, than html2text alone.</p> <p>PSS: Good luck on your job search. Regards.</p> Well there are a few things you can do with with curl, w3m, html2text

Currently I have a few things in my bag o’ scripts:

1) Command line wikipedia script 2) Zipcode look up script 3) NPA IE: Area code lookup script (telco thing) 4) NPA-NXX Area code and prefix lookup script. (telco thing) 5) NPA-NXX-XXXX phone number lookup script. (telco thing). 6) Dictionary lookup script using curl. Since curl understands the dict protocol. 5) acronyms lookup script (curl again) 6) soundslike script that looks words up in the soundex database (helps for misspelled words that your word processor or text editor doesn’t catch.

Ahhhh what the heck; here is the windows version of curl with the dictionary script:

curl -s dict://dict.org/d:%1:gcide & curl. -s dict://dict.org/d:%1:wn & curl. -s dict://dict.org/d:%1:web1913 &

Replace the %1 on windows to a $1 in OSX, Linux, BSD, Solaris and your golden.

Here is the scripts for the soundex database (IE: word sounds like):

curl.-s dict://dict.org/m:%1::soundex curl. -s dict://dict.org/m:%1::soundex:1

Script for a thesaurus

curl. -s dict://dict.org/d:%1:moby-thes

check out dict.org for the protocol and a list of database that they have accessible to the public.

Here is the script for the wiktionary look up script. Check out the database to see what other data formats can be outputted. Text, html, etc. Wikitionary is dictionary side of the house of Wikipedia. They are making a free dictionary.

curl. -s dict://dict.hewgill.com/d:%1:en-brief &

curl –manual | grep dict

Don’t forget to read the RFC on the dict protocol.

I would post the others but those scripts are quite long and their on my nix boxes.

PS: You can use the dump option in w3m and look into the column option . On a related note; check out “html2text” Options -ascii -style pretty

html2text is part curl and part w3m. More options exist when using curl and html2text, than html2text alone.

PSS: Good luck on your job search. Regards.

]]> By: David http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/comment-page-1/#comment-476 David Sun, 15 Mar 2009 02:47:13 +0000 http://blog.mattwynne.net/2008/04/26/fetch-and-parse-html-web-page-content-from-bash-wow/#comment-476 <p>Awesome sauce thanks buddy :)</p> Awesome sauce thanks buddy :)

]]>