I was working on getting the Cewl tool by digininja working, but had a number of troubles with Ruby. This was a virgin ubuntu 8.10 system.
The solution was found here -> http://intertwingly.net/blog/2008/11/23/RubyGems-1-3-1-on-Ubuntu-8-10
I finally got the Ruby upgraded and all the appropriate gems installed. I tested out the cewl.rb tool against a couple of sites.
root@prd-xxx-xxxxx:~/cewl# ./cewl.rb http://www.xyztest.x –email –meta –depth 4
0a4
CompanyName
XYZ
UUT
ZZZ
uvv
Email addresses found
Meta data found
I’m still a bit unsure about the meta data and email functionality, but the rest of it worked like a charm.