Vivek Ramachandran Posted February 22, 2009 Share Posted February 22, 2009 With billions of webpages out there on the web, it is somewhat interesting to see how one can mine them systematically and analyze them. This video is a programming guide to creating a very simple web crawler which can mine the web and extract content from the HTML file using a DOM parser. The video is a get started guide for beginner and intermediate programmers who would like to explore data mining possibilites over the WWW. http://securitytube.net/Crawling-the-Web-f...ofit-video.aspx Quote Link to comment Share on other sites More sharing options...
DingleBerries Posted February 22, 2009 Share Posted February 22, 2009 Thank you for this man. I have wanted to, but never found the motivation, to start doing some steg detecting. Just crawl for images and at a later time run them threw steg detect. Once again thanks for the tut. Quote Link to comment Share on other sites More sharing options...
SomethingToChatWith Posted February 22, 2009 Share Posted February 22, 2009 Awesome... always wondered how one would go about creating a crawler. Quote Link to comment Share on other sites More sharing options...
gcninja Posted February 22, 2009 Share Posted February 22, 2009 Sweet! this would make a good segment (also this guy sounds like my MS xbox support guy, lol jkjk) Quote Link to comment Share on other sites More sharing options...
Vivek Ramachandran Posted February 23, 2009 Author Share Posted February 23, 2009 Thanks All! I am glad you liked the video! I have created a followup video on how to store all this data into a database for future analysis. Its available as a separate post http://hak5.org/forums/index.php?showtopic=12122 Quote Link to comment Share on other sites More sharing options...
Keiyentai Posted February 24, 2009 Share Posted February 24, 2009 Awesome vid and site man. Kudos. Quote Link to comment Share on other sites More sharing options...
lopez1364 Posted February 24, 2009 Share Posted February 24, 2009 Nice work. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.