Navigation

ADS specializes in using Ruby on Rails to build advanced, scalable, database-backed web sites for organizations of all sizes. Find out more at our website.

Atlantic Dominion Solutions
Feb
04
2008

Using Amazon S3, EC2, SQS, Lucene, and Ruby for Web Spidering

By: Robert Dempsey | Tags:

Web Spidering Article

My last article for the Amazon Web Services Developer Connection was a how-to on creating a web spider using Ruby, Rails, Amazon S3, Amazon EC2, Amazon SQS, and then making it all searchable using Lucene. If you are wondering how to make that happen, check out the article: Using Amazon S3, EC2, SQS, Lucene, and Ruby for Web Spidering.

Share this post

Other posts you may enjoy

You can leave a response, or trackback from your own site.

Print This Post Print This Post

2 Responses to “Using Amazon S3, EC2, SQS, Lucene, and Ruby for Web Spidering”

On February 5th, 2008 at 3:12 am Pages tagged "amazon" said:

[...] bookmarks tagged amazon Using Amazon S3, EC2, SQS, Lucene, and Ruby for We… saved by 5 others     NataoDoidao bookmarked on 02/05/08 | [...]

On February 7th, 2008 at 7:33 am Rails Podcast Brasil - Episódio 4 said:

[...] Using Amazon S3, EC2, SQS, Lucene, and Ruby for Web Spidering [...]

Leave a Reply