Skip to main content

MapReduce

Google's MapReduce is a new parallelism framework for processing large amounts of data. Some recommended links are:
Labels:

Comments

  1. alopatenkoApril 30, 2010 at 9:47 PM

    Hey Alex
    you may like this book about about large scale text processing with mapreduce
    http://www.umiacs.umd.edu/~jimmylin/book.html

    ReplyDelete
  2. Alex ThomoMay 2, 2010 at 8:39 AM

    Thanks, Andrei. Seems very good book.

    ReplyDelete

Post a Comment

Popular posts from this blog

Latent Semantic Analysis Tutorial

I wrote a tutorial on Latent Semantic Analysis (LSA). It can be accessed by following this link . I believe LSA is a very interesting method for ranking documents in response to a query. LSA is a method for discovering hidden concepts in document data. Each document and term (word) is expressed as a vector with elements corresponding to these concepts. Each element in a vector gives the degree of participation of the document or term in the corresponding concept. The goal is not to describe the concepts verbally, but to be able to represent the documents and terms in a unified way for exposing document-document, document-term, and term-term similarities or semantic relationship which are otherwise hidden. An Example Suppose we have the following set of five documents d1 : Romeo and Juliet. d2 : Juliet: O happy dagger! d3 : Romeo died by dagger. d4 : “Live free or die”, that’s the New-Hampshire’s motto. d5 : Did you know, New-Hampshire is in New-England. and search query: dies , dagger ...
7 comments
Read more

Sanctuary Sneakers

Sanctuary Sneakers is a local early-stage startup that aggregates and leverages all available sneaker data in one place to compare prices and reveal the best deals. Their web app digs up real-time prices, inventory, and more information for both new & used sneakers from the most popular online marketplaces and stores so you don't have to! It is a perfect example of data integration from different disparate data sources. Check them out at https://sanctuarysneakers.com
Post a Comment
Read more

SQLite Musicbrainz database

Here is a rar file with a stripped down SQLite Musicbrainz database. The compressed file is about 700 MB, so it will take around 10 min to download with a good connection. This database is for educational purposes. I have not deleted tuples from the main tables, just removed some columns and tables I thought weren't necessary to experience and understand the data. Here is a database schema diagram  and a file with create table statements and explanatory comments. Also here is a Toad data model . The raw data used for the database was downloaded from Musicbrainz on Oct 14, 2012.  
1 comment
Read more