Bloom Filters

are a data structure that can be used to compactly represent a very large set of items. Rapleaf released a Ruby library.