Real Time Search with Lucene

Lucene has for a while already a nice feature that we call "Near-realtime search" (NRT). The approach works well for a lot of applications, but we're currently working on an even better real-time solution in Lucene: directly searching IndexWriter's RAM buffer while documents are being added! This will dramatically improve indexing performance compared to NRT, and the search latency (the time it takes for a document to become searchable) will shrink to a minimum - hence we will scratch the N in NRT!

Not many real-time search engines in the world have a higher query load than Twitter search! We'll look into some early performance numbers from a Twitter prototype using Lucene and the new RT technology.