Search results

There are so many search engines around like intelx, stealseek etc all ingesting over billions of records. I want to know how do they ingest it where do they store the data for such fast retrieval. Even when locally going through logs files with maybe 700 million records it takes a good while...