DEV Community

Discussion on: How Abstraction Can Be a Useful yet Painful Concept, Especially for Beginners

Collapse
 
newfront profile image
Scott Haines

Lars. ElasticSearch runs off of a core technology called Lucene. The thing that makes your search so powerful is due to the reverse index. This creates a powerful sparse matrix of zero and ones with respect to each records fields within a specific index (seen via index pattern in Kibana if using KSQL). The search is able to perform quickly by doing distributed linear algebra (matrix math) so each data node in your cluster can return a partial search back to the front nodes where the zeros and ones match the query and then the front nodes will do a final aggregation / and any post filtering necessary. That is the basics. If you are even more interested you should read about the gossip protocol and NewSQL databases since there is some overlap there in terms of linear scalability within a cluster and what happens when a data node is lost.

Collapse
 
suckup_de profile image
Lars Moelleken

Thanks for the reply, do you know a good book about that topics?

Collapse
 
devanghingu profile image
Devang Hingu

bro.. you didn't understand @suckup_de 's topics.. @suckup_de You are great.!!!

Thread Thread
 
newfront profile image
Scott Haines

Just trying to help. I'm new to this site

Thread Thread
 
suckup_de profile image
Lars Moelleken

@newfront "bro"... I think you are the person how understand me, because you respond with a helpful comment, so thanks for that. :)