MarbleFlows is an open-source software application designed to optimize vector search in Language Model (LLM) related applications. It features a user-friendly interface equipped with advanced Natural Language Processing (NLP) cleansing techniques like TF-IDF, normalize, and enrich your embedding tokens. Notably, MarbleFlows offers a means to intelligently split or merge content based on its structure, adding void or hidden tokens to make the chunks semantically coherent.
