VAST InsightEngine is an application that runs in VAST DataEngine whereby

  • Data is written into VAST DataStore through any of its interfaces (file, object, …)
  • An event is generated in VAST DataEngine which triggers a function in [VAST|VAST DataEngine]
  • The function generates embeddings for the data that was just ingested using NIM
  • The embeddings are inserted into VAST’s integrated vector database

Once indexed (which is near real-time), an inferencing application can perform RAG against the data.