Grow your YouTube views, likes and subscribers for free
Get Free YouTube Subscribers, Views and Likes

Semantic Chunking for RAG

Follow
AI Makerspace

In this event, we’ll learn how the semantic chunking algorithm works! Text is split into sentences that are converted vectors through an embedding model. Similarity is measured between each pair of consecutive sentences. If sentences are too similar, as defined by a threshold, additional chunks are created. We can ensure that if any two consecutive sentences are too different from one another, additional chunks can be created. In theory, this will allow us to achieve better results during retrieval within our RAG system.


Event page: https://lu.ma/chunkingrag

Have a question for a speaker? Drop them here:
https://app.sli.do/event/eQnuJrAp9sN3...

Speakers:
Dr. Greg, CoFounder & CEO
  / gregloughane  

The Wiz, CoFounder & CTO
  / csalexiuk  

Join our community to start building, shipping, and sharing with us today!
  / discord  

Apply for our new AI Engineering Bootcamp on Maven today!
https://bit.ly/aie1

How'd we do? Share your feedback and suggestions for future events.
https://forms.gle/1UxkU7LbfV14f77p7

posted by ihlelelwely