Stay up to date with Greg: mail.gregkamradt.com/
Semantic Deduplicator: github.com/gkamradt/SemanticD...
SingleStore: tiny.one/QUtq9Wa
Dive into the innovative world of semantic deduplication. Navigate the challenges of consolidating product feedback and explore the mechanics behind a new Python package I built. From refining grocery lists to streamlining KZhead comments, witness the transformative power of semantic understanding.
Outline
0:00 - Skit
0:26 - Introduction
0:53 - The Problem
1:15 - The Semantic Deduplicator
2:10 - How it works - Refactoring
2:36 - How it works - Multiple Requests
3:00 - Sponsor: SingleStore
4:00 - How it works - Deduplication
4:40 - Example: Grocery Lists
5:08 - Example: Feature Requests
6:00 - Example: KZhead Comments
6:49 - Get Started
7:09 - Ryan Brandt shout out
7:22 - Outro
Greg’s Info:
- Twitter: / gregkamradt
- Newsletter: mail.gregkamradt.com/
- Website: gregkamradt.com/
- LinkedIn: / gregkamradt
- Work with me: tiny.one/TEi2HhN
- Contact Me: Twitter DM, LinkedIn Message, or contact@dataindependent.com
Great idea of something simple but very useful. Thank you.
Super helpful. Thanks Greg
Nice - thanks Shubham!
quality video and quality content as always, thanks Greg!
Awesome! Thank you Jessa Co.!
Thank you for your great tools.
thank you for the great video.
A cool follow up to this video would be showing how to use this within excel using their new built in Python features
Oo ya that would be cool - good call
Very cool. Would this work with non-English languages?
2:38 I don't get it, how do you solve the second problem - splitting multiple requests? Do you just use few-shot learning or embedding vectors?
Yep exactly few shot learning
Was looking for this as well, thank you :)
Great, thanks! Awesome channel btw, don't be surprised if I have further questions. I just discovered it and now I'm bing watching it :)@@DataIndependent
Any way to solve this issue for big data like pyspark? Might wanna avoid LMs there
Hm...I'm sure there is but I'm not too familiar with PySpark to suggest a method
BTW Thanks ❤
Thanks Cam