LangChain101: Question A 300 Page Book (w/ OpenAI + Pinecone)

2024 ж. 28 Нау.
194 315 Рет қаралды

Twitter: / gregkamradt
Or get updates to your inbox: mail.gregkamradt.com/signup
In this tutorial we will load a PDF book, split it up into documents, get vectors for those documents as embeddings, then ask a question.
--AI Generated Description--
In this tutorial, I am is discussing how to query a book using OpenAI, LangChain, and Pinecone, an external vector store, for semantic search.
I'm demonstrating how to split up the book into documents, use OpenAI embeddings to change them into vectors, and then use Pinecone to store them externally.
I'm then showing how to ask a question and get an answer back in natural language. This technique can be used to query books as well as internal documents or external data sets.
--AI Generated Description--
0:00 - Intro
1:31 - Diagram Overview
3:33 - Code Start
5:46 - Embeddings
6:33 - Pinecone Index Create
7:45 - First Question
9:33 - Ask Questions w/ OpenAI
Code: github.com/gkamradt/langchain...

Пікірлер
  • So even Ryan Gosling's getting into this now.

    @edzehoo@edzehoo Жыл бұрын
    • It's a fun topic!

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent he was referring to the fact you look like Ryan Gosling.

      @blockanese3225@blockanese322511 ай бұрын
    • ​@@blockanese3225 I think understands that.

      @Author_SoftwareDesigner@Author_SoftwareDesigner11 ай бұрын
    • @@Author_SoftwareDesigner lol I couldn’t tell if he understood that when he said it’s a fun topic.

      @blockanese3225@blockanese322511 ай бұрын
    • yesss

      @nigelcrasto@nigelcrasto11 ай бұрын
  • OMG, this is exactly the functionality I need as a long-form fiction writer, not just to be able to look up continuity stuff in previous works in a series so that I don't contradict myself or reinvent wheels ^^ -- but then to also do productive brainstorming/editing/feedback with the chatbot. I need to figure out how to make exactly this happen! Thank you for the video!

    @sarahroark3356@sarahroark3356 Жыл бұрын
    • Nice! Glad it was helpful

      @DataIndependent@DataIndependent Жыл бұрын
    • Agreed. Do you have any simplified tutorials? Like explaining langchain I fed my novel into chatgpt page by page it worked..ok but I kept running into roadblocks. Memory cache limits and more.

      @areacode3816@areacode3816 Жыл бұрын
    • @@areacode3816 maybe from ur pinecone reaching its limit? or ur 4000 gpt3 token limit? i would check these first, if its pinecone the fix is easy, jus buy more space, but if its due to gpt then try gpt4 it has double the token at 8k or if that doesnt work i would figure out an intermediary step in between to introduce another sumarizing algorithm before passing it to gpt3

      @thebicycleman8062@thebicycleman806211 ай бұрын
    • How would I use this to make a smart chat bot for our chat support on our company? Specific to our company items

      @gjsxnobody7534@gjsxnobody753411 ай бұрын
    • @@gjsxnobody7534I have same query!

      @shubhamgupta7730@shubhamgupta773010 ай бұрын
  • you know it's something big when The GRAY MAN himself is teaching you AI!!

    @nigelcrasto@nigelcrasto11 ай бұрын
  • Your series is just so so good. What a passionate, talented teacher you are!

    @davypeterbraun@davypeterbraun10 ай бұрын
    • Nice! Thank you!

      @DataIndependent@DataIndependent10 ай бұрын
  • Great job on the video. I understood a lot more in 12 mins than from a day of reading documentation. Would be extremely helpful if you can bookend this video with 1. dependencies and set up and 2. turning this into a web app. If you can make this into a playlist of 3 videos, even better.

    @NaveenVinta@NaveenVinta11 ай бұрын
  • No idea how long i've been searching the web for this exact tutorial. Thank you.

    @blocksystems202@blocksystems202 Жыл бұрын
    • Wonderful - glad it worked out.

      @DataIndependent@DataIndependent Жыл бұрын
  • This is absolutely brilliant! I love the way you explain everything and just give away all notes in such detailed and easy to follow way.. 🤩

    @krisszostak4849@krisszostak484911 ай бұрын
  • This is exactly what I was looking to do, but I could'nt sort it out. This video is legit the best resource on this subject matter. You're gentleman and a scholar. I tip my hat to you, good sir.

    @64smarketing57@64smarketing5710 ай бұрын
  • Can you do a more indepth Pinecone video? It seems like an interesting concept alongside embeddings and i think it'll help seam together the understanding of embeddings for more 'web devs' like me. I like how you used relatable terms while introducing it in this video and i think it deserves its own space. Please consider an Embeddings + Pinecone fundamentals video. Thank you.

    @vinosamari@vinosamari Жыл бұрын
    • Nice! Thank you. What's the question you have about the process?

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent I thinks that general pinecone video would be great, and connecting it with LangChain and building similar apps to this would be awesome

      @ziga1998@ziga199811 ай бұрын
    • Weaviet is even better

      @ko-Daegu@ko-Daegu11 ай бұрын
  • thanks for making these videos! I've been going through the playlist and learning a lot. One thing I wanted to mention that I find really helpful in addition to the concepts explained is the background music! Would love to get that playlist :)

    @lostnotfoundyet@lostnotfoundyet9 ай бұрын
    • Thank you! A lot of people gave constructive feedback that they didn't like it. Especially when they sped up the track and listed to it on 1.2x or 1.5x Here is where I got the music! lofigenerator.com/

      @DataIndependent@DataIndependent9 ай бұрын
  • Nice video. i tweaked the code and split the index part and the query part so that i can index once and keep querying - like how we would do in the real world. Nicely put together !!

    @nsitkarana@nsitkarana9 ай бұрын
    • Hello, Do you have an example of how you did that. This is the part that I have become confused about how to reuse the same indexes. Thanks

      @babakbandpey@babakbandpey9 ай бұрын
    • Can you pls provide an example?

      @karimhadni9858@karimhadni98588 ай бұрын
  • This is the best video i've watched explaining the use of pinecone.

    @nickpetolick4358@nickpetolick435811 ай бұрын
    • Nice!!

      @DataIndependent@DataIndependent11 ай бұрын
  • Great video man. Loved it. I had been looking for this solution for some time. Keep up the good work.

    @Crowward92@Crowward9211 ай бұрын
  • This is super awesome!!! And so easily explained! You made my year. Please keep up the greatest work

    @ninonazgaidze1360@ninonazgaidze13606 ай бұрын
  • I like the video because it was to the point and the presentation with the initial overview diagram is great.

    @virendersingh9377@virendersingh937711 ай бұрын
  • Great tutorial bro. You're really doing good out here for us the ignorant. Took me a while to figure out that I needed to run pip install pinecone-client to install pinecone. So this is for anyone else who is stuck there

    @DanielChen90@DanielChen90 Жыл бұрын
    • Glad it worked out

      @DataIndependent@DataIndependent Жыл бұрын
  • Great video! Thanks a lot for sharing! One question: Once you have already loaded the vectors into Pinecone and closed your environment. How can you query the Pinecone DB if you don't have anymore the docsearch object?

    @josevl8678@josevl867811 ай бұрын
  • This is a great video and Greg is awesome. Let's hope he puts together a course!

    @401kandBeyond@401kandBeyond10 ай бұрын
  • Fantastic video thanks. I obtained excellent results (accuracy) following your guide compared to other tutorials I tried previously.

    @PatrickCallaghan-yf2sf@PatrickCallaghan-yf2sf6 ай бұрын
    • Ah that's great - thanks for the comment

      @DataIndependent@DataIndependent6 ай бұрын
    • Was the starter tier of pinecone enough for you?

      @aaanas@aaanas5 ай бұрын
    • Its one project only on starter tier, that one project can contain multiple documents under one vector vector db. For me it was certainty enough to get an understanding of the potential. From my limited experience, to create multiple vector db's for different project types you will need to premium/paid and the cost is quite high. There may be other competitors offering cheaper entry level if you wish to develop apps but for a hobbyist/learning the starter tier on pinecone is fine IMO.

      @PatrickCallaghan-yf2sf@PatrickCallaghan-yf2sf5 ай бұрын
  • Awesome tutorial, brief and easy to understand, Do you think this could be an approach to make semantic search on private data from clients? my concern is data privacy so, I guess by using pinecone and openAI, is that openAI only process what we send (to respond in a NL), but they don't store any of our documents.

    @Juniorventura29@Juniorventura299 ай бұрын
  • bro thank you so much honestly this video means so much to me, I really appreciate this all the best in all your future endeavors

    @ShadowScales@ShadowScales5 ай бұрын
    • Love it - what was your use case?

      @DataIndependent@DataIndependent5 ай бұрын
  • Thank you soooo much I am using this knowledge soo much for my school projects.

    @Mr_Chiro_@Mr_Chiro_10 ай бұрын
  • Awesome example, thanks for putting this together!

    @MrWrklez@MrWrklez Жыл бұрын
    • Nice! Glad it worked out. Let me know if you have any questions

      @DataIndependent@DataIndependent Жыл бұрын
  • this helped me a lot, thanks, for the updated code in description as well!

    @thespiritualmindset3580@thespiritualmindset35806 ай бұрын
  • Hey Greg, great video! Do you know if it's possible to automatically create a pinecone db index from code? So that you don't have to create them manually

    @quengelbeard@quengelbeard2 күн бұрын
  • This is great, thanks! have you thought about how to extend it to be able to CHAT about the book? (as opposed to a question at a time). I am running into problems figuring out when to keep a chain of chat and when to realize its a new or related question that needs new pulling of similar docs

    @agiveon1999@agiveon199911 ай бұрын
  • Amazing content man , love the diagrams and how you deliver ,absolutely professional . quick question , is the text returned by the chain is exactly the same from the book or does the openAI engine make some touches and make it better ?

    @haouasy@haouasy7 ай бұрын
  • Really clear, useful demo - thanks for sharing

    @HelenJackson-pq4nm@HelenJackson-pq4nm11 ай бұрын
  • Thanks for the tutorial series! May I ask could I work with multiple different PDFs at the same time (except combining them?)?

    @cheunghenrik7041@cheunghenrik704110 ай бұрын
  • Thanks as always Greg!

    @user-xp2ym1ng2h@user-xp2ym1ng2h5 ай бұрын
    • Awesome thank you

      @DataIndependent@DataIndependent5 ай бұрын
  • This is gold ! please do another one with data in Excel or Google sheet please :)

    @davidzhang4825@davidzhang482510 ай бұрын
  • I actually scanned the whole Mars trilogy to have something substantial, and it works fine. The queries generally return decent answers, although some of them are way off. Thanks for your excellent work!

    @bartvandeenen@bartvandeenen Жыл бұрын
    • Nice! Glad to hear it. How many pages/words is the mars trilogy?

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent About 1500 pages in total.

      @bartvandeenen@bartvandeenen Жыл бұрын
    • Did you look at the results returned from Pinecone so you could determine if the answers that were off were due to Pinecone not providing the right context or OpenAi not interpreting the data correctly?

      @keithprice3369@keithprice3369 Жыл бұрын
    • @@keithprice3369 no I haven't.good idea to do this. I know have gpt4 access so can use much larger prompts

      @bartvandeenen@bartvandeenen Жыл бұрын
    • @@bartvandeenen I've been watching a few videos about LangChain and they did bring up that the chunk size (and overlap) can have a huge impact on the quality of the results. They not only said there hasn't been much research on an ideal size but they said it should likely vary depending on the structure of the document. One presenter suggested 3 sentences with overlap might be a good starting point. But I don't know enough about LangChain, yet, to know how you specify a split on the number of sentences vs just a chunk size.

      @keithprice3369@keithprice3369 Жыл бұрын
  • Thanks for this very helpful practical tutorial!

    @ThomasODuffy@ThomasODuffy11 ай бұрын
  • thanks for the great content! do you know how to better control the cost of having such a retrieval-based chatbot? Based on my experience, it is quite costly to run QnA on just the simple pdf that provided in LangChain repo, using default embeddings and llm models provided from the langchain example

    @svgtdnn6149@svgtdnn614911 ай бұрын
  • Hey Greg amazing content, learning a lot from your videos! But I'm running into a problem, I was looking into the source code, and I noticed that the Pinecone.from_texts method indexes/stores the data, so it's not ideal to be running multiple times, right? Do you have any suggestion to improve this?

    @kelvinromero@kelvinromero6 ай бұрын
  • thank you Greg! very helpful tutorial!!

    @guilianamustiga2962@guilianamustiga29625 ай бұрын
    • Thanks Guiliana!

      @DataIndependent@DataIndependent5 ай бұрын
  • this is awesome! my question is, what happens when the model is asked a question outside of the knowledge base that was just uploaded? For example, what would happen if you asked a question about who is the best soccer player?

    @jonathancrichlow5123@jonathancrichlow51238 ай бұрын
  • Thank you very much for doing this. It's absolutely awesome!!! Also can you do a video on how to improve the quality of answers?

    @tunle3980@tunle398010 ай бұрын
  • This is such a game changer. Can’t wait to hook all of this up to GPT-4 as well as countless other things

    @____2080_____@____2080_____ Жыл бұрын
    • Nice! What other ideas do you think it should be hooked up to?

      @DataIndependent@DataIndependent Жыл бұрын
    • Thumbs up and subscribed.

      @____2080_____@____2080_____ Жыл бұрын
  • Hey, Greg! I'm trying to connect the dots on GPT + langchain and your videos have been excelent sources! To give it a try, I'm planning to build some kind of personal assistant for a specific industry (i.e. law, healthcare), and down the road the vector database will become pretty big. Any guideline on how to sort the best results and also how to show the source of where the information was pulled from?

    @alvaromseixas@alvaromseixas11 ай бұрын
    • Nice! Check out the langchain documentation for "q&a with sources" you're able to get them back pretty easily.

      @DataIndependent@DataIndependent11 ай бұрын
  • Great video!! Loved your explanation. Could you create another video on how to estimate the costs? Is the process of turning the Documents to Embeddings using OpenAI running every time you make a new question? or just the first time? Thanks!

    @ininodez@ininodez11 ай бұрын
    • Pinecone is basically a search engine for ai. It doesn't need the entire book but just segments of it instead. This saves a lot of tokens cause only segments of information end up in the prompt. Like adding some information into gpt's short term memory

      @silent.-killer@silent.-killer11 ай бұрын
  • Love this brother!

    @luisarango-jm8eq@luisarango-jm8eq11 ай бұрын
  • This is really cool but i havent yet seen a query for a specific information store (in your case, a book) that chatgpt cant natively answer. For example i queried chatgpt the questions you asked and got detailed answers that echoed the answers you received and then some.

    @mosheklein3373@mosheklein33739 ай бұрын
  • Got to say, you are awesome! Keep up the good work, you got a subscriber here!

    @sunbisoft9556@sunbisoft9556 Жыл бұрын
    • Nice! Thank you. I just ordered upgrades for my recording set up so quality will increase soon.

      @DataIndependent@DataIndependent Жыл бұрын
  • Short, but very sweet video! Question: does this work for documents in other languages? Say, Japanese, for example? And, is there a text splitter for Japanese? (a la ChaSen, Kuromoji, etc.)

    @mlg4035@mlg403511 ай бұрын
  • Great video! Do you know how Pinecone deals with the similarity of sequences of different length? For example, matching the 1k tokens documents in the video's db with the short query questions you ask.

    @JuaniPisula@JuaniPisula11 ай бұрын
  • Hey, great video! What do you mean when you say that it's going to be more expensive with additional documents? What drives the cost? Thank you!

    @knallkork700@knallkork70011 ай бұрын
  • Hi! Awesome tutorial. This is exactly what I was looking for. I really love this series you've started and hope you'll keep it up. I also wanted to ask: 1. What's the difference between using Pinecone or another vector store like Chrome, FAISS, Weaviate, etc? And what made you choose Pinecone for this particular tutorial? 2. What was the cost for creating embeddings for this book? (time & money) 3. Is there a way to estimate the cost of embeddings with LangChain beforehand? Thank you very much and looking forward to more vids like this! 🤟

    @HerroEverynyan@HerroEverynyan Жыл бұрын
    • For your questions 1. The difference with Pinecone/Chrome,etc. Not much. They store your embeddings and they run a similarity calc for you. However the space is super new, as things progress one may be a no brainer over another. Ex: You could also do this in GCP but you'd have to deal with their overhead as well. 2. Hm, unsure about the book but here is the pricing for Ada embeddings: $0.0004 / 1K tokens. So if you had 120K word book which is ~147K tokens, it would be $.05. Not very steep... 3. Yes, you can calc the number of tokens you're going to use and the task, then look up their pricing table and see how much it'll be.

      @DataIndependent@DataIndependent Жыл бұрын
    • ​@@myplaylista1594 This one should help out help.openai.com/en/articles/4936856-what-are-tokens-and-how-to-count-them

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent It can't be so expensive. text-embedding-ada-002 is about ~3,000 pages per US dollar (assuming ~800 tokens per page).

      @klaudioz_@klaudioz_ Жыл бұрын
    • @@klaudioz_ ya, you’re right my mistake. I didn’t divide by the extra thousand in the previous calc. Fixing now

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent No problem. Thanks for your great videos !!

      @klaudioz_@klaudioz_ Жыл бұрын
  • Thank you - Super helpful to understand how to use external data sources with OpenAI. What are some of the limitations of this approach i.e. size of content being indexed in pinecone, any limits on correlating and summarizing data across multiple documents/sources, can I combine multiple types of sources of information about a certain topic (document, database, blogs, cases etc.) into a single large vector?

    @pramodm6168@pramodm61689 ай бұрын
  • Thanks for sharing, pretty good. QQ, did you make a version of this using Chroma?

    @carlosbenavides670@carlosbenavides6706 ай бұрын
  • Hi. I kind of curious, with so many open source chat gpt like right now, can we use that instead of openAI API? For example, using dolli and use only about 8B parameter. Is it possible? And also, about the embeddings, we can use another embedding too right? Is it the same with bag of words kind of thing? Thank you. Great video!

    @daryladhityahenry@daryladhityahenry11 ай бұрын
  • I am getting Index 'None' not found in your Pinecone project. Did you mean one of the following indexes : langchain1 for below line docsearch = Pinecone.from_texts([t.page_content for t in texts], embeddings, index_name) Any idea what the issue could be. I checked index_name variable is set correctly as langchain1

    @sumitbakhli2049@sumitbakhli204911 ай бұрын
  • Your videos are amazing. Keep it up and thanks!

    @philipsnowden@philipsnowden Жыл бұрын
    • Thanks Philip. Anything else you want to see?

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent I'm curious what's a better option for this use case and would love to hear your thoughts. Why LangChain over Haystack? I want to pass through thousands of text documents into a question answering system and am still learning the best way to structure it. Also, an integration into something like Paperless would be cool! I'm a total noob so excuse my ignorance. Thanks!

      @philipsnowden@philipsnowden Жыл бұрын
    • @@philipsnowden I haven't used Haystack yet so I can't comment on it. If you have 1K text documents you'll definitely want to get embeddings and store them, retrieve them, then pass them into your prompt for the answer. Haven't used paperless yet either :)

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent Good info, thank you.

      @philipsnowden@philipsnowden Жыл бұрын
    • @@DataIndependent Could you do a more in depth explainer on this? I'm struggling to take a directory of text files and get it going. I've been reading and trying the docs for langchain but am having a hard time . And can you use the new turbo 3.5 model to answer the questions? Thanks for your time, have a tip jar?

      @philipsnowden@philipsnowden Жыл бұрын
  • Thanks for sharing. Could you elaborate on why you didn’t use overlap?

    @maxhodges7511@maxhodges751110 ай бұрын
  • Another great tutorial Greg! Curious if you've played around with Faiss. And if so, what you think of Pinecone vs Faiss?

    @calebsuh@calebsuh9 ай бұрын
    • Yep! I've played around with it and love it for local use cases. I had a hard time w/ a supporting library in it the last time I used it

      @DataIndependent@DataIndependent9 ай бұрын
    • @@DataIndependent Pinecone was getting expensive for us, so we're trying out Faiss now

      @calebsuh@calebsuh9 ай бұрын
  • Thanks for your tutorials on Langchain, certainly helps alot and appreciate what you're doing here! Would like to better understand how pinecone helps in this use case as compared to your prev tutorial on 'custom files +chatgpt'. Would i be able to upload multiple documents to query in that prev tutorial or would pinecone be necessary?

    @user-vc2sc9rq7t@user-vc2sc9rq7t Жыл бұрын
    • Pinecone is good when you want to store your vectors in the cloud. This can help when you're building a more robust app. In the previous tutorial I was using Chroma which is more local based.

      @DataIndependent@DataIndependent Жыл бұрын
  • Great tutorial, I wonder how to generate questions based on the content of the book? I would probably have to pass the entire content of the book to the GPT model.

    @sovopl@sovopl10 ай бұрын
  • Great video , I am wondering is there way to use the PDFs which made from photocopy of the document ( need to convert image to text )

    @shaunchen5054@shaunchen505411 ай бұрын
  • In LangChain is "similarity search" used as a synonym for "semantic search", or they are referring to different types of search? To my knowledge similarity search focuses on finding items that are similar based on their features or characteristics, while semantic search aims to understand the meaning and intent behind the query to provide contextually relevant results

    @valdinia-office2910@valdinia-office291010 ай бұрын
  • Every time I run the cell with the emmbeding class do I get a charge from OpenAI? What option can I use to do the embedding load only once (for example to make queries available through a web application)?

    @pedrorios6566@pedrorios65663 ай бұрын
  • Duudee!!! This video is exactly what I was looking for! Still a complete noob at all this LLM integration stuff and so visual tutorials are so incredibly helpful! Thank you for putting this together 🙌🏿🎉🙌🏿

    @CarloNyte@CarloNyte Жыл бұрын
    • Great to hear! Checkout the video on the '7 core concepts' which may help round out the learnings

      @DataIndependent@DataIndependent Жыл бұрын
  • great video. thanks so much. How do you query the index without creating the embeddings all the time? is it possible? thanks

    @danilovaccalluzzo@danilovaccalluzzo11 ай бұрын
    • Hi, i found this : docsearch = Pinecone.from_existing_index(index_name, embeddings)

      @nihonkeizaishinbun2254@nihonkeizaishinbun22549 ай бұрын
  • Great series.

    @caiyu538@caiyu5387 ай бұрын
  • This is definitely cool, thank you. There seem to be several dependencies left out. It would be great if all dependencies were shown or listed...

    @sabashioyaki6227@sabashioyaki622711 ай бұрын
    • ok, thank you and will do. Are you having a hard time installing them all?

      @DataIndependent@DataIndependent11 ай бұрын
    • @@DataIndependent hey I'm stuck on the dependency part as well

      @benfield1866@benfield186611 ай бұрын
  • Loved it. 1 Question, what model of openai does this approach uses? For example, davinci etc?

    @tazahglobal8662@tazahglobal866211 ай бұрын
  • Great tutorial, thanks so much!

    @walter7812@walter78125 ай бұрын
    • Awesome thanks Walter

      @DataIndependent@DataIndependent5 ай бұрын
  • Great video. QQ, How is it different from asking Chat-GPT to base its answers on the title of the book and Author?

    @akashbhoite42@akashbhoite429 ай бұрын
  • Great stuff! What GUI wrapper do you recommend?

    @roberthuff3122@roberthuff312211 ай бұрын
  • How do you get around rate limits for really large documents? OpenAI ada embeddings model can only take up to a certain amount of requests/ chunk sizes per minute.

    @retardedpenguin1@retardedpenguin111 ай бұрын
  • Thanks Greg for the great work. I actually ran some Q & A with a financial reporting (PDF) based on your examples. While the model did really great for text, it struggled with structured financial data outlined in tables, as typical for financial reporting. Do you think that can be improved further down the line (I assume that's something Open AI has to address in their LLM and not necessarily LangChain)?

    @AvatarRob25@AvatarRob25 Жыл бұрын
    • For those examples it's all about the data preprocessing. The information is there, my guess is it's hard to read in table form though. Yes I'm hoping that there is more support for this in the future.

      @DataIndependent@DataIndependent Жыл бұрын
    • You might try TabLLM. It may complicate your process but it can reformat tables to be understood by an llm

      @ClowdyHowdy@ClowdyHowdy Жыл бұрын
    • Wolfram Alpha?

      @MJFloof@MJFloof Жыл бұрын
    • BloombergGPT?

      @pablocanovas9626@pablocanovas962611 ай бұрын
  • Excellent...!! Just one question, Once we load data is this data now belongs to OpenA/ChatGPT. ? In other words can they use this uploaded book data to answer questions that other users may ask?

    @yashkhd1100@yashkhd110011 ай бұрын
  • thank you for this series. I'm confused about one thing. When querying the db, you passed the text, not its embedding. How does pinecone know how to embed the text?

    @user-bv7qv2vj5w@user-bv7qv2vj5wАй бұрын
  • This is a great video. It helped a lot. I have a question. I am new to this, and I am having trouble splitting this code to make the queries now directly to the previously uploaded data, instead of uploading the vectors again. I want to use what I already have in Pinecone. How do i do that?

    @yonathan310393@yonathan31039310 ай бұрын
  • Awesome video! Is there a way to embed the prompt and response interface into a website, more like a chatbot experience?

    @thepracticaltechie@thepracticaltechie11 ай бұрын
  • Would love to see an example of adding another book after you've done this one. What would be some of the considerations and fine-tuning you'd make as a result of the second upload

    @fareedbehardien@fareedbehardien Жыл бұрын
    • You could add more documents to your existing index and it shouldn't be a problem. However once you start to add a bunch of information, pre-filtering your vectors will become more important. Ex: If you know the answer comes from 1 of your 3 books then you can tell Pinecone to only return docs from that 1 book

      @DataIndependent@DataIndependent Жыл бұрын
  • Your videos is really awesome and very helpful. What approach should i take if i want to make semantic search from structured (tabular) data instead of free text using openai and langchain?

    @sunil_modi1@sunil_modi1 Жыл бұрын
    • There might be a better answer out there...but my take is that, since you'll need to feed text into OpenAI, then you can make documents out of your rows first, get embeddings for those documents, then do your similarity search. It'll take some translation and file formatting

      @DataIndependent@DataIndependent Жыл бұрын
  • Is it a fine tuned model ? Because if not we will charged high for using openai api. Please make a video on fine tuned langchain openai ai model like text-ada-001

    @vishnuvardhanvaka@vishnuvardhanvaka10 ай бұрын
  • It's really a great video to get start with langchain. I have a small confusion here. what if I want to send all the similar docs to the llm model not just k=5. Is there a way to deal with it?

    @sangeetkumar6337@sangeetkumar633710 ай бұрын
  • Hi Greg! Thanks so much for the video! I am wondering what OpenAI embedding model you used, and what OpenAI chat model you used, and where can I find that in the code? Additionally, is there a way to view the cost of querying in terms of tokens consumed? Thanks!

    @peikewu7952@peikewu79529 ай бұрын
    • For embeddings I just use openai's ada-002 model. For chat model, if one isn't provided, then it's gpt-3.5 (as of today), I used the default so you won't see it unless you check out the langchain source code

      @DataIndependent@DataIndependent9 ай бұрын
  • How does langchain wraps the history of the chat ? Or it doesn't ? Internally, how does it send the prompt to OpenAI ? Thanks for the amazing tutorial

    @cnmoro55@cnmoro5511 ай бұрын
  • This is awesome! Thank you very much for the video. One quick question. How much did this cost with OpenAI and Pinecone API usage?

    @facundoalvarezmorales3325@facundoalvarezmorales332511 ай бұрын
    • Pinecone at the time was free, openai was a couple cents

      @DataIndependent@DataIndependent11 ай бұрын
  • Excellent video! Thanks for this! Is there a way to use conversational memory while doing generative Q&A?

    @satvikparamkusham7454@satvikparamkusham7454 Жыл бұрын
    • Big time - check out the latest webinar on this exact topic. It should be on the langchain twitter

      @DataIndependent@DataIndependent Жыл бұрын
  • Greg, you are INCREDIBLE! Your channel and GitHub are a goldmine. Thank you 🙏. At 9:09, what install on Mac is necessary to assess methods like that?

    @deanshalem@deanshalem9 ай бұрын
    • Also, I’ve been trying to make some type of “theorems, definitions, and corollaries” assistant which extracts from my textbook all the math theorems, definitions, and corollaries. The goal there was to create textbook summaries to reference when I work through tough problems which require me to flip back and forth through my book all day long. But more interesting, I am struggling to create a “math_proofs” assistant. Your approach in this video is awesome, but I can’t find any of your resources in which you use markdown, or latex, or any mathematical textbook to be queried. I use MathPix to convert my textbooks to latex, wordDoc, or markdown. But when I use my new converted markdown text, despite working hand-in-hand with the lang chain documentation, I still fail to get a working agent that proves statements. I feed the model: “Prove the zero vector is unique” and it replies nonsense, even though this proof is explicitly written in the text. It is not even something it had to “think” to produce (simple for the sake of example, these proofs are matrix theory so they get crazy). Could you please chime in?

      @deanshalem@deanshalem9 ай бұрын
    • Pulling all of that information out could be tough. I have a video on the playlist around "topic modeling" which is really just pulling structured information out of a piece to text. That one may be what you're looking for

      @DataIndependent@DataIndependent9 ай бұрын
  • It’s incredible instructions. In my case, I have some documents in Vietnamese language, will Pinecone support utf8 ? OpenAI + langchain + pincone,.. very helpful in many fields especially in customer services

    @kennt7575@kennt757511 ай бұрын
  • Amazing work ! thank you so much !!

    @waeldimassi3355@waeldimassi335510 ай бұрын
  • Nice! I was working with pinecone / gpt code recently that gave your chat history basically infinite memory of past chats by storing them in pinecone which was pretty sweet as you can use it to give your chatbot more context for the conversation as it then remembers everything you ever talked about. Will be combining this with a custom dataset pinecone storage this week (like a book) to create a super powered custom gpt with infinite recall of past convos. Would be curious on your take, particularly how to keep the book data universally available to all users but at the same time keeping the past chat data of a particular user totally private but still being able to store both types of data on the free tier pinecone which I can see you are using (and I will be using too).

    @PizzaLord@PizzaLord Жыл бұрын
    • Nice! That's great. Soon if you have too much information (like in the book example above), you'll need to get good at picking which pieces of previous history you want to parse out. I imagine that won't be too hard in the beginning but it will later on.

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent Doesnt the k variable take care of this? It only returns the top k number in order of relevance that you end up querying. Or are you talking about the chat history and not the corpus? I see no reason why you would not just specify a k variable of 5 or 10 in regard to the chat history too. For example if a user was seeking relationship advice and the system knew their entire relationship history and the user said something like "this reminds of of the first relationship that I told you about", it would be easy for the system to do an exact recall of the relationship, the name of the partner and from there recall everything very quickly using the k variable on the chat history. I use relationships as an example because I just trained my system on a book that I wrote called sex 3.0 (something that gpt knows nothing about) and I am going to be giving it infinite memory and recall this week.

      @PizzaLord@PizzaLord Жыл бұрын
    • @@PizzaLord Yes, the K variable will help w/ this. My comment was around the chance for more noise to get introduced the more data you have. Ex: More documents creep in that share a close semantic meaning, but aren't actually what you're looking for. For small projects this shouldn't be an issue. Nice! That's cool about the project. Let me know how it goes. The langchain discord #tools would love to see it too

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent Another thing I will look at, and I think it would be cool if you looked at it too, is certain chat questions triggering an event like a graphic or a video link being shown where by the video can be played without leaving the chat. This can be done by either embedding the video in the chat response area or by having a separate area of the same html page which is the multimedia area or pane that gets updated. After all the whole point of langchain is to be able to chain things together, no? Once you chain things together you can get workflow. This gets around one of chat gpts main limitations right now which is that its text only in terms of what you can teach it and the internet loves its visuals and videos. Once this event flow stuff is in place you can easily use it to flow through all kinds of workflow with gpt at the centre like collecting data in forms, doing quick survey so you can store users preferences and opinions about what they might want to get out of an online course that you are teaching it and then storing that in a vector DB. It can become its own platform at that point.

      @PizzaLord@PizzaLord Жыл бұрын
    • @@PizzaLord You could likely do that by defining a custom tool, grabbing an image based off a URL (or generating one) and then displaying in your chat box. Doing custom tools is interesting and I'm going to look into a video for that.

      @DataIndependent@DataIndependent Жыл бұрын
  • Excellent video!

    @JoanSubiratsLlaveria@JoanSubiratsLlaveria7 ай бұрын
  • This is gold! Thank you so much!

    @lukaszwiktor@lukaszwiktor11 ай бұрын
    • Thank you!

      @DataIndependent@DataIndependent11 ай бұрын
  • hey. great work. question. If I want to summarize a very large document, Could I split it into multiple documents and create embeddings to create summary? what is the best practice?

    @vigneshkannan66@vigneshkannan669 ай бұрын
    • Nice! This is a great question - I have a whole video on summarization methods depending on text length. Check out “5 levels of summarization”

      @DataIndependent@DataIndependent9 ай бұрын
  • When implementing this, would I still be able to ask questions outside the book?

    @CrunchyMind@CrunchyMind10 ай бұрын
  • This is great! thanks, do you have a video that shows how to connect what you did to a chatbot interface?

    @rayali8958@rayali89589 ай бұрын
    • Not currently but this is on the horizon - I'll make a post on this channel in a few weeks

      @DataIndependent@DataIndependent9 ай бұрын
  • great video, one question for chatbot , how about the same or similar questions send to robot from different client? does the cost double, how to optimize it ?

    @yantaosong@yantaosong10 ай бұрын
  • Would using this methodology be a good way to build up a Q&A Body of Knowledge ontop of a businesses SOP documents? Allowing newcomers to a company to query best-practice protocols thorugh a query system - negating the need to always go to their manager?

    @willosullivan1986@willosullivan19865 ай бұрын
    • Big time, it's a great starting point. If you need more advanced retrieval techniques you could try out one of these: github.com/gkamradt/langchain-tutorials/blob/main/data_generation/Advanced%20Retrieval%20With%20LangChain.ipynb

      @DataIndependent@DataIndependent5 ай бұрын
    • @@DataIndependent Thank you!

      @willosullivan1986@willosullivan19865 ай бұрын
  • Brilliant video

    @AtulThakorPeppercorn@AtulThakorPeppercorn7 ай бұрын
  • How exactly is openAI querying those docs? Are you sending those docs in as prompt inputs?

    @danielnelson9996@danielnelson999611 ай бұрын
  • Great explanation. Thank you.

    @RomuloMagalhaesAutoTOPO@RomuloMagalhaesAutoTOPO11 ай бұрын
    • Thank you! That's great

      @DataIndependent@DataIndependent11 ай бұрын
  • This is a great video - succinct and easy to follow. Two questions: 1) How easy is it to add more than one document to the same vector db 2) Is it possible to append an additional ... field(?) to that database table - so that the provenance of the reference can be reported back with the synethised result?

    @nathanburley@nathanburley11 ай бұрын
    • 1) Super easy. Just upload another 2) Yep you can, it's the metadata field as you can add a whole bunch. People will often do this for document id's

      @DataIndependent@DataIndependent11 ай бұрын
    • @@DataIndependent Amazing (and thanks for the reply). One final follow up then, is it easy / possible to delete vectors from the db too (I assume yes wanted to ask). I assume this is done by using a query e.g. if meta data contains "Document ID X" then delete?

      @nathanburley@nathanburley11 ай бұрын
  • Thank you for this wonderful series! I have watched the series! Why doesn't the load_qa_chain throw an error token limit when you use "stuff"? If I'm not mistaken, we have more than the acceptable amount of tokens right?

    @brofessorsbooks3352@brofessorsbooks3352 Жыл бұрын
    • I'd have to go back and officially check, but if there wasn't an error thrown then we were almost definitely under the token limit. You could git clone the repo and check yourself!

      @DataIndependent@DataIndependent Жыл бұрын
    • @@DataIndependent Thank you. I wouldve guess there should be way more than say... 8k's worth of tokens in your referred to Data Science pdf.

      @brofessorsbooks3352@brofessorsbooks3352 Жыл бұрын
    • @@brofessorsbooks3352 Oh, it's because only the top K similar documents chunks were returned. Not the whole pdf

      @DataIndependent@DataIndependent Жыл бұрын
  • Im also curious how would you implement this into a stand alone app that can be queried

    @mosheklein3373@mosheklein33739 ай бұрын
  • Awesome video as always. Noticed that there is the standard load_qa_chain, and on the other hand we also have VectorDBQA. Which one should be the choice to go for?

    @kennethleung4487@kennethleung4487 Жыл бұрын
    • Depends on your task. The VectorDBQA will be a convenient way do handle the document similarity for you. Or you could do it manually yourself w/ load_qa_chain.

      @DataIndependent@DataIndependent Жыл бұрын
KZhead