KZhead
Ғылым және технология

"okay, but I want GPT to perform 10x for my specific use case" - Here is how

AI Jason
2024 ж. 29 Сәу.
756 136 Рет қаралды
Жүктеу

Finetune Falcon 7b/40b instruct with your own data - The step by step guide about how to train falcon model for generating high quality midjourney prompt, from prep training dataset to comparing final results;
- Join Falcon 40B contest: falconllm.tii.ae/call-for-pro...
- Follow me on twitter: / jasonzhou1993
- Join my AI email list: www.ai-jason.com/
- My discord: / discord
🔗 Links
- Google colab: colab.research.google.com/dri...
- Midjourney training dataset: docs.google.com/spreadsheets/...
- RelevanceAI midjourney training dataset generator: app.relevanceai.com/notebook/...
⏱️ Timestamps
0:00 Finetune VS Knowledge base
1:50 Step1 Choose base LLM
2:30 Step2 Prep training data
4:54 Step3 Setup google colab
5:41 Step4 Load base Falcon model
6:48 Step5 Load training data
7:36 Step6 Finetune model
7:56 Step7 Save & run finetuned model
9:08 Falcon 40b
👋🏻 About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! ask@ai-jason.com
#gpt #autogpt #ai #artificialintelligence #tutorial #stepbystep #openai #llm #falcon7b #finetune #largelanguagemodels #largelanguagemodel #midjourney

Пікірлер

  • No clickbait, no long intro, no over-excitement. Just pure, straight-to-the-point content, with real-world examples and neatly divided sections. You are a hero

    @trickybarrel444@trickybarrel4449 ай бұрын

    • You understood that? I wish.

      @668771@6687718 ай бұрын

    • YES! Getting tired of those time filler AI videos, almost didn't watch this one. Now subscribed

      @Bashar3A@Bashar3A8 ай бұрын

    • Aaaah just like the good ol days 😅😂

      @myob3074@myob30748 ай бұрын

    • ​@@668771knuckle down and study practice study practice, it's not that difficult 🤷🏽‍♂️

      @myob3074@myob30748 ай бұрын

    • specific use case: filter videos for overexcitement and clickbait, then tag them

      @Andyonrice@Andyonrice7 ай бұрын

  • holy heck dude, you just taught us magic. This is the magic! not even the fine tuning, but the data set generation! data sources! all the pieces I have been searching for!

    @spoonikle@spoonikle9 ай бұрын

    • Thanks so much mate!! That means a lot, DM me if you get any question pls!

      @AIJasonZ@AIJasonZ9 ай бұрын

    • Literally brother you have taught us prompt engineering wizardry, there’s no other way to put it.

      @EGGHEADIUS@EGGHEADIUS9 ай бұрын

    • I’ve been generating massive data sets and manipulating in python then bringing it back to fine tune. Shits getting wild out here

      @DeepDiveNFT@DeepDiveNFT9 ай бұрын

    • @@DeepDiveNFTlol sounds like fun, what kind of general use cases do you have?

      @Zer-ei4co@Zer-ei4co9 ай бұрын

    • Be wary that OpenAI prohibits the use of their models to generate training data (no competing closure). It's hard to detect, obviously, but it's useful knowledge imo regardless.

      @stan9682@stan96829 ай бұрын

  • Let's be honest. Who here clicked because you thought he was JIMMY YANG?

    @ai-tools-search@ai-tools-search6 ай бұрын

    • Who’s Jimmy Yang? 😂

      @shuzhu6633@shuzhu66336 ай бұрын

    • @@shuzhu6633 the comedian in the thumbnail

      @NESDUB@NESDUB6 ай бұрын

    • jian yang

      @aiutksemua@aiutksemua5 ай бұрын

    • I'm not 😂

      @bakasenpaidesu@bakasenpaidesu5 ай бұрын

    • That's 😂

      @tevx9670@tevx96705 ай бұрын

  • One thing I really like about your videos is that it always comes with really quality examples. And the examples are pretty much practical oriented. Do make the embedding video.

    @sayantandas7544@sayantandas75449 ай бұрын

    • Thanks man, that means a lot! 😬

      @AIJasonZ@AIJasonZ9 ай бұрын

    • @@AIJasonZ Absolutely agree. Very helpful and i like the speed you go, staying on topic. Please make the embedding video! Very interested to see your take on it.

      @treadaar@treadaar9 ай бұрын

    • I thought the opposite, this was like watching someone assemble a nuclear reactor. I'm more confused about AI after watching this. You need to be a master programmer to properly view this video.

      @668771@6687718 ай бұрын

    • @@AIJasonZ +1 on make the embedding video. Really great stuff :)

      @antonschillen2633@antonschillen263314 күн бұрын

  • Very good teaching style. I also liked that you actually went through the process ourself. Thank you very much

    @sweetmelon3365@sweetmelon33659 ай бұрын

  • Honestly, I love how you don't put a clickbaity title or thumbnail, and how you explain it well but also fast.

    @pikleman5880@pikleman58808 ай бұрын

  • Fantastic video once again, can’t wait for the next embedding one 😊

    @lucyn.7501@lucyn.75019 ай бұрын

  • One of the best and most straight forward tutorials i have Seen after 5 years of ComputerScience! Keep it up now i am honna binge eatvh your other videos

    @hansjochen2193@hansjochen21937 ай бұрын

  • Excellent video Jason. Well organised and easy to understand.

    @dogemaster6361@dogemaster63619 ай бұрын

  • Omg this is the best one I have seen so far!!!I’m planning to train one of my own model soon!!

    @loktheswe6768@loktheswe67688 ай бұрын

  • Really appreciate your free thought. Will try to follow you closely.

    @DivineMisterAdVentures@DivineMisterAdVentures9 ай бұрын

  • Great Video! I would love to see a video on how to create an embedded knowledge base and use it along side this fine-tuning.

    @unshadowlabs@unshadowlabs9 ай бұрын

  • most underrated channel in AI. Thank you for the effort you are putting into this.

    @unicornist@unicornist6 ай бұрын

  • I'm floored by your content. It is amazing 👏👏👏👏👏👏

    @squibtechnologies@squibtechnologies6 ай бұрын

  • Bloody awesome video - concise yet detailed! Looking for upcoming vids

    @kazimafzal@kazimafzal8 ай бұрын

  • Excellent video Jason! Step by step examples are really helpful

    @joejiang8353@joejiang83539 ай бұрын

  • well done! looking forward to the embedding video too

    @LC-lj5kd@LC-lj5kd9 ай бұрын

  • Learning so much from you. Thank you for making this.

    @AdrianMark@AdrianMark9 ай бұрын

  • Man this is exactly the sort of guide I was looking for. Thank you very much.

    @DorkDork69@DorkDork696 ай бұрын

  • I'm glad i found this channal! wonderful work!!

    @tahamohd1409@tahamohd14099 ай бұрын

  • brooo....God bless you for this...gained a ton

    @awesomeGuss@awesomeGuss9 ай бұрын

  • Good work dude! This is super useful!

    @chonmon@chonmon9 ай бұрын

  • Your audio gradually went from studio recording to cathedral ambiant. Hey thanks for the info. Love it ♥

    @soyitiel@soyitiel9 ай бұрын

  • Great Video! Keep up the good work

    @yashsoni5437@yashsoni54379 ай бұрын

  • Great job Jason! Very helpful!

    @mytechnotalent@mytechnotalent9 ай бұрын

  • Great concise tutorial, thanks!👍

    @Muuip@Muuip8 ай бұрын

  • keep the good job Jin Yang，your top follower from shanghai

    @user-jt3jc7fk2x@user-jt3jc7fk2x9 ай бұрын

  • honestly, I was not expecting jin yang to teach us but I'm all for it straight to the point, loved it

    @user-jd3gf5xw1x@user-jd3gf5xw1xАй бұрын

  • One of the best, to the point, goldmine of a tutorial

    @Yadu-bv1kn@Yadu-bv1kn8 ай бұрын

  • Awesome video! So many great resources. Demystified a lot for me. Thanks!

    @maxgeorgopoulos3516@maxgeorgopoulos35167 ай бұрын

  • This is such a relevant and timely video. Thanks bud. PS I love all your silicon valley video titles

    @hughesadam87@hughesadam878 ай бұрын

  • Great content! A how-to without any fluff what so ever that is easy to follow.

    @antonschillen2633@antonschillen263314 күн бұрын

  • This is fantastic info, thanks! Subscribed.

    @mhc4124@mhc41248 ай бұрын

  • This is just amazing! waiting for your embedding model

    @royxss@royxss9 ай бұрын

  • great video Jason - also my first ever comment on KZhead. Most practical tutorials on AI so far imo - I would be keen to see a video where you set up a vector DB and load your own data

    @sparebatteries@sparebatteries9 ай бұрын

    • Hah thanks, first comment means a lot to me! Will get more content :)

      @AIJasonZ@AIJasonZ9 ай бұрын

  • Much appreciated ❤️ Thanks man, this helped me alot!

    @khaledrweha6823@khaledrweha68237 ай бұрын

  • Excellent tutorial on finetuning Falcon 7B

    @BiranchiNarayanNayak@BiranchiNarayanNayak8 ай бұрын

  • Real thanks from another Jason man, clear and concise video! As a high schooler, I'd like to create an LLM project, so I hope I can follow through after I do my research :)

    @jasonwang3539@jasonwang35398 ай бұрын

  • Brilliant mate. Keep these coming

    @markmonfort29@markmonfort299 ай бұрын

  • So useful! Thank you!

    @AnonymousBosch3158@AnonymousBosch31589 ай бұрын

  • Would love to see the video on the knowledge database. Thank you for this!

    @chaseclingman@chaseclingman9 ай бұрын

  • Good Job Jason 👨🏽‍💻

    @user-vk5fj5mj8s@user-vk5fj5mj8s9 ай бұрын

  • Excellent lesson on Fine tuning. You are a good teacher. Thanks. Please make he next video I am now subbed.

    @chrismachabee3128@chrismachabee31289 ай бұрын

  • Oh man, this is so good, i always confused about when should i finetune LLM, this makes things super clear; Also falcon 40b seem to be an awesome choice!

    @jasonfinance@jasonfinance9 ай бұрын

  • Good stuff Jason🤙🏻

    @TheAiClub@TheAiClub9 ай бұрын

  • this is gold, thank you!

    @DavidPiccinelli@DavidPiccinelli8 ай бұрын

  • All thriller no filler. Wicked vid well done sir

    @arfh2759@arfh27599 ай бұрын

  • What an amazing to the point video! You're an amazing human being Jason. Keep doing you!

    @JayanaKalansuriya@JayanaKalansuriya9 ай бұрын

  • This is an amazing video that helps me make sense of the Azure Open AI playground to train my model. Love this.

    @JustRawFootage@JustRawFootageАй бұрын

  • Wow, what a sick video. Thanks so much!

    @indiecowan33@indiecowan335 ай бұрын

  • my man great content ever, keep it up

    @Blue-bd4vs@Blue-bd4vs9 ай бұрын

  • Bro you've done something wonderful for the world with sharing this video 🎉👏 As an app dev I learned something I didn't know I needed to know

    @serispeaks@serispeaks8 ай бұрын

  • give this man a cookie, dude thank you !!!!

    @CloudWithUgur@CloudWithUgur7 ай бұрын

  • Yes please, waiting for knowledge base embedding video ! 🎉

    @Hmelino@Hmelino8 ай бұрын

  • This channel is going to be huge.

    @davidconnelly@davidconnelly8 ай бұрын

  • Great video mate! Keep up the work (Y)

    @martinskov5155@martinskov51555 ай бұрын

  • Great video, dude! Thanks!

    @Trolosi123@Trolosi1238 ай бұрын

  • I have been spinning my wheels on a project and this video unstuck me - thanks a million!

    @ryanfarran@ryanfarran6 ай бұрын

  • fantastically clear

    @sup5356@sup53568 ай бұрын

  • I like it. Because your video i can follow it every step. It's important for a newbine .

    @lucaswei9133@lucaswei91339 ай бұрын

  • Astonishing content Man 👍👍👍

    @MasterBrain182@MasterBrain1829 ай бұрын

  • I appreciate this. Subscribed.

    @michaelnurse9089@michaelnurse90899 ай бұрын

  • Well explained my friend👏👏

    @wilfredomartel7781@wilfredomartel77819 ай бұрын

  • Thank you for sharing this. This will definitely help. Also epic thumbnail 😂

    @dreamingtulpa@dreamingtulpa9 ай бұрын

  • Absolutely loved the video mate! super focused! You inspired me for my own channel! thanks and keep it up! :))

    @DigitalMirrorComputing@DigitalMirrorComputing3 ай бұрын

  • Great video. Helped create a much tighter solution for our client.

    @SafetyLabsInc_ca@SafetyLabsInc_ca6 ай бұрын

  • Great content! thanks for sharing

    @mlavinb@mlavinbАй бұрын

  • Great job !

    @loudorz@loudorz7 ай бұрын

  • that was really good glad this was recommended to me

    @dubey_ji@dubey_ji9 ай бұрын

  • Thanks for sharing. It was helpful for understanding the fine tuning process. Can you also make a video on KnowledgeBase embedding? Thanks

    @chopradimpy@chopradimpy9 ай бұрын

  • really interesting! nice video! 🤗

    @CustAndCode@CustAndCode8 ай бұрын

  • This was super informative and I learned a lot. Great video!! Not to be rude, see this as a constructive comment, be aware of some typos you have along the video. It's not like it bothers me much or anyone, but correcting those little details add up to make your content even better! Good luck and I hope to watch more of your videos :D

    @th3j0t46@th3j0t468 ай бұрын

  • Thanks for sharing!

    @sohailhosseini2266@sohailhosseini22667 ай бұрын

  • Beyond excellent. Damn. Reminds me of Yolo and Stable diffusion in a way. I have got to read the papers sometimes and try tot write a C implementation. This is beautiful!!!!!

    @yelectric1893@yelectric18938 ай бұрын

  • thanks for this amzaing videos. looking forwards to your next videos for embedded knowledge base and creating a chatbot for UI using these trained models.

    @nsoe8990@nsoe89909 ай бұрын

  • Wow this is amazing, pure relevant data, tahnk you!, you got my subscription and like

    @Gos2@Gos28 ай бұрын

  • Awesome! I'm totally new to fine-tuning. I'm looking forward to fine-tuning a model with thousands of private 4K images!

    @user-cl5gh9pu6r@user-cl5gh9pu6r5 ай бұрын

  • Looking forward to the video on embedding a knowledge base

    @juansebastiansandovalcorre9254@juansebastiansandovalcorre92549 ай бұрын

  • Thank you Jin yang

    @wizarddon@wizarddon8 ай бұрын

  • you are legend tysm!

    @parkjunu2400@parkjunu24008 ай бұрын

  • Amazing, thank you!

    @AndrewsPanda@AndrewsPanda8 ай бұрын

  • Hi, Thanks for the excellent video.

    @Nono-ie3yk@Nono-ie3yk24 күн бұрын

  • excellent tutporial! thank you for sharing.

    @joseinTokyo@joseinTokyo5 ай бұрын

  • really helpful and straight forward. Subbed !

    @user-cn4co9mt4p@user-cn4co9mt4p2 ай бұрын

  • Ey 😊 awesome. I created a conversational api with context management in Java. I've used gpt-4 and learnt allot. I'm hoping I can make use of this as well. Nice video.

    @MYBLOODYUSERNAMEFFS@MYBLOODYUSERNAMEFFS8 ай бұрын

  • Amazing, you are the best bro. thanks

    @yush3402@yush34026 ай бұрын

  • 节奏好快，剪得厉害👍

    @judysu8992@judysu89928 ай бұрын

  • I have been looking for you for so long. Thank you so much for this. Now I can ditch open AI api key and use this for free for my usecase.

    @ayushnayak6138@ayushnayak6138Ай бұрын

  • Thanks for the detail level of explanation .....

    @raaajit1@raaajit14 ай бұрын

  • Waw that was amazing

    @C3r3P0weL@C3r3P0weL8 ай бұрын

  • Thanks for sharing such an amazing content! It would be great with you could also make a video about creating embeddings

    @joaopauloborges3866@joaopauloborges38665 ай бұрын

  • Damn amazing video

    @sameergamer4567@sameergamer45677 ай бұрын

  • Great video Jason.

    @mitchellsigley8574@mitchellsigley85749 ай бұрын

  • Great information. I am interested in the embedding style. Would love to see a video of that.

    @nithinchinni@nithinchinniАй бұрын

  • Hi it would be really great if you could make a video showing on how to create Auto layouts. If we have the content done via these, how do we lay it out in a ppt or Adobe indesign to continue with the design work. Any thoughts or suggestions here?

    @user-gx6uh9ih6h@user-gx6uh9ih6h8 ай бұрын

  • This video is excellent; I appreciate your hard work. Are you considering creating a video about DemoGPT?

    @DemoGPT@DemoGPT8 ай бұрын

  • Greaeeeeeeeeeeettttttt ! I have been surfing through internet for last 6 months for this type of workflow tutorial and here you have just made it. Thank you so much for this. My biggest question was how to prepare my own data to finetune a specific AI model for my use case. You have explained that part very easily. Now I can start making my own chatbots. P.S I am not a tech guy .... just an accountant.😅

    @sirrr.9961@sirrr.99619 ай бұрын

    • You should ditch your boring profession.

      @Theineluctable_SOME_CANT@Theineluctable_SOME_CANT8 ай бұрын

  • OMG. It's amazing. I was just wondering after a little research on the fine-tuning processes. There are actually 3 levels: Unsupervised Fine-Tuning, Instruction Fine-Tuning, RLHF. How to actually do that in coding? I couldn't really find documentations for that on different models. Some models have first two, others have just level 2. Could you provide some guide?

    @user-mz8gr1bb2v@user-mz8gr1bb2v6 ай бұрын

  • Thank you for the video. Is this the way to make LLM good at certain languages (spoken ones)?

    @Unknown-ki8yk@Unknown-ki8yk8 ай бұрын

  • 🎯 Key Takeaways for quick navigation: 00:00 *🤖 Methods for GPT Usage* - Two methods discussed: fine-tuning and knowledge base. - Fine-tuning: Suitable for modifying behavior, like mimicking specific individuals. - Knowledge base: Utilized for providing accurate domain-specific data, such as legal or financial information. 01:38 *💡 Case Study: Fine-Tuning for Military Purpose* - Selection of a powerful large language model (Falcon) for fine-tuning. - Importance of quality dataset for fine-tuning model effectiveness. - Utilization of GPT to generate training data and platforms like Randomness AI for bulk processing. 05:08 *🛠️ Fine-Tuning Process* - Preparation steps for fine-tuning on Google Colab, including library installation and model loading. - Use of Low-Rank Adapters for efficient fine-tuning. - Saving and uploading the trained model to Hugging Face for sharing and further use.

    @trunkmak2@trunkmak217 күн бұрын
KZhead