🔊 “Want to go super deep into LLMs? Do an advanced project with Langchain”…
[Read More]
Day 19 of 100 days of large language models
API response streaming for reducing perceived LLM latency
🐢 LLMs can be slow. Working on a recommender solution, beautiful output but oh my, the latency of API batch!
[Read More]
Day 18 of 100 days of large language models
Tip for LangChain
💡 Tip for #langchain users: pip install -U langchain
[Read More]
Day 17 of 100 days of large language models
Fine-tuning LLaMa 7B on my home RTX3090
🦸♂️ Today I learned to fine-tune LLaMa 7B on my home RTX3090 GPU with 24GB VRAM, using QLoRA (Quantized Low-Rank Adaptation)!
[Read More]
Day 16 of 100 days of large language models
Completed LangChain & Vector Databases in production course
⚡️ Supercharged my learning with another LangChain course completed. 8 days of early starts, night sessions, one weekend, and 70(!) Python scripts later!
[Read More]