Deep Dive into LLMs – Chapter 1: Data Collection & Preprocessing
Deep Dive into LLMs Chapter 1: Data Collection & Preprocessing written by Tamás Fodor These articles are loosely based on Andrej Karpathy’s technical deep dive into Large Language Models. Karpathy is the former Director of AI at Tesla and an OpenAI founding member. His recent lecture provides one of the most comprehensive technical explanations of […]
Deep Dive into LLMs – Chapter 2: Tokenization
Deep Dive into LLMs Chapter 2: Tokenization written by Tamás Fodor These articles are loosely based on Andrej Karpathy’s technical deep dive into Large Language Models. Karpathy is the former Director of AI at Tesla and an OpenAI founding member. His recent lecture provides one of the most comprehensive technical explanations of how systems like […]
Deep Dive into LLMs – Chapter 3: Neural Network Architecture
Deep Dive into LLMs Chapter 3: Neural Network Architecture written by Tamás Fodor These articles are loosely based on Andrej Karpathy’s technical deep dive into Large Language Models. Karpathy is the former Director of AI at Tesla and an OpenAI founding member. His recent lecture provides one of the most comprehensive technical explanations of how […]
The InstructGPT Breakthrough: Teaching AI to Actually Follow Instructions
The InstructGPT Breakthrough: Teaching AI to Actually Follow Instructions How OpenAI solved one of AI’s biggest problems by learning from human feedback written by Tamás Fodor When GPT-3 first amazed the world with its text generation capabilities, it had one major flaw: it often didn’t do what users actually wanted. Ask it to write a […]
Availability Is More Than Just Uptime – Designing Truly Scalable Systems
Availability Is More Than Just Uptime – Designing Truly Scalable Systems In DevOps and SRE roles, we often fall into the trap of equating availability with simple uptime. “All systems green? Then everything’s fine.” But that assumption is dangerously misleading especially in today’s world of complex, rapidly scaling systems built on microservices or even modern […]
AI Utopia – Arguments in Favor of Artificial Intelligence
AI Utopia – Arguments in Favor of Artificial Intelligence written by Tamás Fodor Stephen Hawking: AI will be ‘either best or worst thing’ for humanity How can artificial intelligence make the world better? The rapid fundamentally transforming our relationship with work, learning, and everyday life. As we stand on the threshold of this transformation, it is […]
AI Dystopia: Arguments Against Artificial Intelligence
AI Dystopia: Arguments Against Artificial Intelligence written by Tamás Fodor Stephen Hawking: AI will be ‘either best or worst thing’ for humanity What risks does the development of artificial intelligence pose? The increasingly rapid spread of AI raises fundamental questions about the safety of our society, the authenticity of information, and the future of our work. As […]
