La notation Big O en langage clair
← Retour aux articles La notation Big O décrit la façon dont le travail d’un algorithme évolue lorsque la quantité […]
Les algorithmes en clair, Uncategorized
Uncategorized
LLMs Derived, Uncategorized
Speculative Decoding: Faster Generation Without Changing the Target
← Back to Blog & Articles Speculative decoding uses a faster draft model to propose several tokens, then asks the […]
LLMs Derived, Uncategorized
DPO: Preference Optimization Without a Reward Model Loop
← Back to Blog & Articles Direct Preference Optimization turns paired preferences into a classification-like objective. It increases the relative […]
LLMs Derived, Uncategorized
LoRA: Fine-Tuning Through a Low-Rank Update
← Back to Blog & Articles Low-rank adaptation, or LoRA, keeps a pretrained weight matrix fixed and learns a compact […]
LLMs Derived, Uncategorized
How to Count Transformer Parameters Without Guessing
← Back to Blog & Articles Parameter counting reveals where model memory and compute are concentrated. The reliable method is […]
LLMs Derived, Uncategorized
Tokenization Changes What a Language Model Sees
← Back to Blog & Articles A language model does not receive words directly. It receives token identifiers produced by […]
LLMs Derived, Uncategorized
Why Scaled Dot-Product Attention Divides by Square Root of d
← Back to Blog & Articles The scaling factor in attention is not decorative. It keeps dot products in a […]
The AI Algorithms Compendium, Uncategorized
RAG Is a Pipeline, Not a Single Algorithm
← Back to Blog & Articles Retrieval-augmented generation connects a language model to an external collection. Its quality depends on […]
The AI Algorithms Compendium, Uncategorized
Q-Learning and Policy Gradients Solve Different Problems
← Back to Blog & Articles Q-learning estimates the value of actions; policy-gradient methods adjust a policy directly. Both optimize […]
The AI Algorithms Compendium, Uncategorized
Why Attention Replaced Recurrence in Many Sequence Models
← Back to Blog & Articles Recurrent networks process sequence positions through a chain of hidden states. Attention creates direct, […]