Deep Learning Frameworks Compared Pytorch Vs Tenso
We need a task that’s big enough to show the moving parts but small enough to hold in your head. Here it is: we’ll train a 2-layer neural network on synthetic regression data. That’s it.
Deep Learning
Christopher Bishop S Pattern Recognition And Machi
Before we go any further, we need to clear up a common confusion. Christopher Bishop has written two major books, and people often conflate them.
Bert Explained What Bidirectional Actually Means A
You're reading a sentence. You hit the word "bank." Do you think of a river bank or a savings bank? The answer depends on what comes before *and* after.
Batch Size And Learning Rate A Quick Reference Gui
Let’s start with the rule you’ll see cited everywhere. In their 2017 paper “Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour,” Goyal et al.
Activation Functions Reference Relu Sigmoid Tanh G
weights = torch.tensor([0.5, -0.8, 1.2]) bias = torch.tensor(0.1)
Multi Agent Reinforcement Learning When Agents Hav
Think back to the DQN from Part 5. It worked because the environment was **stationary**. The transition probabilities — the chance of going from state A to state B given an action — didn't change while the agent was learning. The reward function was fixed. The agent was the only thing changing in the world.
Policy Gradients And Reinforce Learning A Policy D
Remember the DQN from Part 5? It took a state (4 numbers for CartPole) and output 2 Q-values — one for pushing left, one for pushing right.
Deep Q Networks What Happens When Q Learning Meets
Remember the FrozenLake problem from Part 4? A 4×4 grid, 16 states, 4 actions. A Q-table with 64 entries. It worked beautifully.
Machine Learning In Healthcare Diagnosis Support R
Before we dive into successes and failures, we need a shared vocabulary. Healthcare ML isn't one thing. It's three broad categories that behave very differently:
Reference: Optimizers
A reference covering neural network optimizers from GD to AdamW, with learning-rate schedules, decision trees, and practical guidance for each architecture.
Reference: Loss Functions (the Training Objective)
A reference on training loss functions—MSE, cross-entropy, Huber, hinge, contrastive, and triplet—with formulas, gradient shapes, and selection guidance.
Reference: Activation Functions
A consolidated reference of activation functions—sigmoid, tanh, ReLU, GELU, softmax—with formulas, output ranges, gradient properties, and when to use each one.
Why Isn't My Model Learning? A Friendly Guide to Diagnosing Deep Learning Dead-Ends
Learn a practical 4-step checklist to diagnose stalled deep learning models: overfit one batch, check gradients, scale data, and sweep learning rates.
Batch Normalization and Dropout: The Regularization Tricks That Make Deep Learning Actually Work
Learn how Batch Normalization and Dropout fix overfitting and training instability in deep networks, with practical PyTorch code and layer-ordering guidance.
Borrowing Brains: A Beginner's Guide to Transfer Learning and Fine-Tuning
Learn how transfer learning lets you borrow pretrained models like ResNet and BERT, swap their heads, freeze the body, and fine-tune for custom tasks.
Building a Miniature Transformer From Scratch: The 'Lego' Approach to Deep Learning
Build a miniature Transformer from scratch in PyTorch by snapping together embeddings, multi-head attention, and positional encoding like Lego bricks.
Multi-Head Attention and Positional Encoding: Giving the Transformer a Sense of Direction
Discover how positional encoding gives Transformers word-order awareness and multi-head attention tracks multiple patterns at once in this hands-on guide.
The Attention Mechanism, Finally Explained (Without the Matrix Algebra)
Understand the attention mechanism powering every modern language model—queries, keys, values, and softmax explained through analogies and Python code.
LSTMs and GRUs: Giving Networks a Memory
Learn how LSTMs and GRUs use gated memory to beat the vanishing gradient, retaining early signals across long sequences for better sequence predictions.
Why RNNs Forget: The Intuition Behind the Vanishing Gradient Problem
See why RNNs forget early sequence signals: backpropagation multiplies small weights across steps, so the gradient vanishes before reaching the first input.
Why Computers See Better with CNNs: An Intuitive Guide to Image Recognition
Learn why CNNs outperform dense networks for image recognition by using sliding filters, shared weights, and pooling to detect spatial patterns efficiently.
Why Deep Networks Die: Solving the Vanishing Gradient Problem with ReLU, ResNets, and BatchNorm
Learn why deep neural networks stop learning as they grow deeper, and discover how ReLU, ResNets, and BatchNorm solved the vanishing gradient problem.
Backpropagation Intuitively: How Networks Learn From Their Mistakes
Learn how backpropagation works intuitively—no calculus needed. See how neural networks assign blame to weights via the chain rule and learn from mistakes.
Neural Networks, Without the Calculus: What's Actually Happening Inside a Single Neuron
Learn how a single artificial neuron works without calculus—weights, bias, and sigmoid activation combine evidence into calibrated probabilities.