The 17th Lok Sabha (2019–2024) averaged 55 sitting days a year — the lowest of any full-term parliament. The National Commission to Review the Constitution recommended a minimum of 120 days. India's Constitution recommends no minimum at all. Every number in this post is sourced directly from PRS Legislative Research, PIB press releases, or official parliamentary records. Where sources disagree, both figures are shown.

The Same Parliament, Two Sessions Apart

2025 opened with a Budget Session that exceeded its scheduled time. Then the Monsoon Session functioned at 29% of its scheduled hours. Same parliament. Four months apart.

PRS and PIB use different productivity methodologies — both are shown. The gap between the two sessions, by either measure, is not marginal.

The Bills That Took Minutes

In the Monsoon Session 2025, Parliament passed 14 bills (PRS count, excluding finance/appropriation). The chart below shows how much time Lok Sabha actually spent debating each of them, against the time formally allocated on the agenda.

The Income-Tax (No.2) Bill 2025 replaced the original Income Tax Bill (which had been referred to a Select Committee in the Budget Session). The replacement was introduced and passed in Lok Sabha in a single day, with 4 minutes of LS debate. The Merchant Shipping Bill waited 244 days after introduction, then received 20 minutes. Rajya Sabha, in contrast, gave several of these bills 1–2 hours each — which the Lok Sabha number obscures.

The 70-Year Decline

Lok Sabha sitting days per year, from the first session in 1952 to today. Every bar extracted directly from the Ministry of Parliamentary Affairs Statistical Handbook.

Peak: 168 days in 1954. The low points are not random — 1975–77 is the Emergency, 1977 is the election year, 2008 was 30 days (the lowest post-Emergency year), 2020 was COVID. The 10-year rolling average has not been above 100 since 1974.

Session by Session: The Full Picture

Every session of the 17th and 18th Lok Sabha — productivity, collapse points, and bills passed per sitting.

Budget 2023 is the worst single session: 33% overall, with Part II running at just 5%. Monsoon 2021 at 21% — Parliament was in session but almost entirely disrupted by the Pegasus and farm laws controversies. Budget 2022 at 123% shows the same parliament can work when it chooses to.

Five Years of the 17th Lok Sabha

These are aggregate statistics from the PRS summary of the complete 17th Lok Sabha (June 2019 – February 2024). They are not per-session estimates — they are the published totals.

The 729 Private Member Bills introduced → 2 discussed is not a rounding error. 729 bills were formally introduced by MPs; 2 received floor time. The last Private Member Bill to actually pass Parliament was in 1970.

MPs Who Raised Matters Parliament Never Addressed

Every year, MPs formally file matters they want to raise. When Parliament is disrupted, these go unaddressed. The chart counts exactly how many were filed but never taken up — under Rule 377 in Lok Sabha, and Rule 180 in Rajya Sabha.

2022: 306 LS matters and 412 RS matters unaddressed. Winter 2022 alone accounts for 260 of the LS total — the session had 8 of 10 business days disrupted and 23 RS MPs suspended. The 2025 Budget figure (473 LS) is high because Rule 377 is deprioritised in busy sessions even when Parliament is functional — not a pure disruption signal. 2023 LS data absent from the Ministry’s published dataset.

When Disruptions Hit the Two Houses Differently

The government tracks exact hours lost to forced adjournments per session, per house. Winter 2024 shows the sharpest contrast: Rajya Sabha lost 65.7% of its time to disruptions while Lok Sabha, in the same session, lost only 4.6%.

Winter 2024 RS was disrupted by a notice to remove the Vice-President and a judge impeachment notice — neither passed, but both consumed the house. LS continued functioning. Same Parliament, same weeks, opposite outcomes.

How India Compares

Counting parliamentary sitting days across countries is harder than it looks — different countries measure different things. The chart below uses only verified primary-source figures, with methodology noted per row.

India’s 55 days is an average across a full 5-year term. Japan’s 150 days is calendar days the session is open, not necessarily plenary sittings. Germany and Canada figures are converted from sitting weeks (IPU data) — treating 1 week as 5 days. The comparison is directionally valid, not exact.

The Data

Every fact in this post is traceable to a primary source. Nothing is approximate.

Primary sources used:

What this post does not claim: All figures cited from secondary sources that cite PRS (e.g., The Week, Drishti IAS) are excluded from visualizations — only direct primary source fetches are used. Session productivity % for Monsoon 2020 and Special 2023 are unavailable (PRS pages returned 404).

Japan loses 99 hours of trading time to holidays each year — more than any other major exchange. India loses 87.5 hours across 14 closures. China loses only 72 hours despite having 18 holidays. Same counts, wildly different costs — because the pattern matters as much as the total. Every number below is verified from official exchange sources.

Where Every Holiday Falls

Each dot is one weekday the market is closed. Position is exact — placed by week within the year. Hover to see the holiday name.

India’s row is a dashed line — one dot almost every month, never clustered. China’s row is the opposite: six solid blocks you can plan around. Germany and LSE clear the entire mid-year with almost nothing.

What It Actually Costs

The count of holidays is misleading without session length. Germany and LSE each close 8 times but run 8.5-hour days. China closes 18 times but trades only 4 hours a day.

Japan’s 2024 extension to 5.5-hour sessions (removing the lunch break, effective Nov 5 2024) pushed its annual hours-lost above everyone else — a fact absent from most market commentary.

What Each Country Decides Is Worth Stopping For

Japan closes for 13 civic holidays and only 2 cultural ones. India is the opposite — 10 religious festivals and 3 civic days. The breakdown reveals institutional character more than any count does.

JPX has a category none of the others have: 3 exchange-declared market holidays (Jan 2, Jan 3, Dec 31) with no civic or religious basis — the exchange simply decided those days don’t trade.

How Many Weeks Are Actually Interrupted

Same holiday count can mean very different disruption rhythms. Each square below is one trading week — colored if it contains at least one closure, dark if completely clean.

China has 18 holidays but only 9 disrupted weeks — clusters compress the damage. India has 14 holidays but 12 disrupted weeks because every closure is isolated. Xetra’s 33-week uninterrupted streak (late April through November) is the cleanest continuous trading window of any major exchange.

The Data

Every date, name, type, and block grouping — verified from official exchange circulars and the open-source exchange_calendars package. No approximations.

Sources per exchange:

Every PFBR headline just repeated "Three-Stage Nuclear Power Programme" without explaining what the stages actually mean, what fuel flows between them, or why India — specifically India — had no other choice. I went looking for the complete picture. This post covers India's uranium scarcity problem, Homi Bhabha's 1954 roadmap, and what first criticality at Kalpakkam actually unlocks — with interactive simulations of the chain reaction, the full fuel relay, and the PFBR's three-loop sodium coolant system.

I. Introduction: The Moment of “First Light”

On April 6, 2026, the 500 MWe Prototype Fast Breeder Reactor (PFBR) at Kalpakkam achieved “first criticality.” While this event generated widespread headlines, I wasn’t able to understand why it mattered and what the goal is here. I just kept reading flashy words and “Three-Stage Nuclear Power Programme.” This is what I understood after all my searches and asking Gemini to explain concepts. I hope it helps to get a complete picture.

First, to understand the significance of this moment, it is necessary to strip away the dramatic connotations of the word criticality (I thought criticality is a negative word 🙂!). In nuclear physics, it is the precise mathematical point of balance; it marks the exact moment when the nuclear fission chain reaction inside the core becomes self-sustaining. The reactor is producing exactly as many neutrons as it is losing or consuming. In engineering terms, achieving first criticality means the machine has successfully transitioned from a dormant construction project to a “living,” operational physics environment. The engine has officially started.

In general, how any electricity generation process works (other than solar — I always feel why we don’t have other ways) is somehow you convert other energies to rotate a turbine (wind turbine, water turbine, steam turbine, etc). Here in nuclear reactors we use fission — the breakdown of the atom — which releases a vast amount of energy to heat up a coolant, and that hot coolant passes the energy to generate steam, which rotates the turbine, and you know what is next ⚡️⚡️⚡️. However, the true weight of the PFBR lies not in the electricity it will eventually generate, but in its role as a “bridge.” India’s nuclear power strategy operates on a unique, three-stage roadmap designed to solve a severe geographical handicap: the country possesses very little high-quality uranium, but holds the world’s largest reserves of thorium. The PFBR represents the critical “Stage 2” of this roadmap. It is the industrial-scale proof of concept that will allow India to transition from a uranium-dependent past to a thorium-powered future (self-sustainability, autonomy, protection from Middle East conflict — Indian Govt will say “Atmanirbhar Bharat”, say whatever you want).

II. The “Why”: India’s Unique Problem

The Resource Gap: The foundation of India’s nuclear strategy is dictated by geology. India possesses very limited domestic reserves of high-grade uranium. Relying purely on imported uranium exposes the national power grid to global market volatility, supply chain disruptions, and geopolitical pressure. However, India is home to an estimated 25% of the world’s “economically extractable” (this is important — it’s not like finding Lithium in Ladakh which might not be economically viable to extract) thorium reserves, found predominantly in the monazite sands along the coasts of Kerala, Tamil Nadu, and Odisha.

The Strategy: Recognizing this stark resource imbalance in 1954, physicist Dr. Homi J. Bhabha formulated the “Three-Stage Nuclear Power Programme.” Rather than perpetually importing uranium to power standard reactors, Bhabha’s roadmap was designed to sequentially build the technology required to unlock the vast domestic thorium reserves. The end goal was — and remains — absolute energy autonomy.

The Global Comparison: A common question is why technologically advanced nations like the United States or France do not use thorium. The answer lies in the Cold War (lots of our past is indirectly tied to the Cold War) and pure economics. The global nuclear infrastructure was built around the “Uranium Cycle” largely because the early reactors were tied to military programs. Today, enriched uranium is a highly commoditized, easily accessible fuel on the global market. For Western nations, it is far more economical to simply buy uranium than to spend billions of dollars developing complex thorium reactors from scratch. India, lacking domestic uranium but rich in thorium, was forced to forge its own path.

III. Stage 1: The Foundation (The “Slow” Starters)

The Technology: To begin the three-stage process, India deployed Pressurized Heavy Water Reactors (PHWRs). Today, a fleet of approximately 18 to 20 PHWRs serves as the operational backbone of India’s civilian nuclear power grid.

The Physics (The “Catch”): The key operational feature of a PHWR is that it uses Natural Uranium. Natural uranium is comprised of about 99.3% Uranium-238 (which is highly stable) and only 0.7% Uranium-235 (which splits easily). To sustain a nuclear fission chain reaction with such a tiny concentration of U-235, the physics must be strictly managed. The U-235 atoms require slow-moving neutrons to trigger fission.

To achieve this, the reactor uses Heavy Water (deuterium oxide) as a “moderator.” The heavy water acts as a physical brake. When high-speed neutrons are released from a splitting atom, they crash into the heavy water molecules, lose kinetic energy, and slow down to “thermal” speeds. This deceleration is what allows the U-235 to catch the neutrons and keep the power plant running.

The Strategic Output: The immediate output of Stage 1 is commercial electricity. However, the long-term strategic output is found in the nuclear waste. While the reactor burns the U-235, the massive surrounding quantity of U-238 inside the fuel rods absorbs stray neutrons. In doing so, the U-238 transmutes into Plutonium-239. Once the fuel rod is “spent,” engineers chemically reprocess it to extract this plutonium. This extracted plutonium is the indispensable “starter fuel” required to ignite the Stage 2 Fast Breeder Reactors. Without Stage 1 running for decades to slowly accumulate plutonium, Stage 2 could never begin.

Interactive: Nuclear Chain Reaction

The visualization below shows the fundamental physics at work inside every stage of this programme. Each blue circle is a U-235 atom. Fire a single neutron — watch it trigger a cascade.

Each fission releases 2–3 neutrons. Each of those can trigger another fission. One neutron → exponential cascade. This is the chain reaction that all three stages of India’s programme depend on.

The Three-Stage Fuel Relay at a Glance

Before diving into Stage 2, here’s the full fuel relay from start to finish — each stage feeds the next.

Hover over each stage. Arrows show what fuel passes between stages; each stage outputs electricity as a side-effect of its primary mission.

IV. Stage 2: The PFBR (The “Fast” Factory) — Where we are now

The “Breeder” Concept (Two Phases): With the PFBR reaching criticality, India has officially activated Stage 2. Unlike standard reactors that simply consume fuel until it is depleted, the PFBR is a “breeder” designed to produce more fissile material than it consumes. Because the ultimate goal of the programme requires a massive stockpile of new fuel, Stage 2 actually operates in two distinct, sequential phases:

• Stage 2A (The Multiplier): This is the current phase. The core of the reactor is fueled by the Plutonium harvested from Stage 1. Surrounding this active core is a “blanket” of Uranium-238 (the leftover waste from Stage 1). As the Plutonium undergoes fission, it releases neutrons that strike the U-238 blanket, transmuting it into fresh Plutonium. The goal of Phase 2A is strictly to breed enough Plutonium to build a larger fleet of breeder reactors.
• Stage 2B (The Thorium Bridge): Once India has bred enough Plutonium to sustain a fleet of Stage 2 reactors, the “recipe” changes. Engineers will replace the U-238 blankets with blankets of Thorium-232. The Plutonium core remains the “engine,” but the fast neutrons will now bombard the Thorium, transmuting it into the man-made superfuel: Uranium-233. This U-233 is collected and stockpiled to eventually trigger Stage 3.

The Necessity of “Fast” Neutrons: To make both phases of this breeding process work, the physics must be the exact opposite of Stage 1. The transmutation of U-238 (and later Thorium) requires high-energy, “fast” neutrons. If the reactor used water as a coolant, the water would act as a moderator, slowing the neutrons down and instantly stopping the breeding process. Therefore, the PFBR cannot use water.

The Sodium Secret: The solution is Liquid Sodium. Sodium is a heavy metal; when neutrons hit sodium atoms, they bounce off without losing their speed, allowing the breeding to continue. Furthermore, sodium possesses remarkable thermal properties. While water boils at 100°C and requires massive, thick pressure vessels to prevent steam explosions, liquid sodium does not boil until 882°C. The PFBR operates at around 550°C, meaning the liquid metal coolant flows through the reactor at normal atmospheric pressure, eliminating the risk of a high-pressure explosion.

The Engineering Hurdle: The trade-off for these benefits is a severe engineering challenge. Sodium is highly reactive: it burns upon contact with air and explodes upon contact with water. Because it is an opaque metal, engineers cannot simply look inside the reactor; they must rely on advanced ultrasonic sensors and robotics for monitoring and maintenance.

The Three-Loop Safety System: {#the-three-loop-safety-system} To safely turn this intense heat into electricity, the PFBR utilizes a strict three-loop system.

1. The Primary Loop: Radioactive liquid sodium flows through the core, absorbing heat.
2. The Secondary Loop: This heat is transferred to a second, non-radioactive loop of liquid sodium. This acts as a physical firewall.
3. The Tertiary Loop (Water): The secondary sodium loop travels outside the reactor to a heat exchanger, where it boils water into high-pressure steam to spin the electrical turbines. If a pipe breaks in the steam generator, the water will only react with the non-radioactive secondary sodium, completely isolating the nuclear core from the chemical reaction.

V. Stage 3: The Thorium Era (The End Goal)

The Paradigm Shift: It is crucial to understand that Stage 3 is not just the PFBR running on different fuel; it requires an entirely new class of reactor. Once India has used its Stage 2 breeder reactors to stockpile enough Uranium-233 (created by substituting the U-238 blankets with Thorium-232), that fuel will be transferred into Advanced Heavy Water Reactors (AHWRs). This marks the beginning of Stage 3.

The Closed Loop: Inside the AHWR, the operational physics finally reach their endgame. The core is fueled by the Uranium-233, and it is surrounded by a blanket of pure Thorium. As the U-233 fissions to create commercial electricity, the neutrons it releases strike the Thorium blanket, transmuting it into new U-233. The reactor breeds exactly enough fuel to sustain itself. At this stage, the loop is closed: the system requires only raw thorium as an input, effectively severing India’s reliance on global uranium markets forever.

The Proof of Concept (KAMINI): The idea of running a power grid on U-233 is not a theoretical hope. India currently operates the Kalpakkam Mini reactor (KAMINI), a small research facility that holds a unique distinction: it is currently the only reactor in the world operating on Uranium-233 fuel. KAMINI proves definitively that the physics of Stage 3 are sound and achievable.

The Decades-Long Hurdles: Reaching Stage 3 at a commercial scale is expected to take until the 2040s or beyond due to two immense, unavoidable bottlenecks:

1. The Fuel Bank (“Doubling Time”): It takes roughly 10 to 15 years for a breeder reactor to produce enough excess fuel to start a second reactor. India must patiently wait for the Stage 2 reactors to breed a massive, national stockpile of U-233 before large-scale AHWRs can be commissioned.
2. The U-232 Robotics Problem: When Thorium is converted into U-233 inside a reactor, a side-reaction inevitably creates trace amounts of an isotope called Uranium-232. As U-232 decays, it produces Thallium-208, which emits incredibly intense, highly penetrating 2.6 MeV gamma radiation. Because of this extreme radiation, human technicians cannot safely handle or manufacture U-233 fuel rods. The transition to Stage 3 requires the development of heavily shielded “hot cells” where the fuel fabrication is handled entirely by automated robotics.

VI. Conclusion: The Thorium Advantage and the Final Payoff

If the Three-Stage Programme takes nearly a century to complete, and involves immense engineering hurdles like liquid sodium and robotic fuel fabrication, the ultimate question is: Is it worth the wait? The answer lies in the massive environmental and strategic advantages of the Thorium cycle. By reaching Stage 3, India will not just achieve energy independence; it will achieve a level of nuclear sustainability that the standard “Uranium Cycle” cannot match.

The Ultimate Recycling Machine: One of the greatest criticisms of global nuclear power is the accumulation of radioactive waste. India’s Stage 2 breeder reactors directly address this. The PFBR and its successors actively consume the “nuclear waste” (Uranium-238 and Plutonium) generated by the Stage 1 reactors over the last fifty years. Instead of burying this waste in deep geological repositories, India is using it as the primary fuel to build the bridge to Thorium.

The Efficiency Multiplier: In a standard Stage 1 reactor, roughly 1% of the mined uranium is actually converted into energy; the rest is discarded. In the closed-loop Thorium cycle of Stage 3, because the reactor constantly breeds its own fuel, close to 100% of the mined thorium is utilized. Theoretically, one tonne of Thorium can yield the energy equivalent of 200 tonnes of conventional Uranium.

The Waste Lifespan: Nuclear fission inherently creates radioactive byproducts, but not all waste is equal. The waste from a standard Uranium reactor contains heavy “transuranic” elements (like Plutonium, Americium, and Curium) that remain dangerously radioactive for tens of thousands of years. Thorium, however, is a lighter element. The fission byproducts of the Thorium/U-233 cycle are far less toxic, and the bulk of its radioactive waste decays back to safe, natural background radiation levels in approximately 300 years — a timeframe that human engineering and geology can easily manage.

The Final Meaning of Kalpakkam’s Criticality

When the PFBR at Kalpakkam reached first criticality on April 6, 2026, it was not merely testing a new turbine or bringing a few more megawatts to the grid. It was proving that the hardest, most dangerous physics of the Three-Stage Programme — the fast neutrons and the liquid metal coolants — could be safely tamed on an industrial scale.

India still has decades of work ahead. The PFBR must now run for years to multiply its Plutonium (Stage 2A), before shifting its diet to breed Uranium-233 (Stage 2B), and eventually handing that superfuel over to the automated robotic facilities of Stage 3.

It is a grueling, multi-generational marathon. But with the PFBR now “awake” and self-sustaining, India has successfully crossed the hardest technical threshold. The bridge to a century of clean, independent, and sustainable Thorium power is officially open.

Why Do We Need Differentiable Loss Functions?

Deep learning models—like the ones powering LLMs or your favorite image generator—are trained using gradient-based optimization algorithms, stuff like gradient descent. These algorithms are basically the GPS for training: they figure out how to adjust the model’s parameters (those millions of tiny weights) to make the loss—the “how wrong are we?” score—as small as possible. To do that, they need to calculate the gradient of the loss function with respect to those parameters. Think of the gradient as a little arrow saying, “Nudge this weight up a bit, and the loss goes down,” or “Tweak that one down, it’s messing things up.”

Now, here’s the catch: gradients only exist if the loss function is differentiable. That just means it’s smooth enough that we can measure how it changes when we tweak the inputs—no sudden jumps or breaks where the slope goes haywire.

What Happens If the Loss Function Isn’t Differentiable?

If the loss function isn’t differentiable, gradient-based optimization—the backbone of deep learning—falls apart. Those little arrows we rely on? Gone. Without them, we can’t tell the model which way to tweak its weights, and it’s stuck, unable to learn. Sure, there are derivative-free optimization methods out there—like random search or evolutionary algorithms. Those methods are way less efficient, especially when you’re dealing with the crazy high-dimensional parameter spaces in deep learning models.

Here’s something that might trip you up: in Group Relative Policy Optimization (GRPO), reward functions don’t have to be differentiable—think stuff like the length of a generated response or whether it even contains an answer. So how are we still using GRPO to fine-tune LLMs, which live and breathe gradients?

TLDR:

“The advantage (normalized reward) acts as a constant or scaling factor in the GRPO Loss”

GRPO, cooked up by the DeepSeek team, is a twist on reinforcement learning (RL) that’s all about efficiency and stability when fine-tuning LLMs. It builds on the idea of PPO—using human feedback to guide the model—but it’s got some unique tricks up its sleeve, especially with how it handles rewards. Let’s break it down.

The Basics of GRPO

In GRPO, the LLM is your policy ($\pi_\theta$), spitting out responses based on prompts. You’ve got a reward model ($R_\phi$)—trained on human feedback or reward function—that scores those responses.

Unlike traditional RL methods like PPO, GRPO skips the critic (a separate model estimating future rewards), which cuts compute costs by about 50%. Instead, it uses a clever way to judge how good a response is by comparing it to a group of other responses for the same prompt. That’s where the “group relative” part comes in.

The Reward Function in GRPO

Here’s where it gets interesting: the reward function in GRPO doesn’t need to be differentiable. It could be something simple and rule-based, like:

• “How long is this response?” (e.g., word count)
• “Does it actually answer the question?” (e.g., 1 if yes, 0 if no)
• “Is it toxic?” (e.g., a binary flag from a rule-based checker)

These are discrete, step-like signals—not smooth curves you’d expect gradients to flow from. But GRPO still can use a reward model $R_\phi$ to assign scores, and that’s often a neural network trained on human feedback (like “this response is better than that one”). So, you might have a mix: a differentiable reward model for some parts, plus these non-differentiable, rule-based rewards tossed in.

The GRPO Loss Function

Demonstration of PPO and GRPO. GRPO foregoes the value model, instead estimating the baseline from group scores, significantly reducing training resources. (Source: DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models)

Let’s get to the meat of it—the loss function that makes GRPO tick. The goal is to tweak the LLM’s parameters ($\theta$) to maximize rewards, but with some guardrails to keep things stable. Here’s the equation:

$\mathcal{L}_{\text{clip}}(\theta)$: This is the clipped surrogate loss, adapted from PPO for GRPO. It encourages better responses while preventing excessive policy changes:

Where:

• $r_t(\theta) = \frac{\pi_\theta(a_t

  s_t)}{\pi_{\text{old}}(a_t

  s_t)}$ is the probability ratio—comparing how likely the new policy is to generate this response versus the old policy

• $A_t$ is the advantage, measuring how much better (or worse) this response is compared to others in the group
• The clip function keeps changes bounded (typically $\epsilon = 0.2$) to maintain stability

A key innovation in GRPO is how it calculates the advantage ($A_t$). Instead of using a separate critic model like PPO does, GRPO computes it by comparing a response’s reward to the group statistics:

Where $R_\phi(r_i)$ is the reward for response $r_i$, and $\mathcal{G}$ represents the group of responses for the same prompt.

The $\text{mean}(\mathcal{G})$ and $\text{std}(\mathcal{G})$ terms represent the average and standard deviation of rewards across the group, respectively. This normalization transforms raw rewards into relative advantages, making training more stable by comparing each response to its peers.

Why Non-Differentiable Rewards Still Work in GRPO

Okay, so how does GRPO handle rewards like “length of the generation” or “contains an answer,” which aren’t differentiable? Here’s the trick: the reward itself doesn’t need to be differentiable—what matters is how it’s used in the optimization. Let’s unpack this:

1. Rewards Are Just Scores:

• In GRPO, the reward function—whether it’s a fancy neural network $R_\phi$ or a simple rule like “1 if it answers, 0 if not”—is only there to assign a number to each response. That number (the reward) isn’t differentiated directly. It’s a fixed value that feeds into the advantage calculation.

1. Advantages Drive the Gradients:

• The advantage $A_t$ is computed from those rewards, and it’s just a normalized comparison (better or worse than the group). It’s not differentiated either—it’s a constant for each response.
• The differentiable part comes in the policy update. The loss $\mathcal{L}{\text{clip}}$ depends on the LLM’s probabilities ($\pi\theta$), which are differentiable. The gradients flow through the policy, not the reward or advantage directly.

Now, here’s the part that clicked for me: in the GRPO loss function, the advantage $A_t$ acts like a constant or scaling factor. Check this out:

The $r_t(\theta)$ part—the probability ratio—is what the LLM tweaks, and it’s totally differentiable. The advantage $A_t$? It’s just a number we calculate from the rewards, like “this response is 1.5 better than average.” It scales how much we push the model toward or away from that response, but we don’t need to differentiate it. It’s fixed for that step.

So, even if the reward function is something chunky and non-differentiable—like “1 if the answer’s there, 0 if not”—it doesn’t matter. The reward spits out a score, we turn it into an advantage, and that advantage just rides along as a multiplier. The gradients flow through the LLM’s policy, not the reward itself. It’s like giving the model a scorecard and saying, “Here’s how you did—now adjust!” The scorecard doesn’t need a slope; it just needs to exist.

For additional perspectives on GRPO, check out these papers and blog posts:

1. DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
2. https://epichka.com/blog/2025/grpo/
3. https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-reasoning-llms
4. https://newsletter.languagemodels.co/p/the-illustrated-deepseek-r1

Introduction to Visual Language Models

Visual language models represent a significant advancement in AI’s ability to understand and interpret the visual world. These models integrate vision and language processing capabilities to perform tasks such as:

1. Image captioning
2. Visual question answering (VQA)
3. Image-text retrieval
4. Visual reasoning

Traditional approaches to vision-language tasks often used separate models for visual feature extraction and language processing. Modern visual language models, however, adopt an end-to-end approach, training the vision and language components jointly.

Architecture of Visual Language Models

The general architecture of visual language models consists of three main components:

1. Visual Encoder

The visual encoder processes the input image and extracts visual features. This can be implemented using:

Where:

• $I$ is the input image
• $V$ represents the extracted visual features
• $n$ is the number of visual tokens
• $d_v$ is the dimensionality of the visual features

Common choices for visual encoders include:

• Convolutional Neural Networks (CNNs)
• Vision Transformers (ViT)
• Hybrid architectures combining CNNs and transformers

2. Language Encoder/Decoder

The language component processes textual inputs and generates textual outputs. In the encoder-decoder architecture:

Where:

• $T$ is the textual input
• $L$ represents the language features
• $m$ is the number of language tokens
• $d_l$ is the dimensionality of the language features

3. Cross-Modal Fusion

The cross-modal fusion component aligns visual and language features:

Where:

• $F$ represents the fused multimodal features
• $k$ is the number of fused tokens
• $d_f$ is the dimensionality of the fused features

Mathematical Formulations in Visual Language Models

Attention Mechanism

The attention mechanism is central to modern visual language models, allowing the model to focus on relevant parts of the image when generating text:

For cross-attention between vision and language:

Where:

• $Q_l$ is the query from the language features
• $K_v, V_v$ are the key and value from the visual features

Contrastive Learning

Many visual language models employ contrastive learning to align visual and textual representations:

Where:

• $s(v, t)$ is the similarity score between image $v$ and text $t$
• $\tau$ is a temperature parameter
• $N$ is the number of negative samples

Recent Advances in Visual Language Models

Recent advances in visual language models have focused on creating more general-purpose models that can handle a variety of vision-language tasks. Notable examples include:

1. CLIP (Contrastive Language-Image Pre-training): Trained on 400 million image-text pairs, CLIP learns visual concepts from natural language supervision.

2. DALL-E: Capable of generating images from textual descriptions, demonstrating the ability to understand complex concepts and compositions.

3. BLIP (Bootstrapping Language-Image Pre-training): Unifies vision-language understanding and generation, achieving state-of-the-art performance across various vision-language tasks.

4. Florence: A unified vision-language foundation model that demonstrates strong transfer learning capabilities.

Applications of Visual Language Models

Visual language models have a wide range of applications:

1. Accessibility: Helping visually impaired individuals understand visual content through descriptions.

2. Content Moderation: Automatically identifying inappropriate or harmful visual content.

3. Search and Retrieval: Improving image search by understanding semantic content.

4. Creative Tools: Assisting in content creation, such as generating images from descriptions or suggesting edits.

5. Robotics: Helping robots understand and interact with their environment through visual and language cues.

Challenges and Future Directions

Despite their impressive capabilities, visual language models face several challenges:

1. Bias: Models can perpetuate or amplify societal biases present in their training data.

2. Computational Efficiency: Large models require significant computational resources, making them inaccessible for many applications.

3. Evaluation: Properly evaluating the performance of visual language models across diverse tasks remains challenging.

4. Generalization: Improving the ability of models to generalize to unseen concepts and compositions.

Future directions in visual language model research include:

1. Multimodal Reasoning: Enhancing the models’ ability to reason about complex visual scenes.

2. Temporal Understanding: Extending models to understand and generate content about dynamic visual scenarios.

3. Interactive Learning: Developing models that can learn from interaction and feedback.

Conclusion

Visual language models represent a significant step toward creating AI systems that can perceive and communicate about the visual world in ways similar to humans. As research continues to advance, we can expect these models to become more capable, efficient, and responsible, opening up new possibilities for human-AI interaction and collaboration.

For a detailed mathematical understanding of these models, refer to the key equations presented in this post, which highlight the fundamental principles underlying modern visual language models.