cassionData Analysis

Back to the lessonLesson 7 of 8What a phase classification asserts

Six rows, two sources, one table

The same deck as the downloads, rendered as a page. Start the slideshow to present it full screen — arrow keys or a click advance one slide, Escape leaves.

Slides · PDFSlides · PowerPoint

  1. Slide 1 / 19

    What this lesson covers

    • What the table is for
    • Building the rows
    • Direct and indirect evidence
    • Reliability, and why it is scored
    • What convergence looks like
    • The table as it goes into the workshop
    • What comes next
    Speaker notes
    An IPC evidence table is not a spreadsheet of results. It is a structured argument in which each row carries an indicator, a value, a reliability score and a phase — and the analyst's job is the last column.
  2. Slide 2 / 19

    What the table is for

    • Every row of an evidence table carries five things
    Speaker notes
    Lesson 4 established that four instruments give four answers. The IPC's response to that is not to pick one, average them, or find the true number. It is to lay them out so that a group of analysts can argue about them in a structured way and record what they concluded. Every row of an evidence table carries five things:
  3. Slide 3 / 19

    What the table is for

    ColumnWhat it holdsWho supplies it
    IndicatorThe measure, by nameThe standard
    ValueThe number, with its denominator and nThe analyst
    Reference tableThe phase thresholds for that indicatorThe IPC manual
    PhaseWhich phase the value falls inArithmetic
    ReliabilityHow much weight this row can bearThe analyst's judgement
    Speaker notes
    The fifth column is the one that is not computed, and it is the one that makes the table an argument rather than a list.
  4. Slide 4 / 19

    Building the rows — In Python (cont.)

    import pandas as pd
    
    evidence = pd.DataFrame([
        {"indicator": "Food Consumption Score, poor",
         "value": "7.4%", "n": 1989, "source": "household survey"},
        {"indicator": "Household Hunger Scale, moderate or severe",
         "value": "42.9%", "n": 2075, "source": "household survey"},
        {"indicator": "reduced Coping Strategy Index, 19 or above",
         "value": "51.0%", "n": 2112, "source": "household survey"},
        {"indicator": "Livelihood coping, crisis or emergency",
         "value": "48.5%", "n": 2121, "source": "LCS module"},
        {"indicator": "Maize price, year on year at the lean peak",
         "value": "+22%", "n": 10, "source": "market monitoring"},
        {"indicator": "Wage to maize terms of trade, change",
         "value": "-49%", "n": 10, "source": "market monitoring"},
    ])
  5. Slide 5 / 19

    Building the rows — In Python (cont.)

    print(evidence)
  6. Slide 6 / 19

    Building the rows — In R

    library(dplyr)
    
    evidence <- tibble::tribble(
      ~indicator,                              ~value,   ~n,   ~source,
      "FCS poor",                              "7.4%",  1989, "household survey",
      "HHS moderate or severe",               "42.9%",  2075, "household survey",
      "rCSI >= 19",                           "51.0%",  2112, "household survey",
      "LCS crisis or emergency",              "48.5%",  2121, "LCS module",
      "Maize price, year on year",             "+22%",    10, "market monitoring",
      "Wage terms of trade, change",           "-49%",    10, "market monitoring"
    )
  7. Slide 7 / 19

    Building the rows

    • Six rows, two sources, six different denominators — Building the table in code from the same script that computed the…
    Speaker notes
    Six rows, two sources, six different denominators. Building the table in code from the same script that computed the numbers is what stops the values drifting from the analysis — the same argument as the WASH denominator table, in a different sector.
  8. Slide 8 / 19

    Direct and indirect evidence

    • Direct evidence — measures the outcome itself: food consumption, nutritional status, mortality
    • Indirect evidence — measures something that causes or accompanies the outcome: prices, terms of trade, rainfall,…
    • Indirect evidence cannot classify on its own — A 49% fall in wage terms of trade is a powerful argument that…
    • But indirect evidence is what makes a classification forward-looking — The household indicators describe the lean…
    Speaker notes
    The IPC separates evidence by how close it sits to the outcome being classified. Direct evidence measures the outcome itself: food consumption, nutritional status, mortality. The FCS and HHS rows are direct. Indirect evidence measures something that causes or accompanies the outcome: prices, terms of trade, rainfall, displacement, conflict. The two market rows are indirect. Indirect evidence cannot classify on its own. A 49% fall in wage terms of trade is a powerful argument that consumption will deteriorate, and it is not a measurement of consumption. The distinction matters because an analysis short of direct evidence often has plenty of indirect evidence and is tempted to promote it. But indirect evidence is what makes a classification forward-looking. The household indicators describe the lean season that has happened; the price series describes the one still running. That is why an IPC analysis produces a current classification and a projection, and the projection leans on the indirect rows.
  9. Slide 9 / 19

    Reliability, and why it is scored — In Python

    evidence["reliability"] = [
        "high — 1,989 households, standard instrument",
        "high — 2,075 households, standard instrument",
        "medium — no context-specific threshold established",
        "medium — 58 households cannot be classified above crisis",
        "medium — balanced panel of 10 of 12 markets",
        "medium — same panel; wage series is a single occupation",
    ]
    print(evidence[["indicator", "value", "reliability"]])
    Speaker notes
    Not every row deserves equal weight, and the reasons are the ones this course has been accumulating.
  10. Slide 10 / 19

    Reliability, and why it is scored — In R

    # The reliability column is prose, and it is the part that gets read.
  11. Slide 11 / 19

    Reliability, and why it is scored

    • Write the reason, not a score — "Medium" tells a reader nothing; "58 households cannot be classified above crisis"…
    • A denominator smaller than the sample — the FCS's 1,989 of 2,112.
    • A threshold borrowed rather than established — the rCSI's 19.
    • A panel that changed composition — the price series without MK001.
    • A rule applied where the data cannot support it — a maximum severity over a partly administered module.
    Speaker notes
    Write the reason, not a score. "Medium" tells a reader nothing; "58 households cannot be classified above crisis" tells them exactly how much to discount the row and in which direction. Four things that lower reliability, all of them met earlier in this course:
  12. Slide 12 / 19

    What convergence looks like — In Python

    evidence["direction"] = ["worse", "worse", "worse", "worse", "worse", "worse"]
    print(f"rows pointing the same way: "
          f"{(evidence['direction'] == 'worse').sum()} of {len(evidence)}")
  13. Slide 13 / 19

    What convergence looks like — In R

    # Six of six. That is convergence — and it is not the same as agreement on level.
  14. Slide 14 / 19

    What convergence looks like

    • All six rows point the same direction and they disagree about severity by a factor of seven — That combination — strong…
    • "They disagree, so the data is bad." — They disagree because they measure different things, and the disagreement…
    • "Four of six say over 40%, so it is over 40%." — Voting across indicators measuring different quantities is not an…
    • "The most severe row is the safest." — Nor is the least severe
    Speaker notes
    All six rows point the same direction and they disagree about severity by a factor of seven. That combination — strong convergence on direction, wide disagreement on level — is the most common real pattern, and the table is what lets you say both at once. The wrong readings of it are worth naming. "They disagree, so the data is bad." They disagree because they measure different things, and the disagreement carries the diagnosis: coping and asset depletion high, severe consumption deficit not yet. "Four of six say over 40%, so it is over 40%." Voting across indicators measuring different quantities is not an estimator of anything. "The most severe row is the safest." Nor is the least severe. The row you lead with should be the one with the highest reliability for the decision at hand, and the others belong beside it.
  15. Slide 15 / 19

    The table as it goes into the workshop — Example (cont.)

    Evidence table — lean season 2024, four districts
    
      Direct evidence
        FCS poor (28/42 set)          7.4%   n=1,989   high reliability
        HHS moderate or severe       42.9%   n=2,075   high
        rCSI >= 19                   51.0%   n=2,112   medium, threshold not local
        LCS crisis or emergency      48.5%   n=2,121   medium, 58 partial modules
    
      Indirect evidence
        Maize, year on year at peak   +22%   10 markets, balanced panel
        Wage terms of trade           -49%   10 markets, same panel
    
      Convergence: six of six rows indicate deterioration.
      Divergence: severity estimates range from 7.4% to 51.0%, reflecting
      different constructs rather than measurement error.
      Not available: nutritional status, mortality, food access at the
  16. Slide 16 / 19

    The table as it goes into the workshop — Example (cont.)

      household level in physical quantities.
  17. Slide 17 / 19

    The table as it goes into the workshop

    • The "not available" block is not a formality — Nutrition and mortality are the two outcome indicators the IPC weights…
    Speaker notes
    The "not available" block is not a formality. Nutrition and mortality are the two outcome indicators the IPC weights most heavily, and an analysis without them is classifying on consumption and coping alone. Saying so is what stops the next reader assuming they were considered and found unremarkable.
  18. Slide 18 / 19

    What comes next

    • The table is assembled.
    Speaker notes
    The table is assembled. The last lesson is what a working group is entitled to conclude from it — the sentence a Phase 3 classification asserts, the one it does not, and the threshold rule most people quoting a phase have never read.
  19. Slide 19 / 19

    Where this goes next

    Read the full lesson, with runnable code Back to the lesson