You Can’t Assess What You Can’t Access: The Power of Independent Longitudinal Verification

Posted on May 5, 2026

0


Jon W. Hansen — Hansen Models™ · Procurement Insights™ — May 2026


“Incomplete assumptions don’t disappear. They accumulate. And when the system scales, reality collects the debt.”

Jon W. Hansen, Implementation Physics™


There is a question that procurement leaders rarely ask of the industry’s content properties, and it is the question that matters most for senior commitment decisions: can this property’s forward-looking claims be tested against what actually happened?

The question is structural rather than evaluative. It is not asking whether a property produces good content. Most of them do. It is asking whether the property’s architecture supports independent longitudinal accuracy verification by external readers without requiring trust in the property’s own representations.

The distinction is the difference between truth and accuracy. A property can produce truth — internally coherent observations at the moment of capture — and still fail to produce accuracy, which requires that the original claims remain checkable against subsequent outcomes. The architecture has to preserve the inputs, maintain editorial independence at the moment of capture, and remain accessible in original form long enough for time to test what was claimed.

This post applies a six-criterion scorecard to the major procurement industry content properties. The scorecard is not subjective. It evaluates each property against observable structural criteria that any external reader can verify independently. The findings are presented as a cohort comparison rather than as critique. None of the properties is being judged on the quality of its content. Each is being assessed on whether its architecture supports the kind of accuracy verification that senior commitment decisions require.

The scores presented in this post represent the consolidated output of a multimodel validation exercise across five independent AI models, applying the same six-criterion framework to the same publicly observable evidence base. Where the models converged, the consolidated score reflects the convergence. Where the models diverged, the divergence itself was examined structurally and the master score reflects the structural reasoning that holds across the assessments rather than any single model’s view.

The Six-Criterion Scorecard

Each property is scored on six structural criteria:

  1. Date-stamped claim availability — Are forward-looking claims captured with publication timestamps and named contributors?
  2. Claim-type clarity — Does the editorial voice distinguish between observation, prediction, vendor assessment, and commentary?
  3. Time-horizon specification — Are predictions anchored to specific deadlines or testable time windows?
  4. Outcome evidence accessibility — Can later evidence be checked against the original claim’s framing?
  5. Accuracy rating possibility — Can the original claim be classified as confirmed, partially confirmed, unproven, or contradicted?
  6. Archive accessibility — Does the original claim remain independently retrievable in its original form?

A 10-out-of-10 score means the property’s architecture supports full independent verification of forward-looking claims across its complete publication history. A 1-out-of-10 score means the architecture produces content that cannot be tested against outcomes by any external reader. Most properties sit between these poles for different structural reasons.

Property One — The Hackett Group

The Hackett Group has been a consulting firm since 1991. It has had over three decades to build a continuously published independent practitioner archive. It has not done so. What it has is a corporate Insights content operation — articles, fact sheets, infographics, podcasts, research reports, case studies, webcasts — architected for lead generation and thought leadership positioning rather than for accuracy verification.

Date-stamped claim availability is partial. Research products and benchmarking reports carry publication dates, but specific forward-looking claims are typically embedded inside subscription-gated reports or aggregate findings. Claim-type clarity is mixed. Benchmarking observations are clearly typed; predictive claims are typically framed as survey expectations or directional commentary rather than as testable predictions. Time horizons are often vague — claims tend to use “over the next several years” or “in the coming era” rather than specific deadline-anchored predictions. Outcome evidence accessibility is weak. Original claims are not maintained in immutable historical form; positioning gets refreshed across technology transitions; comparable later reports update the framing rather than testing the prior claim. Accuracy rating possibility is limited because most claims are descriptive present-state benchmarks rather than predictions. Archive accessibility is compromised. Content is subscription-gated, periodically refreshed, and not architected as a continuously accessible chronological archive.

Master score: 3/10. This is not a critique of The Hackett Group. It is a structural finding. A consulting firm’s content operation is architected to support its commercial offerings, which is what corporate content marketing does. Scoring it against accuracy infrastructure criteria reveals what the architecture is not designed to produce.

Property Two — Spend Matters (Now Part of The Hackett Group)

Spend Matters launched in November 2004 as the first blog of its kind in the procurement and supply chain sector, founded by Jason Busch. For two decades it operated as an independent property with two parallel content tiers: a publicly available blog and subscription-gated premium research (Spend Matters PRO). The public tier was chronologically accessible, carried a named editorial voice, and supported retrospective claim-checking by external readers. The PRO tier produced subscription-gated vendor analysis and research that was accessible only to paying subscribers. In May 2025, The Hackett Group acquired the property. The acquisition is the structural event that defines Spend Matters’ current position in the cohort.

During the 2004-2025 independent period, the scorecard would have placed Spend Matters at approximately 7/10 for the public tier. The public blog architecture supported accuracy verification reasonably well — date-stamped claims were standard, editorial voice was clear, predictions could be checked against subsequent posts, and the continuous publishing pattern created a chronological record. The PRO tier was structurally different. Subscription-gated content cannot be independently verified by external readers because the inputs are not publicly accessible, which means PRO research could not be tested against subsequent outcomes by anyone outside the subscriber base. That architectural distinction matters for a cohort comparison built on independent longitudinal verification — content behind a paywall is not externally checkable regardless of how high its quality might be.

The acquisition has changed two things structurally. First, the editorial environment around any new content is now the Hackett Group commercial environment — partnership economics, consulting engagements, enterprise client relationships. Independence forward from the acquisition date is asserted but operates inside a commercial structure that has structurally different incentives than the independent practitioner model that originally produced the archive. Second, the historical archive’s continuing accessibility in original form is no longer guaranteed by the editorial structure that originally produced it. The original 2004 launch posts are not easily retrievable from the current public site. The current spendmatters.com About page redirects in some configurations to a Hackett Group landing page that asserts the original editorial posture in past-tense framing.

The acquisition demonstrates that independent practitioner archives have historically been built outside consulting firm structures rather than within them. Hackett operated for thirty years in the procurement industry with the resources to launch any content property it wanted. The property that eventually became part of Hackett’s portfolio was built by Jason Busch outside the consulting firm structure across the 2004-2025 independent period. That structural pattern — independent practitioner archives built outside, then acquired into, commercial consulting structures — is observable in the public record of the cohort.

Master score: 5/10. The pre-acquisition independent period was genuinely strong accuracy infrastructure. The post-acquisition trajectory introduces uncertainty about archival continuity and editorial environment that would not have applied under the original ownership. The score reflects the structural reality that independence claims made from inside a commercial consulting structure are categorically different from independence claims made from outside one.

Property Three — Sourcing Innovation

Michael Lamoureux launched Sourcing Innovation in June 2006 with an explicit editorial mission to cut through vendor marketing noise with technically grounded analysis. He has continuously published since then. He maintains the property under his own editorial control. There are no acquisitions, no ownership transfers, and no vendor sponsorship economics inside the property itself.

Date-stamped claim availability is strong — original posts since June 2006 are timestamped and chronologically accessible. Claim-type clarity is strong. Lamoureux’s editorial voice consistently distinguishes between technical commentary, vendor analysis, predictions, and structural critique. Time-horizon specification is variable, with some predictions anchored to specific deadlines and others positioned as directional structural commentary. Outcome evidence accessibility is reasonable. The continuous publishing pattern creates a chronological record that supports retrospective claim-checking. Accuracy rating possibility is good for predictive claims that have time-horizon specification; somewhat lower for structural commentary that operates across longer evaluative timeframes. Archive accessibility is strong. The sourcinginnovation.com archive remains accessible and the property has maintained editorial continuity for nineteen years.

The cross-property editorial relationship — Lamoureux’s past contributions to Spend Matters as an analyst — is editorial collaboration rather than commercial entanglement. Sourcing Innovation itself operates outside vendor sponsorship economics and analyst-firm partnership structures.

Master score: 7.5/10. Sourcing Innovation is one of two genuinely independent practitioner archives in this cohort with structurally comparable continuity to Procurement Insights. Lamoureux has built and maintained an archive whose editorial environment has remained consistent across its complete publication history. The two-point gap to Procurement Insights reflects the franchise’s broader thematic range, the explicit ARA™ RAM 2025™ validation methodology, and the formal Accuracy Ledger trajectory that is forward methodology development rather than structural archive quality.

Property Four — CPO Rising

Andrew Bartolini launched CPO Rising in January 2010 as the publishing voice of Ardent Partners. The property has been continuously published for sixteen years with a clear editorial voice and an annual rhythm anchored by State of Procurement and BIG Trends and Predictions reports.

Date-stamped claim availability is strong. Claim-type clarity is mixed. Bartolini’s editorial voice is clear, but the property publishes Ardent Partners research alongside commentary, and the boundary between independent observation and commercial research is not always operationally distinct. Time horizons in the annual reports are specified; individual posts are more variable. Outcome evidence accessibility is reasonable for blog content; weaker for the underlying research, which is subscription-gated. Accuracy rating possibility is limited because Ardent Partners’ analyst-firm business model includes vendor sponsorships and partnership relationships. Archive accessibility is reasonable for blog content with month-by-month indexing back to January 2010.

Master score: 5.5/10. The property is well-maintained, the editorial voice is genuine, and the annual prediction cycle produces testable forecasts. The structural limitation is the analyst-firm commercial model. Vendor partnership economics affect what claims can be made about which vendors and how the claims get framed when commercial relationships shift.

Property Five — Art of Procurement

Philip Ideson launched Art of Procurement in November 2015 with a podcast-first format that has expanded into written content, events, and commercial partnerships across the procurement technology vendor community. The property has been continuously published for ten years.

Date-stamped claim availability is strong. Claim-type clarity is mixed. Podcast format produces conversational claims that are harder to extract as testable predictions; written content is clearer. Time-horizon specification is variable — most content is observational rather than predictive. Outcome evidence accessibility is weaker because podcast format does not produce the kind of textual artifact that supports retrospective claim-checking. Accuracy rating possibility is limited because vendor-sponsored content and commercial partnerships can structurally compromise independent claim-testing. Archive accessibility is reasonable for the podcast and written content.

Master score: 5/10. The property serves the procurement community well in its chosen format. The structural limitations for accuracy verification are the format itself (podcasts are observational and conversational rather than predictive and testable) and the commercial sponsorship architecture.

Property Six — Procurement Insights

The franchise’s archive launched in May 2007 and has been continuously published for nineteen years. It maintains zero vendor sponsorships, no acquisitions, no analyst-firm absorption, and no consulting-firm commercial relationships embedded in the property itself.

Date-stamped claim availability is strong. Every post since May 2007 is timestamped, chronologically indexed, and continuously accessible. Claim-type clarity is strong. The editorial voice consistently distinguishes between observation, prediction, vendor commentary, and structural argument; predictions are typically named as predictions. Time-horizon specification is generally specified, with the strongest prospective predictions anchored to specific deadlines or to structural conditions that play out over documented time horizons.

Two notable proof cases in the archive demonstrate what continuous independent observation produces over time. The 1998 DND RAM research delivered measurable outcomes against externally verifiable conditions — delivery performance moved from 51% to 97.3%, and the company that produced the research was sold for approximately $12 million in 2001. The 2007 FOSS post identified four specific structural failure modes of free and open-source software approaches in enterprise contexts; nineteen years later, the open-source AI orchestration artifact LLM Council exhibited all four predicted failure modes with structural precision. Both proof cases, as well as the many others, are publicly documented, timestamped, and verifiable by any external reader.

Outcome evidence accessibility is strong. The continuous publishing pattern creates a complete chronological record. Accuracy rating possibility is strong. The methodology that supports the calculation is itself documented in the archive through the ARA RAM 2025™ multimodel validation framework. Archive accessibility is strong, and the editorial environment has remained structurally consistent across the complete publication history.

Master score: 9.5/10. The score is 9.5 rather than 10 for one specific reason. When the franchise points to particular posts as evidence of accuracy — DND 1998, the FOSS post, and others — a skeptical reader could legitimately ask whether the franchise is showing the full record or only the cases that look favorable. That is a fair question. The franchise has not yet produced a comprehensive list of every prediction it has made across the past nineteen years with outcomes documented for each. The raw material exists in the archive — every post is timestamped and publicly accessible. The formal accounting has not yet been built. The franchise is calling this work the Procurement Insights Accuracy Ledger, and producing it would close the gap and move the score to 10.

The Cohort Comparison

What the Cohort Shows

Three structural observations follow from the comparison.

Within this cohort, only two properties meet the criteria for continuously verifiable independent practitioner archives. Procurement Insights and Sourcing Innovation are the two properties whose editorial environments have remained structurally consistent across their full publication histories. The other four properties operate inside commercial structures that compromise the editorial environment in different ways — Hackett’s own corporate content operation, the Spend Matters property now operating inside Hackett’s commercial structure, CPO Rising operating inside Ardent Partners’ analyst-firm model with vendor partnership economics, and Art of Procurement running commercial sponsorships across the procurement technology vendor community.

The cohort splits into three structural tiers rather than two. The top tier — independent practitioner archives at 9.5 and 7.5 — meets the architectural conditions for accuracy verification. The middle tier — properties at 5.5, 5, and 5 — produces continuous content with clear editorial voices but operates inside commercial structures that can compromise the independence in different ways. The bottom tier — corporate content operation at 3 — is architected for purposes other than accuracy verification. The structural distinction between the top tier and the rest of the cohort is categorical rather than incremental.

The acquisition pattern is itself a structural finding. Independent practitioner archives in the procurement industry have historically been built outside consulting firm structures. The three independent practitioner archives in the cohort — Spend Matters, Sourcing Innovation, and Procurement Insights — were all built by independent practitioners across two decades before any commercial consolidation entered the picture. Of those three, only Spend Matters has been acquired into a consulting firm structure. Sourcing Innovation and Procurement Insights remain independent.

What This Means for Senior Practitioners

When senior commitment decisions about AI deployment, vendor selection, or transformation initiatives require evaluation of forward-looking claims, the question that matters is whether the source’s claims can be tested against what actually happened. Most procurement industry content properties cannot be tested in this way — not because their content is wrong, but because their architecture does not preserve the inputs in checkable form.

The above paragraph is worth holding clearly. The properties that score below 7 in this cohort are not failing at being accuracy infrastructure. They are succeeding at being what their architectures are designed to be — corporate content operations, analyst-firm research properties, media platforms, podcast-first commercial communities. Each one serves its mission. None of them is architected to produce the kind of accuracy verification that senior commitment decisions require.

The two properties in the cohort that meet the criteria are the two with structurally consistent independent editorial environments across their full publication histories. That is not a coincidence. Independence over time is the architectural condition that allows accuracy to be measured rather than asserted. Commercial structures and acquisition trajectories can compromise that independence in different ways, and once compromised, the architectural conditions for accuracy verification do not get rebuilt from inside the new commercial environment.

The Procurement Insights™ archive is not asserting accuracy. It is documenting it, in real time, with timestamps that any external reader can verify. The continuous strands of accuracy that the archive produces are checkable strand by strand. That is the condition that allows accuracy to be measured, rather than asserted.


Hansen Models™ · Phase 0™ · Hansen Fit Score™ (HFS™) · ARA™ · RAM 2025™ · Human Language Interface™ · Learning Loopback Process™ · Hansen Strand Commonality™ · Implementation Physics™

Founder: Jon W. Hansen — hansenprocurement.com — procureinsights.com


Continuous Strands of Accuracy — Jon Hansen

Posted in: Commentary