---
title: "Compare models | SOSX"
url: "https://sosx.ai/analysis-tools/compare-models/"
description: "The same analysis task run on the same SOSX network by several AI backends, with each one's time, tokens, cost, carbon estimate and scored output quality set side by side."
---

[Analysis tools](https://sosx.ai/analysis-tools/) / Choosing between options

# Compare models

“Which AI model does this work best?”

![Comparing models in four stages: one task on one network, run by each AI backend, each run measured and scored, and a side-by-side comparison.](https://sosx.ai/figures/analysis-compare-models.svg)

Which AI model should do this work? The question sounds technical and is really a judgement about the work itself. A model that is quicker and cheaper on a general benchmark can be the weaker choice on your network, and the only honest way to find out is to give each candidate the same job and look at what comes back.

## At a glance

What the report carries

-   Comparison table
-   Detailed results
-   Summary

Exports to PDF or Word, with an explainability companion and the audit trail alongside it.

## The discipline

A fair comparison holds everything still except the thing being compared. Same network, same task, same instructions: only the model changes. Then it keeps two questions apart. The first is what each run cost: time, tokens, money and energy. The second is what each run was worth: whether the output was accurate, complete and consistent.

Neither number decides on its own. A cheaper model that drops half the answer is no saving, and a better answer may not be worth five times the cost for a routine pass.

## How SOSX runs it

Name the network, the backends you want to compare and the task, and SOSX gives each backend the identical task on the identical network. It records each run's execution time, token usage, cost and estimated carbon, then scores each output for accuracy, completeness and consistency. If one provider fails, the comparison carries on with the others and says which one did not complete.

## What you get

A comparison table with the quickest, cheapest, lowest-carbon and highest-quality run each marked, the detailed per-backend results behind it, and a summary. It is the evidence to have in hand when you choose which model your team's analyses run on.

## The others in this group

Several routes are on the table and one of them has to be argued for.

-   ### Trade-off analysis

    “Which option wins, and what does it cost us elsewhere?”

    Multi-objective comparison across systems or scenarios, with the Pareto frontier drawn and the sensitivity caveats attached.

    ![Trade-off analysis in four stages: the option set, the criteria and their weights, the Pareto frontier, and a choice you can defend.](https://sosx.ai/figures/analysis-trade-off-analysis.svg)

    [More information about Trade-off analysis](https://sosx.ai/analysis-tools/trade-off-analysis/)

-   ### Comparative study

    “How do these options compare, fairly?”

    Several variants built to one shared backbone, so the comparison is like for like rather than six differently-shaped models nobody can line up.

    ![A comparative study in four stages: the common scope and the dimension being varied, the shared backbone every variant must carry, the variants themselves built or imported, and a like-for-like comparison at the end.](https://sosx.ai/figures/analysis-comparative-study.svg)

    [More information about Comparative study](https://sosx.ai/analysis-tools/comparative-study/)

-   ### Product explorer

    “What should this product actually be?”

    A guided exploration of category, market, performance, constraints and design trade-offs, held inside the network.

    ![Product exploration in four stages: the category, the market it serves, the constraints that bite, and a product definition held in the network.](https://sosx.ai/figures/analysis-product-explorer.svg)

    [More information about Product explorer](https://sosx.ai/analysis-tools/product-explorer/)

Or see [all the analysis tools](https://sosx.ai/analysis-tools/). If you would rather we built the model and ran them for you, that is our [system research, build and analysis](https://sosx.ai/services/research-build-and-analysis/) service.

[Drop us a message and let's have a chat](https://sosx.ai/contact/)
