Skip to content

Ideas · Essay

AI adoption is the wrong goal for engineering teams

When AI use becomes a target, teams can end up optimizing for visible adoption. Engineering leaders should instead ask whether a specific use of AI improves a software outcome they can verify.

By Nythrex team3 min read

A hand-operated railway switch with a lever and signal lamp beside the rails on gravel.
A railway switch makes the distinction between activity and direction visible. Photo: Wikimedia Commons, CC0. · https://commons.wikimedia.org/wiki/File:Hand-operated_railroad_switch.jpg (CC0)

A leadership review can make AI adoption look like progress: more engineers have access, more prompts are sent, more pull requests begin with an agent. Those measures are easy to collect and easy to celebrate. They also describe the use of a tool, not whether the organization is delivering better software.

The strongest argument for adoption targets is practical. Without a visible goal, experimentation may stay with a few enthusiasts; leaders need some evidence that teams are learning and that investment is reaching daily work. But turning adoption into the result confuses exposure with value. The useful question is whether a bounded workflow gets safer, more reliable, or less costly when AI is introduced.

Why adoption looks like a sensible goal

Engineering leaders have reason to pay attention to adoption. GitHub’s October 28, 2026 Octoverse report says that more than 40% of pull requests on its platform began with an agent’s first draft in September, compared with 17% in March. GitHub also reports that among newly created repositories, those with an agent configuration file averaged eight times as many commits as new repositories without one. These figures suggest that agent use is spreading and changing how work enters review. They can help a team decide whether a workflow deserves investigation. They do not establish that the extra commits represent more useful product work, or that the change caused improved delivery.

Where adoption stops being evidence

The distinction matters because activity can rise while the work remains difficult to verify or operate. GitHub’s report itself separates agent-started pull requests from other pull requests and notes that its agent signal detects only identifiable involvement. The figures describe platform activity; they are not a controlled comparison of business outcomes. A team that copies those figures into a target risks rewarding the detectable behavior, even if review, testing, integration or maintenance becomes harder.

A tool’s usage is a leading clue to investigate, not the verdict on its value.

Editorial conclusion based on the sources below

A September 19, 2026 Google Cloud account describes a different approach in Google’s infrastructure code security work: agents scan changes before submission, a triage step checks whether a reported vulnerable path is reachable, and proposed fixes go to human review. Google reports more than 92% precision for that triage agent and says it completes in under a minute. Those are Google’s reported results for its own system, not a promise that another organization will reproduce them. The useful lesson is the shape of the claim: a defined task, a check against code structure, a measured quality criterion and a review path. “We use agents” has none of that precision.

A heap of old iron keys tied with string.
A tool’s access and its output both need context and accountable review. Photo: Wikimedia Commons, CC0. · Wikimedia Commons, CC0: https://commons.wikimedia.org/wiki/File:Keys-unlock_(24242899961).jpg

Replace adoption targets with workflow evidence

Treat adoption as a prompt for inquiry. Pick a real workflow where a team believes AI may help, then write down what success would mean before changing the process. Keep the measure connected to work the team is responsible for, not to a count that flatters tool usage.

  1. Name the task and its boundary. For example, evaluate whether an agent-assisted security review finds actionable issues in a specific class of changes. State what is excluded.
  2. Set a baseline and quality bar. Record how the existing workflow performs, including review effort, false alarms, missed issues, elapsed time and any material operating cost. Do not infer quality from output volume.
  3. Run a limited comparison and inspect the exceptions. Keep a person accountable for checking results, resolving uncertain cases and deciding whether the changed workflow is worth keeping.

An editorial recommendation for Nythrex

For this subject, Nythrex should frame AI reporting around evidence for a defined engineering outcome: what changed, how it was checked, and what remains uncertain. Keep tool usage as context for that review rather than presenting it as proof of productivity or return. This is an editorial recommendation, not a claim about current Nythrex product capabilities.


Sources

Frequently asked questions

Why is AI adoption not enough to measure engineering value?

Adoption shows that people use a tool, but it does not show that delivery, quality, risk or cost improved. Compare a defined workflow against relevant outcome measures and include verification effort.

How should an engineering team evaluate an AI assisted workflow?

Define the task and success criteria before changing the workflow, then compare against a baseline. Include quality checks, review effort, exceptions and operating cost, with a person accountable for the decision.

    Stop guessing.
    Start seeing.

    No card and no subscription: paid plans have not launched yet.

    Create accountNo card, no subscription