BackLuke Scott Notes
IndexWorking with AI
Working with AI

Design the check before delegating the work

Before I give an agent a difficult job, I want the check defined. That check may be a required set of fields, a calculation that can be repeated another way, a source record with a date, or a person who knows the subject and can review the result. The form changes with the work. The evidence for accepting the result should exist before the agent starts.

A guest account hosted by Anthropic gives a useful example from physics. A Claude Science workflow completed a nine-loop calculation in a toy-model theory using established methods. Physicist Lance Dixon could check the result because his team had already developed a way to validate a candidate solution. Claude approached the calculation in two ways, and another team developed a concurrent result with AI assistance. The account discloses compensation to the writer and usage credits to the validator.

The result belongs to that specific problem. Applying the lesson to business work means preserving the conditions that made it checkable: a defined task, established methods, testable output, and a subject-matter expert responsible for interpreting the result.

Software workflows can make those checks part of the process. For example, GitHub's description of dynamic workflows includes passing structured results between stages and pausing for a person to review them. The same design principle is useful when planning a practice workflow, although the software example establishes no result for a dental office.

Consider insurance verification. Before an agent signs in to anything, define the patient and plan identifiers it must match, the benefits and limitations it must capture, the source and time that belong on the record, and the conditions that make the answer uncertain. Decide which result a teammate must review and what the agent should do when a portal response is incomplete or inconsistent.

The same discipline applies to website and marketing work. Give the agent approved claims and source material. Define the pages, links, forms, and display sizes that must be checked. Require a preview before publication and preserve the version that can be restored. A polished page is not finished if the form fails or the product claim outpaces its source.

Desktop automation needs checks at each consequential transition. If an agent prepares an invoice, inspect the customer, line items, total, and saved record before any send. If it updates a system, read the resulting record back. A successful click only tells you that an action was attempted. The saved result is the evidence the next step needs.

For a recurring workflow, I would write five things before granting more responsibility:

  • The exact result that counts as acceptable.
  • The source evidence and timestamps the result must include.
  • The examples or independent checks used to test it.
  • The conditions that require the agent to stop and ask.
  • The person, record, and approval required before an external or consequential action.

Then I would run representative cases beside the existing process. Include routine work, missing information, conflicting records, and a case where stopping is the correct result. Track corrections and build the check into the workflow so it runs each time.

Permissions define how far an agent can reach. A validation path defines the evidence required for its next step. Responsibility can grow when the results consistently clear both.

Choose one repeated job and write its acceptance test before automating it. Save both the expected result and a case that should stop. Those give you something concrete to compare when the model, source system, or workflow changes.

Luke Scott