d0b4e77branch(lead):git switch ai-systems
AI Systems
Make build or buy calls with evidence, and set up the checks your team will rely on.
Less code, more judgement. You learn to scope an AI feature, run a fair bake-off between options, and set quality bars before anyone writes a prompt.
- for
- Leads and founders deciding what to build, what to buy, and how to know it works.
- time
- 3 to 4 weeks at 2 hours a week
- not for
- People who want to build hands-on this month. Agent Builder is more practical.
You will ship
A one-page decision record with a bake-off, a test set, a cost estimate and a rollback plan.
Prerequisites
- Has shipped or managed shipping software
- Can read code even if you do not write it daily
- A real decision on the table helps
d0b4e01plan:six commits to ship
The branch, commit by commit.
0/6 commits done · saved in this browser only
- commit 1Frame the job
Write the user problem and what wrong answers cost before naming any tool.
Where this happens: /courses/build-buy-or-wait#m1 - commit 2Build a test set first
Thirty real examples with expected results. Every option is judged on the same set.
Where this happens: /courses/evals-before-vibes#m1 - commit 3Run the bake-off
Two vendors and one in-house prototype, same inputs, scored side by side.
Where this happens: /courses/build-buy-or-wait#m3 - commit 4Cost and speed budget
Price a month of real traffic and set the slowest response you will accept.
Where this happens: /lessons/agent-trace#cost - commit 5Rollback plan
Decide what turns the feature off and who is allowed to do it.
Where this happens: /courses/build-buy-or-wait#m5 - commit 6Ship the record
Share the decision record and revisit it after thirty days of use.
Where this happens: /projects#decision-record
d0b4c02docs:courses on this branch
Courses.
d0b4d03ship:capstone
Capstone: Build or buy decision record
A one-page record scoring a vendor and a prototype on the same thirty cases.
Tests it must pass
- cost of a wrong answer written down
- both options scored on the same cases
- named owner for rollback
## DecisionBuy for now. Vendor scored 26/30, prototype 21/30.Revisit on the first of next quarter.Owner who can switch it off: support lead.