Count how often each provider uses the AI note tool
Published Nov 13, 2026 · Last checked Nov 13, 2026 · Last changed Nov 13, 2026A study in JAMA found that AI note tools saved about 16 minutes of documentation a day. Clinicians who used the tool in most visits saved three times more, and only 32% used it that often. Count the share of visits where each of your providers uses it.
- Verdict
- ACT
- For
- Medical practices, hospitals. 6 providers and up. Manager, compliance, IT.
- Cost and time
- The study gives no price. Ask your vendor for the usage report at no charge. About two hours to pull the numbers.
Why
The study followed more than 1,800 clinicians who used AI scribes at five US hospitals for more than two years. It compared them with 6,770 clinicians who did not. Documentation time fell by 16 minutes a day, about 10%. Time in the record system fell by 13 minutes a day. After-hours time did not change. Clinicians who used the tool in more than half of their visits saw three times the cut in documentation time. Added revenue from extra visits was about $167 a month for each clinician. These numbers come from researchers, and they are smaller than the numbers vendors quote.
What to do
- Ask your vendor for a usage report: for each provider, the share of visits where the tool was used last month.
- From your EHR reports, write down each provider's documentation time and after-hours time for the same month.
- Sort providers into two groups: above half of visits, and below.
- Ask three providers in the lower group what stops them.
- Pair each of them with a provider who uses the tool in most visits, for one clinic day.
- Check that every provider reads and signs each AI note before it goes into the record.
- Check that patients are told, and agree, before a visit is recorded.
- Measure again in 60 days. Then decide which licenses to keep.
What data may go in
The tool hears the visit, so patient information goes in. The maker must have signed a business associate agreement (the contract a vendor must sign before it handles patient information).
Who checks the output
The provider reads and signs every note. In Texas, the practitioner must review records made with AI. The manager reviews the usage report each month. In a hospital, the committee that approved the tool gets the same report.
The rule to check
Get the patient's permission before an AI note tool records a visit. Texas requires that patients are told when AI is used in their care, and other states have their own rules. Check your state board's rules and your privacy rules.
What can go wrong
The study measured hospitals and their clinics, so a small practice may see different numbers. A provider who signs notes without reading them puts wrong facts into the record. Have each provider re-read ten signed notes a month.
Sources
- Mass General Brigham, on a study in JAMA, research institution's release, Apr 1, 2026.