THE ARISING · Measurement & AI
What should a personal AI agent be allowed to do with health paperwork?
November 17, 2026 · Measurement & AI · Commentary
A personal assistant could help track a missed reimbursement or organize questions for a clinic. Its job changes when it starts sending your medical information or changing an appointment. At that point, the more important question is not how little you notice the assistant. It is how clearly you can see what it is about to do.
In a September episode of the a16z Show, investor Anish Acharya and Assistant Benchmark creator David Pawlan discussed a future in which assistants handle routine tasks without waiting for a fresh instruction. That's a prediction about a market, not a study of how healthcare works. Pawlan's project publishes its test dimensions, scores and examples of runs. The creator's scoring can help people understand what was tested, but it does not independently demonstrate that these tools reduce healthcare paperwork, improve access to care, or make fewer mistakes.
Consider a delayed insurance reimbursement. An assistant could start with a checklist: identify the documents required, note the deadline and draft a message. It can do that without submitting a claim or deciding what to disclose. Before sending, a person should be able to check the recipient, the attachments, what is being requested and any deadline or financial commitment. The assistant should also make it easy to see afterward what was actually sent.
Medical information needs particular care. The U.S. Department of Health and Human Services explains that information a person enters into a consumer app generally isn't covered by HIPAA unless the app is provided by a covered entity or its business associate. The fact that the same information originally came from a medical record does not automatically extend those protections to the app. Before sharing it, check who receives it, how it is used and whether it can be removed.
A useful test is whether an assistant saves time without making someone less able to catch a mistake. Start with a task that doesn't change care or disclose records. Keep a person in control of anything that sends sensitive information, commits money or changes an appointment or treatment. Quiet help is welcome; the decision to act should still be visible.
Original a16z discussion · Assistant Benchmark methods and dimensions · HHS guidance on consumer apps and health information