2. Policy version history
Every version dated, with the weeks it governed, the events decided under it, and what the log shows happened while it was the law. The proposal is carried in the same shape as the versions in force while being visibly not in force: it governs no week and decided no event.
| Version | Effective | Weeks | Events decided | Proposed by | Approved by | Change, and its observed effect |
|---|
| v1 | Jun 8, 2026 | 1, 2, 3, 4 | 712 | M. Halloran, Compliance officer | E. Sandoval, Chief executive officer | Monitor everything the pilot is measuring — every class, every role group, zero disruption. The statutory floor is the exception: SAR/BSA material is blocked everywhere from day one, and exam material everywhere but Compliance and Executive, because neither rung is a pilot decision.The monitor-first baseline: 712 events recorded, 712 of them decided monitor. Stopping nothing is what monitor means, and it is what gives every later rung a denominator to be compared against. |
| v2 | Jul 6, 2026 | 5 | 200 | M. Halloran, Compliance officer | E. Sandoval, Chief executive officer | Warn and coach on member PII, SSN / tax ID and credentials in Commercial Lending and Credit Administration.6 cells moved. While it governed, the log records 108 decided warn across 200 events in week 5. |
| v3 | Jul 13, 2026 | 6 | 213 | M. Halloran, Compliance officer | F. Duarte, IT director | Detector tuning. The custom institution dictionary lands; the member-PII proximity window and the credential shapes are narrowed. No cell changes.No cell changed: this is a detector release. The override rate was 20% when it landed and 11% by week 10, which is the fall the tuning is credited with — 11 points against a 15% target. |
| v4 | Jul 20, 2026 | 7, 8 | 472 | M. Halloran, Compliance officer | E. Sandoval, Chief executive officer | Block credentials and API keys, all role groups.7 cells moved. While it governed, the log records 10 decided block across 472 events in weeks 7, 8. |
| v5 | Aug 3, 2026 | 9, 10 | 585 | M. Halloran, Compliance officer | E. Sandoval, Chief executive officer | Redact member PII in Commercial Lending; the tokenize option comes on for account numbers there.2 cells moved. While it governed, the log records 162 decided redact, 20 decided tokenize across 585 events in weeks 9, 10. |
| v6 | proposed Aug 10, 2026not in force | — | 0 | M. Halloran, Compliance officer | Not approvedno approver has signed this version, which is why it is pending | Proposed: advance Retail & Branch Ops to warn on member PII and SSN / tax ID. Not in force, and unapproved — the approver is not the proposer, and has not signed.Not in force. The case for it is 68% redirect acceptance across weeks 9 and 10: the department it would advance is the one still on monitor while its users are already taking the redirect. |
3. Monitoring evidence
1,144 detections across 3,805 AI interactions in the period — 30.1% of AI use carried a sensitive class. Discovery counts every interaction and detection counts the subset; the two denominators are never mixed in one figure.
What happened to them. 34 blocked in the page, 230 redirected to the internal assistant, 38 abandoned after the coach card, 337 submitted after a transform, 75 overridden with a logged justification, and 430 monitored without interruption. A detection is not an exfiltration. Blocked, redirected and abandoned submissions reached no destination; transformed ones reached it with every detected span masked or tokenized and the original text withheld; overridden and monitored ones went as typed.
Detections against class instances. An event can carry several classes, so class instances outnumber detections: 1144 detections in this window carried 1847 class instances, of which 1840 fall in the six classes the tiles draw. A loan application carrying a name, a tax identifier and an account number is one detection and three instances. The two figures are never divided into one another.
| Data class | Detections | Week on week |
|---|
| Member PII | 847 | +12% |
| Account Numbers | 423 | +8% |
| Loan Files | 291 | +31% |
| Credit Memos | 156 | +19% |
| SSN / Tax ID | 89 | +5% |
| API Keys / Creds | 34 | +44% |
| AI tool | Kind | Lifecycle | Severity | Interactions | Carried a class |
|---|
| ChatGPT (personal) | public | assessed | HIGH | 1,204 | 496 |
| Claude.ai (personal) | public | assessed | HIGH | 687 | 245 |
| Gemini Advanced | public | assessed | HIGH | 412 | 164 |
| Microsoft Copilot (consumer) | public | assessed | MED | 238 | 122 |
| Perplexity | public | assessed | MED | 91 | 44 |
| Department | Detections | Share |
|---|
| Credit Administration | 394 | 34.4% |
| Commercial Lending | 363 | 31.7% |
| Retail & Branch Ops | 282 | 24.7% |
| Finance | 60 | 5.2% |
| IT | 30 | 2.6% |
| Compliance/BSA | 14 | 1.2% |
| Executive | 1 | 0.1% |
4. Sampled provenance chains
6 events, each with the full chain: who acted, what was detected and by which detector, what was decided and under which version, what transform ran, and where the content went. The chain printed here is the chain the console drills to — the same record, not a summary of it.
How these chains were chosen, and what the rest of the log does. Every chain in this section replays: each stored span comes back from the detection engine, from the stored excerpt, at the same offsets with the same proof. That is a selection rule and not a filter on any figure — no count anywhere in this package moves because of it. 650 spans across 650 of the log’s events do not replay in one specific way, and it is a property of one class rather than a defect spread across the log: Customer/Member PII is a combination — a name beside an identifier — and this record holds more member-PII events than identifier detections in the same window, so several hundred names carry no identifier for the rule to pair with. On those events the name is proven at exactly the stored offsets by the engine’s own name rule and the pairing is seeded; the console says so on each such chain, in place. They are counted in every figure in section 3 and none of them is an exhibit here.
H. Delacroix — Credit analyst, Credit AdministrationWarn59b65c07-2a94-407c-9eaf-146a25d5adf7
WhenAug 12, 2026 at 2:33 PMWeekWeek 10ChanneluploadDestinationM365 Copilot (sanctioned)Policyv5Spans7Redact0 tokenized
Spreading the 2025 financials for this relationship. Borrower Naomi Okonjo and co-borrower Tomas Villareal; operating account 00447821, payroll account 00619043, sweep account 00733158; guarantor tax ID 604-18-2277; loan CL-2026-04481. Which line items belong in EBITDA and which are add-backs?
Member PII at 62–74, matched by cmb-member-pii — a pattern shape, not a proof · Member PII at 91–106, matched by cmb-member-pii — a pattern shape, not a proof · Account Numbers at 126–134, matched by pat-account — a pattern shape, not a proof · Account Numbers at 152–160, matched by pat-account — a pattern shape, not a proof · Account Numbers at 176–184, matched by pat-account — a pattern shape, not a proof · SSN / Tax ID at 203–214, proved by the SSN format rule · Loan Files at 221–234, matched by pat-loan — a pattern shape, not a proof
- captured Aug 12, 2026 at 2:33 PMH. Delacroix (Credit analyst, Credit Administration) — upload to M365 Copilot.
- classified Aug 12, 2026 at 2:33 PM7 spans in member_pii, account_numbers, ssn_tax_id, loan_files; proof recorded on each span.
- decided Aug 12, 2026 at 2:33 PMwarn under policy v5, from the member_pii cell for the credit role group.
- transformed Aug 12, 2026 at 2:33 PMSafe transform taken on the coach card: 7 span(s) masked in place by offset. Warn does not rewrite anything by itself — the person chose this. The tokenize option is not on for the account_numbers cell in the credit role group under v5, so every span is masked.
- submitted Aug 12, 2026 at 2:33 PMSubmitted to M365 Copilot after transformation; the original text was not sent.
N. Oyelaran — Credit administration manager, Credit AdministrationMonitor025cd781-82ab-4481-8092-ab14860933f4
WhenAug 4, 2026 at 4:10 PMWeekWeek 9ChannelpasteDestinationClaude.ai (personal) (assessed)Policyv5Spans1TriageTrue positive
Turn the covenant table in the Kettering-Freight Systems credit memorandum into plain sentences a relationship manager can read out. Fixed-charge coverage is 1.17x.
Credit Memos at 57–74, matched by tax-credit-memo — vocabulary markers, not a proof
- captured Aug 4, 2026 at 4:10 PMN. Oyelaran (Credit administration manager, Credit Administration) — paste to Claude.ai (personal).
- classified Aug 4, 2026 at 4:10 PM1 span in credit_memos; proof recorded on each span.
- decided Aug 4, 2026 at 4:10 PMmonitor under policy v5, from the credit_memos cell for the credit role group.
- submitted Aug 4, 2026 at 4:10 PMSubmitted to Claude.ai (personal) as typed.
- adjudicated Aug 4, 2026 at 5:30 PMMarked a true positive by Y. Abadi in triage.
K. Osei — Portfolio manager, Commercial LendingWarn0bcebf7d-b3d3-4da2-965d-6a628b987359
WhenJul 24, 2026 at 8:09 AMWeekWeek 7ChannelpromptDestinationMicrosoft Copilot (consumer) (assessed)Policyv4Spans2Redact0 tokenizedTriageTrue positive
Summarize the credit file for loan CL-2026-06521 — borrower Astrid Espinosa, guarantor on the Kettering-Freight Systems relationship. Focus on covenant history and past-due notes.
Loan Files at 35–48, matched by pat-loan — a pattern shape, not a proof · Member PII at 60–75, matched by cmb-member-pii — a pattern shape, not a proof
- captured Jul 24, 2026 at 8:09 AMK. Osei (Portfolio manager, Commercial Lending) — prompt to Microsoft Copilot (consumer).
- classified Jul 24, 2026 at 8:09 AM2 spans in loan_files, member_pii; proof recorded on each span.
- decided Jul 24, 2026 at 8:09 AMwarn under policy v4, from the member_pii cell for the lending role group.
- transformed Jul 24, 2026 at 8:09 AMSafe transform taken on the coach card: 2 span(s) masked in place by offset. Warn does not rewrite anything by itself — the person chose this. The tokenize option is not on for the account_numbers cell in the lending role group under v4, so every span is masked.
- submitted Jul 24, 2026 at 8:09 AMSubmitted to Microsoft Copilot (consumer) after transformation; the original text was not sent.
- adjudicated Jul 24, 2026 at 5:30 PMMarked a true positive by M. Halloran in triage.
H. Delacroix — Credit analyst, Credit AdministrationWarn0fbee361-da0f-4fa3-a1aa-3eda76ea3e8e
WhenAug 13, 2026 at 10:47 AMWeekWeek 10ChannelpromptDestinationChatGPT (personal) (assessed)Policyv5Spans2TriageTrue positive
The card ending in this number keeps declining: 4539104249102205. The customer is Darnell Solberg. What should the branch check first?
Account Numbers at 48–64, proved by the Luhn checksum · Member PII at 82–97, matched by cmb-member-pii — a pattern shape, not a proof
- captured Aug 13, 2026 at 10:47 AMH. Delacroix (Credit analyst, Credit Administration) — prompt to ChatGPT (personal).
- classified Aug 13, 2026 at 10:47 AM2 spans in account_numbers, member_pii; proof recorded on each span.
- decided Aug 13, 2026 at 10:47 AMwarn under policy v5, from the member_pii cell for the credit role group.
- overridden Aug 13, 2026 at 10:47 AMOverridden with justification: “Content is a published rate sheet. No customer identifier is present in the pasted text.”
- submitted Aug 13, 2026 at 10:47 AMSubmitted to ChatGPT (personal) as typed.
- adjudicated Aug 13, 2026 at 5:30 PMMarked a true positive by M. Halloran in triage.
A. Bergström — Senior credit analyst, Credit AdministrationWarn11dc85a6-0a39-4c9c-8804-4f9f7b721ab8
WhenAug 7, 2026 at 9:20 AMWeekWeek 9ChanneluploadDestinationChatGPT (personal) (assessed)Policyv5Spans2TriageTrue positive
What is the collateral position on loan CL-2026-10818? The borrower is Tomas Krishnamurthy, and the appraisal came in at $1,264,100.
Loan Files at 40–53, matched by pat-loan — a pattern shape, not a proof · Member PII at 71–90, matched by cmb-member-pii — a pattern shape, not a proof
- captured Aug 7, 2026 at 9:20 AMA. Bergström (Senior credit analyst, Credit Administration) — upload to ChatGPT (personal).
- classified Aug 7, 2026 at 9:20 AM2 spans in loan_files, member_pii; proof recorded on each span.
- decided Aug 7, 2026 at 9:20 AMwarn under policy v5, from the member_pii cell for the credit role group.
- abandoned Aug 7, 2026 at 9:20 AMUser closed the prompt after the coach card. Nothing reached ChatGPT (personal).
- adjudicated Aug 7, 2026 at 5:30 PMMarked a true positive by M. Halloran in triage.
M. Ramaswamy — Relationship manager, Commercial LendingRedact1503a827-2fe9-4bae-88f4-fa8f8323920c
WhenAug 7, 2026 at 8:59 AMWeekWeek 9ChannelpasteDestinationPerplexity (assessed)Policyv5Spans2Redact0 tokenizedTriageTrue positive
Summarize the credit file for loan CL-2026-88917 — borrower Camille Nilsen, guarantor on the Hocking-Hills Manufacturing relationship. Focus on covenant history and past-due notes.
Loan Files at 35–48, matched by pat-loan — a pattern shape, not a proof · Member PII at 60–74, matched by cmb-member-pii — a pattern shape, not a proof
- captured Aug 7, 2026 at 8:59 AMM. Ramaswamy (Relationship manager, Commercial Lending) — paste to Perplexity.
- classified Aug 7, 2026 at 8:59 AM2 spans in loan_files, member_pii; proof recorded on each span.
- decided Aug 7, 2026 at 8:59 AMredact under policy v5, from the member_pii cell for the lending role group.
- transformed Aug 7, 2026 at 8:59 AMRedacted under the member_pii cell: 2 span(s) masked in place by offset. The tokenize option is on for the account_numbers cell in the lending role group under v5.
- submitted Aug 7, 2026 at 8:59 AMSubmitted to Perplexity after transformation; the original text was not sent.
- adjudicated Aug 7, 2026 at 5:30 PMMarked a true positive by M. Halloran in triage.
5. Detection accuracy
Precision and false-positive rate are computed from the dispositions of the adjudicated sample, never asserted. An unreviewed detection is not evidence of anything, so it is not in the denominator — and the errors are listed rather than netted off, because a report that hid its false positives would be advocacy.
Adjudicated120True positives112False positives8Precision93.3% against a 90% targetFalse-positive rate6.7% against a 8% ceiling
How the sample was drawn. The adjudication queue is a stratified sample of the detections in the trailing thirty days: each data class contributes in proportion to its share of the window, and within a class events are taken in a fixed order derived from the pilot seed. Detections separately reported as errors are included as well. Reported errors are in the sample by construction rather than by the draw, so precision over this sample is a floor on the sample’s own accuracy and not an unbiased estimate of the control’s. Recall is not measured at all — see the accuracy record. Draws alternate between the two adjudicators in the sampled order, so neither officer marks a contiguous block and the sample carries both signatures.
Who marked it. M. Halloran (Compliance officer, first line) marked 60; Y. Abadi (BSA officer, second line) marked 60.
| Measured | What the figure is, exactly |
|---|
| Precision | Of the detections in the adjudicated sample, the share a named officer marked a true positive. It describes the flags this control raised, over the sample stated in the sampling rule — not the control’s behaviour on traffic it never flagged. |
| False-positive rate of flagged-and-reviewed | The complement of precision over the same sample and the same denominator: the share of reviewed flags marked wrong. It is not a false-positive rate over the negative population, which would need a count of unflagged submissions. |
| Not measured | Why nothing here measures it | What measuring it would take |
|---|
| Recall — sensitive submissions detection missed | No figure on any surface measures it, and none can be derived from the adjudicated sample: adjudication only ever sees events the engine already flagged. | Ground truth independent of the detector — a second, differently-built classifier over the same traffic, or a human review of a sample of unflagged interactions. |
| Coverage — the share of staff and devices the sensor reaches | The pilot has no deployment inventory in this record, so a detection count has no population behind it. | An endpoint inventory reconciled against the staff directory, per week. |
| Adjudicated false positive | Classes that fired | Event |
|---|
| What should a training module on writing a credit memorandum cover for new analysts? This is for the curriculum, not a live file. | Credit Memos | 7ade87d9-3839-4152-9e5e-aeab25b12aec |
| Reformat this vendor invoice line for the AP import — their remittance block reads “Acct 00458217”, net 30, freight prepaid. Does the column order match the template? | Account Numbers | 15607f35-06ae-411a-baa6-0fa46c98966b |
| Draft a polite reply to the landscaping vendor about the Project Sycamore planting schedule — the Main Street beds are behind and we want them finished before the branch anniversary. | Custom Terms | beb9c07f-f662-496b-bc00-a6f91a248bf7 |
| The facilities contract carries note number CL-2026-00912 — that is the vendor’s document number, not one of ours. How should I file it? | Loan Files | 9c422853-82ec-4ed1-9a61-92cdcdb62f2a |
| Tighten this press release quote: “Alder Creek is proud to sponsor the county fair,” said E. Sandoval. Keep the published routing number 041502211 in the donation footer. | Member PII, Account Numbers | b38ae319-82c7-4eef-91d1-bdead8c7e5c8 |
| Does Cardinal Ledger export a trial balance by cost center? I am trying to tie out the quarterly numbers and the manual is unclear. | Custom Terms | 6534737e-c60c-4bc5-b756-2f77bb9be2d9 |
| Write a thank-you note for the volunteers who ran the school board packet drive at the Elyria branch this weekend. | Board Materials | 17c99963-f367-4c0e-9f10-c6ca5581a826 |
| The vendor’s W-9 shows employer identification number 47-2318806, and the remittance form wants it as 472-31-8806 — which format does our AP system expect? | SSN / Tax ID | 8bb02d59-819f-4895-afff-9845dcbf7e25 |
The next draw. 16 detections have been drawn by the same rule and carry no verdict yet. They are not in either figure above, because an unreviewed detection is not evidence of anything.
| Awaiting adjudication | Who | Classes that fired | Decision | Event |
|---|
| What does a returned item on account 00408779 do to the overdraft fee schedule? | B. MwangiFinance | Account Numbers | MonitorWeek 6 | f04e3760-f569-467a-a75d-88694db6f0d6 |
| Reconcile these two entries against deposit account 00863164 and tell me which one is the duplicate posting. | L. TranRetail & Branch Ops | Account Numbers | MonitorWeek 7 | 80a510a3-6980-4be4-b2b0-51d3ede66a3f |
| Customer Espen Mackintosh is disputing three ACH debits on account 00849552. Draft a response that explains the provisional credit timeline. | N. OyelaranCredit Administration | Member PII, Account Numbers | WarnWeek 8 | bdd9da93-a76e-4fbb-9a92-79588f00ac33 |
| Draft the recommendation section of a credit memorandum for Andre Asante, requested facility $518,612, secured by equipment. | N. OyelaranCredit Administration | Credit Memos, Member PII | WarnWeek 8 | 105e2834-7711-4893-bac5-4cdc368f4657 |
| Rewrite the mitigants paragraph in the attached credit memorandum for Alicia Qureshi at Zanesville Enterprises, requested $1,313,374. Keep the committee language, drop the hedging. | N. OyelaranCredit Administration | Credit Memos, Member PII | WarnWeek 8 | 89403b86-9c6e-454d-bb54-cdeb01483dff |
| This call keeps returning 401. The header is Authorization: Bearer ghp_aym2myuy2yuiqeuuuqaum2eyyiua — what am I missing? | G. IyerIT | API Keys / Creds | BlockWeek 8 | 496a590b-8f0f-4f2f-bd7e-139edcf7684b |
| What does covenant 6(b) in loan CL-2026-50577 actually require at each quarter end? | T. BeaulieuCommercial Lending | Loan Files | MonitorWeek 9 | 4097450f-f7dc-4786-a26c-ba9cfd2d0778 |
| Write a follow-up note to Camille Nilsen at (419) 555-0149 about the certificate of deposit maturing next month. | A. BergströmCredit Administration | Member PII | WarnWeek 9 | c1fcfcdb-9476-4747-9dd3-cec36841fe1d |
| What is the collateral position on loan CL-2026-06494? The borrower is Marisol Krishnamurthy, and the appraisal came in at $2,180,680. | R. OkaforCommercial Lending | Loan Files, Member PII | RedactWeek 9 | 620437b4-0919-4fcd-a2d8-77143e72f1de |
| Summarize this complaint. Customer: Greta Nakashima, callback (419) 555-0103, branch: Alder Creek Main. | H. DelacroixCredit Administration | Member PII | WarnWeek 9 | 3c930265-1808-4f6a-be70-cd11502f1f6e |
| How should I phrase a beneficiary change confirmation for Nikhil Ramanathan, reachable on (419) 555-0182? | W. NyathiCompliance/BSA | Member PII | MonitorWeek 9 | 8087d6f6-2852-46e8-a55c-0c8fc07648d8 |
| Reconcile these two entries against deposit account 00117740 and tell me which one is the duplicate posting. | P. NakamuraRetail & Branch Ops | Account Numbers | MonitorWeek 9 | 424ab56b-aaf0-462d-a705-9677127328c0 |
| Please review this loan application for Wren Callahan, SSN 453-56-4914, account #00196680. The debt-to-income ratio is 49% — is that inside our commercial guideline? | D. WhitfieldCommercial Lending | Member PII, SSN / Tax ID, Account Numbers | RedactWeek 10 | 6af7370d-fe32-4e09-b5e3-cd08be7126ae |
| Summarize the credit file for loan CL-2026-68449 — borrower Bela Nilsen, guarantor on the Kettering-Freight Systems relationship. Focus on covenant history and past-due notes. | A. BergströmCredit Administration | Loan Files, Member PII | WarnWeek 10 | d8fe8f15-3d30-4d72-9931-84c5fdc021d5 |
| What is the collateral position on loan CL-2026-52110? The borrower is Marisol Krishnamurthy, and the appraisal came in at $807,448. | A. BergströmCredit Administration | Loan Files, Member PII | WarnWeek 10 | 93c2046c-a77b-4ffb-b77b-646300c8bc96 |
| The card ending in this number keeps declining: 4539860236701693. The customer is Imani Kovalenko. What should the branch check first? | A. BergströmCredit Administration | Account Numbers, Member PII | WarnWeek 10 | bbc7cbb5-6152-43f3-b3e6-2b42dcc62fd6 |
7. Custody of this record
What this artifact holds. Every record behind this package is fictional and generated: one seeded event log for an institution that does not exist, with fictional people, fictional account and loan numbers, and excerpts written by the generator. Nothing here is any real person’s information, and no real institution’s traffic was read to produce it. The excerpts are excerpts by construction — the log stores the fragment a detection was found in, never a full prompt.
What it does not hold. Text a visitor types into the intercept simulator is classified in the request and stored nowhere: there is no database in this deployment, no write path from any surface, and no log line carrying the text. That is why a visitor’s own intercept never appears in this package or in the event log behind it, and why nothing a visitor marks on the adjudication queue survives a reload. The demo will not persist a reader’s words in order to look more capable.
How this copy is reached. Where this build is deployed it sits behind a passcode, and the machine-readable feed sits behind the same gate as the pages — the evidence API is not a second door. The gate keeps fictional figures away from search engines; it is a cookie check and not authentication, and this package says so rather than implying a control it does not have. A checkout run locally with no passcode configured has no gate at all.
What the product intends, which this demo does not evidence. The product definition’s privacy posture is no long-term retention of full prompt content, with the retention window and the access model configurable by the institution (§5.2) — and the demo takes no position on what a bank should choose. That is a statement of intent recorded here because a reader of an examiner package is entitled to ask where the product itself stands; it is not a measurement, nothing on this page evidences it, and the retention schedule, the encryption posture and the access model for a production deployment are open questions this build does not answer.