Skip to main content
Enterprise integration & API

AI audit log: what to record in an integration and why

A customer asks "why did you call me?", a manager asks "why did the bot quote that price?", and the answer is nowhere. This guide builds an audit log for AI integration: why audit matters more with AI, what to record, the reason for actions not taken, entry contents, retention and access, who reads it and an example.

October 7, 20266 min read

Short answer

In an AI integration, the audit log holds the answer to one question: "why did this happen?" When a customer asks "why did you call me?", a manager asks "why did the bot quote this price?" or an auditor asks "who looked at this customer's data?", the answer should be in the log. For AI, the log is broader than for ordinary systems: the AI's answer and the knowledge it used, the APIs it called, automated actions and the reasons for actions not taken, human interventions, configuration changes and access. A log's value depends on who reads it and when — if nobody looks, it is just stored data.

Why audit matters more with AI

In an ordinary system a person takes the action, and the log answers "who did what". In an AI system, some decisions are made by the model: which answer to write, which piece of knowledge to use, whether to hand the customer to an agent, whether to call a lead. Model decisions are not identical every time, and answering "why" later is only possible if what was seen at the moment of decision was recorded.

On top of that, AI behaviour changes with configuration: one line of instructions or one new knowledge document changes thousands of answers. If those changes are not logged, "why did it answer differently yesterday?" has no answer.

What to record: six groups

  1. AI answersThe answer text, the knowledge pieces used, the model and version, the time.
  2. Tool and API callsWhich API, with which parameters, what it returned, whether there was an error.
  3. Automated actionsA lead was created, a call made, a message sent — and if not, why not.
  4. Human interventionAn agent stopped the bot, corrected an answer, took over the conversation.
  5. Configuration changesInstructions, knowledge base, routing rules — who, when, what.
  6. AccessWho logged in, which customer's data they viewed, what they exported.

The reason for an action not taken

The most forgotten kind of log entry answers "why didn't it?". If an automatic call rule did not call a lead — because the lead arrived out of hours, the daily limit was reached, or a manager had already taken it — that decision must also be logged with its reason. The question support hears most is "why didn't this happen?", and only a record of the action not taken can answer it.

What a good log entry contains

  • The exact time, with time zone.
  • Who or what: a user, the AI, an integration account.
  • Which object: conversation, customer, lead — with its identifier.
  • What was done and the result: success, failure, skipped.
  • The reason or source: rule name, knowledge used, error code.
  • Version: under which instructions or rule version.

Retention and access

The log is itself sensitive data: it can contain customer messages and personal data. Three decisions need writing down: how long the log is kept, who can view it, and who can change it — ideally nobody. Retention is chosen by sector requirements and company policy, and the amount of personal data in the log is kept to a minimum — the conversation's identifier rather than the full message text, for example. Setting up access rights is covered in SSO and role-based access.

Who reads it and when

  • Support: in a specific customer complaint — "why did you call?", "why did the bot say that?".
  • Quality: a weekly sample — do AI answers match the knowledge base?
  • IT: for errors and integration problems.
  • Leadership: to check the outcome of configuration changes.
  • Auditors: in regulated sectors, on access and changes.

An illustrative example

This is an illustrative example. A customer complains the bot quoted them an old price. The log is opened: the knowledge piece used in the answer is the old price list; the new one was added three days ago, but the old one was never switched off. The configuration log shows who added the new document and when.

Decision: the old document is switched off, and a new rule is added for the knowledge base — when a price is updated, the old document is deactivated the same day. The customer gets an honest explanation and a correction. Without the log, the cause would have been guessed at.

Common mistakes

  • Logging only errors — successful but wrong decisions stay invisible.
  • Not recording why actions were not taken.
  • Not logging configuration changes.
  • Everyone having access to the log.
  • Never reading the log.

Limitations

A log does not fully explain why the AI "thought" the way it did: it shows the input, the knowledge used and the result, not the model's internal reasoning. Very detailed logs create both storage and privacy risk — what to record and how long to keep it is a balance. In regulated sectors, agree the requirements with legal and compliance.

Testing the log

The best way to check the log works is a drill in advance. Once a quarter, take an invented complaint — "the customer says they got a call at 23:00" — and try to find the answer in the log: was there a call, under which rule, and why at that hour? If the answer cannot be found in 15 minutes, the log is either missing data or hard to search. The drill is there so no time is lost when a real complaint arrives.

The log's owner

An audit log needs an owner — usually IT or security. The owner manages the retention rule, access and regular checks. On the business side, one person reads a weekly sample: are AI answers and automated decisions as expected? Without these two roles the log is written but never used.

Logs in Vexvon

In Vexvon, every bot reply stores which knowledge pieces it used. Every AI call is logged separately by purpose — model, channel, tokens, cost, latency and status. The status of webhooks arriving from channels is tracked. Actions on a lead — assignment, call, unreachable, message, note, stage, reminder, close — go into its log, and the automatic call rule records every call and every decision not to call with its reason. According to the security page, actions in the account are logged. More on security.

Next step

Take three customer complaints from last month and check for each: can the log show what happened and why? Where there is no answer, there is a gap in your log. Error handling is covered in API error handling and retry rules. More articles are in the enterprise integration section, and we can review your logging requirements together during a demo.

Live demo

Ready? Let's start

See Vexvon live in a 10-minute demo.

  • A scenario built for your business
  • A live sample call
  • A tour of the platform
Get a demoorBook a meeting

Your details are used only for the demo and to get in touch.