Managing records created with generative AI assistants (including Microsoft 365 Copilot)
Generative AI virtual assistants, such as Microsoft 365 Copilot, are the most common form of generative AI technologies currently used by Australian Government agencies. These tools assist agency staff in the creation of record content and are often integrated into common office applications.
They can perform tasks such as:
- creating draft content for office documents in response to user prompts
- summarising meetings or documents into concise text
- creating new image, video, code and audio content
- auto generating responses to emails
- transcribing recordings of meetings.
While generative AI assistants can create or recommend content as an output in response to user prompts, it is the responsibility of the user to review the content created and ensure that it is accurate, appropriate and fit-for-purpose – amending and rewriting the AI generated content as needed, and in accordance with business requirements, to create the final business record.
The retention requirements for the final versions of business records created and for the related generative AI outputs and associated prompts and inputs, will depend on the value and purpose of the final records created using generative AI outputs, the associated risk profile, and the overall contribution of the AI outputs to the development of the final records.
Final versions of business records created using generative AI outputs
Where generative AI assistants are used as a content creation tool to support the development of final versions of business records, the generative AI outputs that provide this content will often be considered transitory and facilitative in nature.
Generative AI outputs such as draft document text in response to prompts, or transcripts for meetings, may be considered the equivalent of rough drafts, initial notes or working papers from which more substantive records can be constructed by human users. In such cases, it is the final record created by the human user that has the greatest value and that will generally need to be captured into your agency's approved records system and retained in accordance with the relevant records authorities.
Not all content created by generative AI technologies will necessarily contribute to the creation of final business records that need to be captured in your agency's approved records system. There may be circumstances where low value facilitative or transitory final records may be created using generative AI outputs. In such cases your agency's NAP policy may allow for the destruction of the final record when it is no longer required for business purposes.
Generative AI assistants' outputs that must be retained
In some situations, generative AI outputs will be required to be captured into your agency's approved records system and retained in accordance with the relevant National Archives' approved records authorities. This will apply to:
- outputs which support the creation of final versions of business records that are high-value or significant in nature, or otherwise relate to high-risk or sensitive matters, or are relied upon to support decision-making. In such cases the AI outputs may be treated as major drafts or supporting research and should be retained if they contribute significantly to the formation of the final record and/or provide evidence of the decisions taken in the final record; and
- outputs which are relied upon as the primary evidence of business activities, particularly those that make recommendations or contribute to decision making or provide the best available evidence of the performance of a business activity. This includes generative AI outputs that are retained as final versions of business records in their own right, particularly where there is little or no human user intervention in their creation or acceptance as a final record.
Generative AI assistant outputs that may be destroyed
Generative AI assistant outputs that do not have ongoing business or legal value for your agency and are not required to be retained in accordance with a records authority issued by National Archives, will likely be eligible for destruction as a normal administrative practice when no longer required. This will apply to:
- generative AI assistant outputs that are essentially minor drafts and working papers supporting the creation of low-value or routine business records, or otherwise relating to low-risk matters where no decision-making is involved – such as where AI output content is created but either not included in the final record or edited and altered before inclusion; and
- generative AI outputs that are created for reference purposes only and do not contribute to the creation of a final record.
Note: In some instances generative AI outputs that support the creation of final versions of low value or routine business records, may be considered major drafts or supporting research and retained if they provide a substantial basis for the development of the final record (e.g. substantial AI generated draft content is created that is of good quality and requires little work to finalise; or, a generative AI summary is relied upon to develop a final document). Agencies should take a risk-based approach when determining whether to capture and retain AI outputs in these situations.
Disposal of generative AI assistant prompts and inputs
Where generative AI outputs are captured and retained as business records, it may also be necessary to keep the prompts and other inputs to ensure there is credible evidence to demonstrate how the AI outputs were created and thereby support transparency and accountability.
Agencies will need to make risk-based decisions on which AI prompts and inputs are required to be retained as supporting evidence. These decisions will be determined by the value of the final record that results from the AI outputs, legal requirements and business needs, and the degree to which the prompts and inputs can support understanding and provide relevant evidence to demonstrate how the AI outputs were created.
In some instances, there may be technical difficulties in capturing the relevant prompts and inputs relating to the generative AI outputs, in which case steps should be taken to at least indicate the input sources in the relevant record metadata (even if the actual inputs cannot be captured and retained). Where it is not possible for an agency to retain prompts and inputs identified in its risk-assessment as being required as supporting evidence, it may be necessary to consider whether the use of AI is appropriate in the given situation.
For example, where generative AI assistant output is retained as a major draft the prompts and inputs may also be required to be retained and captured into your agency's approved records management system. This will be determined based on the risk profile and importance of the matter to which they relate. In such cases the generative AI output should be clearly linked to the relevant prompts and inputs – particularly if the output is to be retained as a final document or decision-making document where there has been little or no human input.
Where it is determined that the prompts and inputs used to create the AI assistant outputs are not required to be recorded and retained, these records should be eligible for disposal Iin accordance as your agency's NAP policy when they are no longer required for business purposes. This will likely be the case for most generative AI assistant prompts and inputs, particularly those creating AI outputs relating to low value final records.
Considerations for managing generative AI related records
As generative AI technologies continue to advance and the quality of outputs generated by AI assistants improves, it is likely that these AI outputs will increasingly be used as the final record, with little or no review or alteration by human users. Agencies should monitor the use of generative AI by their staff and where AI outputs are relied upon as final versions or for decision-making, the implementation of increased controls should be considered. Such decisions should also be informed by the relevant Australian Government policies and frameworks (see More information on the use of AI in Australian Government).
The following considerations apply to the management of records created by generative AI technologies:
- Agencies that use generative AI technologies, such as Microsoft 365 Copilot, to assist in content creation should ensure that their NAP policies adequately provide for the disposal of low-value, facilitative AI generated draft content and associated prompts and inputs.
- Prompts given to AI assistants to inform creation of outputs, will generally not be required to be retained, unless your agency has specific business requirements to do so – such as to provide supporting evidence to demonstrate the origin of AI outputs that contribute to particularly high-value records. Any such requirements should be reflected in the agency's business practices and procedures.
- Agency AI policies and procedures should clearly inform staff of their responsibilities and require that all generative AI outputs are reviewed and amended as necessary by a human user, as part of normal business practice to ensure accuracy and reliability of information.
- Agencies rolling-out generative AI assistants should ensure that agency staff are trained in their obligations regarding managing AI outputs and that they are made aware when it is, and is not, appropriate to destroy these records.
- Where content created by AI technologies is accepted as a final record, without further human review or input to verify accuracy, the AI generated status of the content should be added to the record metadata. For example, where an AI generated transcript is captured directly into the agency's approved records management system without review or amendment, there should be an indication in the record title and/or 'notes' field that the record is AI generated and the content is unconfirmed.
- When using generative AI assistants to record meetings and generate transcripts, care should be taken to ensure that consent to record has been obtained from participants. Where meetings are of a particularly sensitive nature, it may be necessary to ensure that participant consent is obtained and recorded prior to the meeting commencing.