Reclaim unused storage

New batch job to reclaim allocated but unused storage in Next®.

The Next® Storage Engine is optimized for performance and long-term retention. When you delete a document in Next® it keeps both the deleted version, all previous versions, and the business log to document it.

According to GDPR (EU’s personal data protection regulation), you cannot keep documents with personal data on record unless you have either a legal reason to do so, or an explicit written permission.

To comply with GDPR, Next® was enhanced with a ‘remove’ feature, that effectively eradicate both the document, all previous revisions, and the business log.

The storage space occupied by removed documents remains allocated in Next® until the internal storage structures (Haystacks) are reorganized or pruned.

This new feature does exactly that: Prunes, reorganizes, or trims the internal haystack storage structures. And creates new haystacks that does not include any removed documents.   

Reclaim unused storage creates new and smaller haystacks 

Be aware that reclaiming unused storage is a long-running and resource intensive task. Running Reclaim unused storage, on a Next® that is already low on resources is not advisable. 

Future enhancements

In our December 2019 release the handling of very large batch jobs is enhanced further. Improved utilization of available memory using streaming, and improved control of prioritization, will reduce the impact of running Reclaim unused storage.      

In a coming release of Next®, you will be able to schedule this, and other batch jobs in calendar. 

For the techies

Reclaim unused storage consists of two phases: 

  1. Analyzing
  2. Compacting

The analyzing phase builds a revision graph for all removed documents across all the selected haystacks.

The compacting phase, reads haystacks with unused storage, and write haystacks without. Once the new haystack is complete, it replaces the old haystack. 

You are able to run either the analyzing phase only, or both phases in one. 

If the analyzing phase is interrupted, it must be restarted.

If the compacting phase is interrupted, the process resumes automatically when Next®is restarted.

Additional information

Please refer to the online product guide for additional information on this feature, once it is released.

Commercial terms and conditions

This update is available at no additional cost, to users with an active service plan. Consultancy assistance will be invoiced.

Disclaimer

Despite our best efforts, we may be forced to change both content and expected delivery of future product updates without notice.  

Details

Title:

Reclaim unused storage

Type:

New feature

Status:

Released

Release time:

November 2019

Affected products:

Next® Bank Statements
Next® Contracts
Next® Emails
Next® Enterprise Archive
Next® ExCustody
Next® Invoices
Next® Mailroom
Next® Processes

Audience:

Admin
Architect

Classification:

Public

Responsible product manager:

Kim Hellum

Updated:

11.12.2019

By:

Kim Hellum