CryoNAV Data Storage Backup - Revision history

Admin: Bot edit via cryonavedit.py: bump cleanup thumb size to bust cache

2026-05-20T21:43:15Z

Bot edit via cryonavedit.py: bump cleanup thumb size to bust cache

← Older revision		Revision as of 23:43, 20 May 2026
Line 15:		Line 15:
	== Selective cleanup ==		== Selective cleanup ==

	[[File:CryoNAV storage cleanup.png\|center\|thumb\|~~700px~~\|Storage Cleanup tab: pick intermediate files to delete while retaining raw data and processing records.]]		[[File:CryoNAV storage cleanup.png\|center\|thumb\|720px\|Storage Cleanup tab: pick intermediate files to delete while retaining raw data and processing records.]]

Admin: Bot edit via cryonavedit.py: add storage tab screenshots

2026-05-20T21:31:48Z

Bot edit via cryonavedit.py: add storage tab screenshots

← Older revision		Revision as of 23:31, 20 May 2026
Line 14:		Line 14:

	== Selective cleanup ==		== Selective cleanup ==

			[[File:CryoNAV storage cleanup.png\|center\|thumb\|700px\|Storage Cleanup tab: pick intermediate files to delete while retaining raw data and processing records.]]


	Through the interface, users can selectively delete intermediate processing files (such as motion-corrected stacks, aligned series, or reconstruction volumes from superseded processing branches) while retaining the raw data and database records.		Through the interface, users can selectively delete intermediate processing files (such as motion-corrected stacks, aligned series, or reconstruction volumes from superseded processing branches) while retaining the raw data and database records.

Admin: Bot edit via cryonavedit.py: migrate to sidebar-target titles

2026-05-20T20:31:01Z

Bot edit via cryonavedit.py: migrate to sidebar-target titles

New page

CryoNAV is designed for single-server deployment with a simple, file-based storage model: SQLite for metadata, the host filesystem for raw and processed image data.

== Database storage ==

The database stores only metadata, file paths, processing parameters, and state. It remains small (tens of megabytes even for large projects) and can be backed up with a single file copy.

The database schema mirrors the physical cryo-ET workflow: Projects contain Grids, which contain Search Maps and Tilt Series, from which Processing Runs produce Tomograms and Denoised Tomograms. Cryo-FIB images from instruments such as the Aquilos are stored as a dedicated entity linked to grids.

In addition to file paths, the database records the size of all tracked files (raw data, intermediate outputs, final results), enabling the storage monitoring described below.

== Storage monitoring ==

The '''Storage''' page in the CryoNAV interface provides an overview of disk usage across raw data, intermediate processing files, and final outputs for all projects, helping teams monitor their storage footprint and identify candidates for cleanup.

== Selective cleanup ==

Through the interface, users can selectively delete intermediate processing files (such as motion-corrected stacks, aligned series, or reconstruction volumes from superseded processing branches) while retaining the raw data and database records.

Because every processing step stores its complete parameter set in the database (see [[CryoNAV Metadata Management#Processing provenance|Processing provenance]]), the full pipeline can be re-executed from raw frames at any time, allowing researchers to reclaim storage without losing the ability to reproduce their results.

== Backup ==

The recommended backup model is a single-file copy of the SQLite database plus a filesystem-level backup of the underlying image storage. SQLite's simplicity makes the database portion straightforward; the image data follows the same backup model as any cryo-EM data store.

== See also ==

* [[CryoNAV Metadata Management|Metadata Management]]
* [[CryoNAV Data Sharing Archiving|Data Sharing & Archiving]]

[[Category:Modules]]