1. Home
  2. Getting Started
  3. Data Retention in OmniCenter
  1. Home
  2. User Reference
  3. Data Retention in OmniCenter

Data Retention in OmniCenter

Time-series Data

OmniCenter stores the time-series data (the sort of data you would typically see displayed in a graph) that it collects from managed devices in individual database files.

The first time a managed device is polled, the data polling engine in OmniCenter creates a new database file for each statistic being collected. The structure of this file is such that it does not grow in storage size as new data is added. Instead, it “rolls up” older data into averages of itself, freeing up space for the newer, more granular data values. As a result, OmniCenter can retain data for 3 years. However, as you look farther back in time, the data becomes less granular and more averaged.

Data that has reached its retention time limit is no longer rolled-up and is simply overwritten with the most recent value (see tables below). This ensure that OmniCenter’s data footprint does not grow unless you add more managed devices (thus more database files).

Averages and Peaks

Peak data values are rolled-up and stored separately from averaged data values using a MAX function. This prevents historical peaks from being blunted over time through averaging.

By default, OmniCenter retains data for the following intervals:

 

General Time-series (Statistic) Data

Collection Period Retention Period
1-minute 7 days
5-minute 100 days (just over a single quarter)
30-minute 196 days (just over 6 months)
4-hour 3 years

 

Per-process Time-series (Statistic) Data
(CPU per process, memory usage per process)

Collection Period Retention Period
5-minute 9 days
30-minute 35 days
4-hour 365 days

 

When displaying time-series data in graphs, OmniCenter always shows the most granular data (shortest collection period) available that covers the entire time period of the graph. Therefore a report run in OmniCenter with a start date of 120 days ago will show data from the 30-minute average (the most granular for that time period). Zooming into that graph will show the most granular data available for the zoomed time period, allowing you to quickly get to the most granular data level available.

Keep in mind that even a graph zoomed in to maximum will only display data as granular as is available for that historical period. To zoom in to 1-minute data, a graph must only be displaying data that is less than 7 days old. If any data points older than that are included on the graph, it will revert to 30-minute data. To zoom in to 30-minute data, a graph must only be displaying data that is less than 100 days old. And so on.

Log Data

For historical-log-type data (such as syslog, alert history, audit logs, detailed call records, and the like) OmniCenter will store the last 3 million records, regardless of date. Each log type is handled independently, so OmniCenter stores 3 million of each type (except SNMP trap and syslog—which are stored together). In most environments, this provides several years of log history. However, in very-high-traffic environments, it may be less. OmniCenter stores time-series data for log monitoring as indicated in the time-series data section above.

Traffic Flow Data

Traffic flow data is accounting type data on specific IP connections. This type of data is provided by technologies such as NetFlow, J-Flow, sFlow and IPFIX.

OmniCenter stores this data in a two ways:

  • Detailed 1-minute flow logs, which are stored for 6 hours. These includes specific information on individual TCP connections between devices.
  • Hourly conversation summaries, which are stored for 7 days.

Time-series flow data (overall volume per application per interface) is stored as indicated in the time-series data section above.

Please contact Netreo support to discuss your requirements if you need additional flow log storage. Some environments may require additional hard disk capacity to accommodate larger flow archives.

Updated on July 22, 2020

Was this article helpful?

Need Support?
Can’t find the answer you’re looking for? Don’t worry we’re here to help!
Contact Support

Leave a Reply