How to persist data in a topic

Overview

By default, topics do not store data to the Data Catalogue. You can choose to permanently store all data streamed into a topic by persisting it.

Before you begin

  1. You should have at least one non-persisted topic that you want to persist. If you’ve just created one, persistence will be off by default.

Steps

  1. Click the Topics icon topics in the left-hand menu.

  2. Click the Persistence toggle next to the Topic you want to persist.

persist toggle
The toggle shows the current state, so it will read “OFF” for a topic that is not persisted.
  1. Click PERSIST in the confirmation dialog.

  2. After a few seconds, the topic will be set to persist and all data streamed into it will now be stored in the Data Catalogue.

If persistence is turned off, new data will not be saved to the catalogue, but data that has already been persisted will remain.