Updating your data in CELUS Data Hub and Power BI

Introduction

Keeping your usage data up to date is a constant challenge and key issue at the same time. When you use CELUS Data Hub for your Power BI reporting, your data travels from CELUS to your reports, and there are three places to keep an eye on:

  • CELUS & Data Hub: All your usage data has to be harvested in CELUS. You can check this easily in the Data coverage overview and the Platforms detail. For more, see Checking if data is in CELUS. From CELUS, the data is loaded into Data Hub automatically.
  • Power BI Desktop: Updating Data Hub does not automatically update your Power BI report. In the Import mode, the most common one, the data from Data Hub is refreshed here only when you request it.
  • Power BI Service (the Microsoft cloud): Here you can set up refreshes to keep your published reports up to date, on demand or on a schedule.

This article explains how each of these works, what you can do manually, and how to set it up.

Updating data in CELUS Data Hub

  • Data from your CELUS account is updated in Data Hub automatically once per day.
  • You can also start an update manually, but only once per hour. The button for the manual synchronization is in the Data Hub menu.

Data in Power BI Desktop

Power BI Desktop is the application installed on your computer. When you connect to Data Hub, you select the connection mode. In Import mode, the most common one, the model loads a copy of the data from Data Hub and keeps it in the file. The data is refreshed only when you request it, so the report does not change when Data Hub is updated.

To refresh the data, click Refresh on the Home tab. Power BI Desktop then loads the latest data from Data Hub into your model.

Before you refresh, make sure Data Hub already contains the data you need, either through the daily automatic update or a manual update (see section 1).

A note on DirectQuery mode: You can also choose DirectQuery mode, where Power BI queries Data Hub each time you open the report instead of keeping a copy of the data in your file. The report then shows whatever Data Hub holds at that moment, but we still recommend Import mode because of limitations of the DirectQuery mode, for example: you have to create the date hierarchy (year, quarter, month) yourself, and publishing to Power BI Service needs extra setup.

Data in Power BI Service

Power BI Service is the Microsoft cloud, where you publish your reports. A published model keeps the data it last loaded, just like in Power BI Desktop, so it needs to be refreshed too. You can refresh it on demand or set up a scheduled refresh, so it updates automatically. For Data Hub data, both options only work with an on-premises data gateway.

Why you need a gateway

The ODBC ClickHouse connector used for Data Hub is available in Power BI Desktop, but it is not built into Power BI Service. Without a gateway, the refresh of a published report fails with an error.

What the gateway is

The gateway is a small Windows program that connects Power BI Service to Data Hub. When a refresh runs, the Service passes the query to the gateway, and the gateway fetches the data from Data Hub. More information here: On-premises data gateways in Power BI.

Which gateway to choose and how to set it up

  • Personal mode is the easy option to start with. It runs as a normal app on your computer, so it only works while the computer is on and you are signed in. It supports Import mode only, which is enough for scheduled refresh.
  • Standard mode is the proper setup for long-term use. It is installed as a service on a computer that stays on, can be shared, and is the option Microsoft recommends. If you prefer Standard mode, please contact your IT department.

Step-by-step instructions with screenshots for setting up the gateway are in a separate article: ClickHouse - Power BI Service Gateway Setup.

Refreshing the model in Power BI Service

Once the gateway is set up and the Data Hub credentials are entered in the semantic model’s settings, you can refresh the model:

  • On demand: click Refresh and select Schema and data or Data from the menu.

We recommend doing this first to check that the connection works.

  • On a schedule: once the manual refresh works, you can Schedule refresh, so the model updates automatically. Choose a time when your computer is on and you are signed in.

If you run into a problem, feel free to contact our support team at ask@celus.net.

No items found.