pod_db_utils

Utilities for the Pod results database.

Module

Functions

update_pod_db

def update_pod_db(    pod_name: str,    connector: PodDbConnector,    datasource_name: str,    datasource: BaseSource,) ‑> None:

Creates and updates the pod database.

This is a static database on the pod with the datapoint hashes so we only compute them once. For each datapoint row in the datasource, a hash value is computed. Then the data from (each table of) the datasource, together with the hash value, are written to the database.

caution

Does not work for multi-table DatabaseSources as we cannot load the data into memory.

---