pycarol.carolina

class pycarol.carolina.Carolina(carol)[source]

This class is used to handle any iteration with Carol data storage (CDS).

Parameters

carol – class: pycarol.Carol

get_bucket_name(space)[source]

Format the bucket path for each possible space.

Parameters

space

str, Which bucket to get. Possible values:

  1. ”golden”: Data Model golden records.

  2. ”staging”: Staging records path

  3. ”staging_master”: Staging records from Master

  4. ”staging_rejected”: Staging records from Rejected

  5. ”view”: Data Model View records

  6. ”app”: App bucket

  7. ”golden_cds”: CDS golden records

  8. ”staging_cds”: Staging Intake.

Returns

formatted bucket path

get_path(space, vars)[source]

Format the bucket path for each possible space.

Parameters
  • space

    str, Which bucket to get. Possible values:

    1. ”golden”: Data Model golden records.

    2. ”staging”: Staging records path

    3. ”staging_master”: Staging records from Master

    4. ”staging_rejected”: Staging records from Rejected

    5. ”view”: Data Model Relationship View records

    6. ”app”: App bucket

    7. ”golden_cds”: CDS golden records

    8. ”staging_cds”: Staging Intake.

  • vars

    dict Parameters needed to format the storage path. Possible keys:

    1. ”tenant_id”: Tenant ID.

    2. ”connector_id”: Connector ID

    3. ”staging_type”: Staging Name

    4. ”dm_name”: Data model Name

    5. ”relationship_view_name”: Relationship view name

    6. ”app_name”: App name

Returns

formatted path

init_if_needed()[source]

Checks if backend credentials / object is still valid. This method is thread safe by using lock.

Returns

True if backend has been reinitialized, false if it is still valid.