|
Job |
Description |
|
APPLY COLLECTION INSTANCE RULES |
Applies rule‑based linking as defined in the Linking Rules under the Collection settings. Run this job to update all collection links after a linking rule change. |
|
CROSS SOURCE LINKING |
Matches and links related assets across multiple source systems. Creates unified entity views by resolving duplicates, aligning identifiers, and establishing cross‑system relationships. |
|
DAILY |
Executes routine daily processing tasks such as lineage changes, usage statistics and non real time index updates |
|
DATABASE OPTIMISATION |
Performs automated database tuning tasks including statistics updates, index maintenance, and storage cleanup. Improves query performance and overall platform stability. |
|
GATHER METRICS AND STATS |
Updates platform statistics such as usage and load frequency |
|
HIGHLY FREQUENT |
Runs high‑frequency micro‑jobs that process incremental updates or event‑driven changes such as new feed updates. |
|
INDEX REBUILD |
Rebuilds search index after significant changes such as upgrades or major platform maintenance |
|
INDEX UPDATE |
Updates the search index for any non-real time changes. |
|
INTRA DAY |
Executes multiple times throughout the day to refresh asset details |
|
OBJECT COLLAPSE |
Consolidates duplicate and redundant assets |
|
OBJECT PURGE |
Removes expired, obsolete, or superseded assets based on the retention period set |
|
SCORE UPDATE OR REFRESH |
Recalculates or refreshes platform scores such as trust score. |
|
SOURCE LOAD |
Load metadata and log data from sources into the platform. Handles file processing, schema validation, and log loads into K. After a source is load, the Daily job is required to see the results in platform. |
|
SUMMARY TABLE REFRESH |
Regenerates summary or aggregate tables used for platform stats. |
|
SYNC SOLR |
Synchronises platform data with a Solr search index. Updates indexed documents to maintain search accuracy and relevance. |
|
WATCHER |
Monitors data pipelines, system health, or specific datasets for anomalies or threshold breaches. Triggers alerts or follow‑up actions when conditions are met. |
|
WEEKLY |
Runs weekly scheduled tasks such as full reconciliations, data clean up and platform maintenance. |