Skip to main content

Introduction

Insight Factory is a Data & AI platform for building, deploying, and operating data pipelines and AI solutions. The platform runs in your Azure tenant, using Databricks, Azure services, and AI frameworks.

Use Insight Factory to ingest data from various sources, transform it using Databricks notebooks, build AI and ML models, and manage the full lifecycle of your solutions.

This documentation covers the platform's core components and how to use them.

Build​

Create tasks to run units of work. Group tasks into production lines to visualise, schedule, and deploy them together.

Key components:

  • Tasks — Individual units of work (ingest data, run notebooks, refresh reports)
  • Production Lines — Sequences of tasks that run together
  • Solutions — A collection of production lines that form a solution (or project)
  • Task Groups — Share configuration across related tasks
  • Configuration — Centralised settings referenced across your environment

Deploy​

Move production lines between Development, Test, and Production environments. Deployments include tasks, configuration, and associated Databricks notebooks.

The deployment workflow requires approval before changes are applied to target environments.

Operate​

Monitor and manage your running pipelines:

  • Pulse Health — View run history and current status
  • Pulse Optimise — Analyse execution times and identify bottlenecks