> For the complete documentation index, see [llms.txt](https://zipline.docs.otised.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://zipline.docs.otised.com/readme.md).

# Introduction

Zipline Cloud is a data management platform for education agencies. It provides end-to-end tooling for ingesting, transforming, validating, and publishing education data across districts, states, and other reporting entities.

## What Zipline Does

**Data Pipelines** — Define routes (ordered sequences of steps) that extract data from source systems, apply SQL transformations, and load results into target tables. Execute pipelines on demand or on a schedule via automation rules.

**Logical and Physical Models** — Maintain logical models that describe the expected shape of your data (tables, columns, types). Connect physical models to live databases to discover schemas. Compare models, generate migration SQL, and take point-in-time snapshots for versioning.

**Agency and System Management** — Configure agencies (school districts, states) and their source systems. Set up data pumps, data receivers, and file-based transfers to move data between systems.

**Data Quality** — Apply validation rules to catch errors during pipeline execution. Review discard statistics, execution logs, and debug logs to diagnose issues. Use record linking to resolve duplicate identities across datasets.

**Data Governance** — Redact sensitive fields, enforce retention policies, track data lineage from source to destination, and integrate with Microsoft Purview for cataloging.

**Course Catalog** — Manage a catalog of course definitions with a request-and-approval workflow for proposing new courses or changes.

**Administration** — Multi-tenant architecture supports hosting multiple agencies on a single deployment. Copy user configurations between tenants, manage environment settings, monitor background jobs, and configure manifests for data submissions.

## Technology Stack

| Layer           | Technology                                                                  |
| --------------- | --------------------------------------------------------------------------- |
| Backend         | ASP.NET Core 10.0, ABP Framework 10.0.2                                     |
| Frontend        | Angular 20                                                                  |
| Database        | SQL Server 2022+                                                            |
| Background Jobs | Hangfire                                                                    |
| Cloud Services  | Azure Blob Storage, Azure Storage Queues, Azure Data Factory, Azure Purview |

***

Browse the documentation using the sidebar navigation.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://zipline.docs.otised.com/readme.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
