Taier

<div align="center"> <a href="https://dtstack.github.io/Taier/" target="_blank" rel="noopener noreferrer"> <img src="website/static/img/logo.svg" width="20%" height="20%" alt="Taier Logo" /> </a> <h1>Taier</h1> <h3>A distributed dispatching system</h3> </div> <p align="center"> <img src="https://img.shields.io/github/release/Dtstack/Taier.svg"> <img src="https://img.shields.io/github/stars/Dtstack/Taier"> <img src="https://img.shields.io/github/forks/Dtstack/Taier"> <a href="https://www.apache.org/licenses/LICENSE-2.0.html"> <img src="https://img.shields.io/badge/license-Apache%202-4EB1BA.svg"> </a> <p align="center"> <a href="https://dtstack.github.io/Taier/">Office Website</a> | <a href="https://dtstack.github.io/Taier/docs/guides/introduction/">Document</a> </p> </p>

中文 | English

Introduction

Taier , spelling in chinese is 太阿, is one of the ancient chinese celebrated swords.

Taier is distributed dispatching system that focus on different tasks submitted and scheduled. It's aimed at reducing the ETL's cost, making the complex dependencies between tasks clearly and reducing the labor cost about submitting, scheduling and O&M.

It's unnecessary to concern about the complex dependencies between tasks and the underlying architecture about the big data platform at Taier, so that you can pay more attention into business.

Taier provide an one-stop big data platform for submitting tasks, scheduling tasks, O&M, presentation about indicators.

The core features for Taier are as follows:

• Easy to distributed extend
• Visualization config for DAG
• With an IDE development platform designed for big-data users
• Supports to develop your own plugins
• Multiply task modes including guide mode and script mode
• Supports to the dependencies between upstream/downstream tasks
• Supports batch and stream tasks
• Integrates various different versions of Hadoop
• Easy to integrate Flink Standalone
• Completely safe and non-intrusive to the cluster's environment
• Isolation by tenants and clusters
• Supports kerberos authentication
• Different versions for tasks
• Supports user-defined parameters for task
• Real-time monitoring about cluster's resources
• Real-time presented about data indicators
• Restrict the task's resource

Architecture

Quick start

In Docker

shellCopy
$ wget https://raw.githubusercontent.com/DTStack/Taier/master/docker-compose.yml
$ docker-compose up -d

Online Preview

Develop Tasks

Tasks

Tasks	Documentation
Work Flow	Documentation
Data Sync	Documentation
Data Acquisition	Documentation
Flink	Documentation
Shell	Documentation
Python	Documentation
Spark SQL	Documentation
Hive SQL	Documentation
Flink SQL	Documentation
OceanBase SQL	Documentation
ClickHouse SQL	Documentation
Doris SQL	Documentation
TiDB SQL	Documentation
MySQL SQL	Documentation
Vertica SQL	Documentation
Postgre SQL	Documentation
SqlServer SQL	Documentation
Greenplum SQL	Documentation
MaxCompute SQL	Documentation
GaussDB SQL	Documentation
DataX	Documentation
User-defined Task	Documentation

Questions

FAQ Reference For questions, bugs and supports please open an issue, we'll reply you in time.

Stay in touch

• Slack https://join.slack.com/t/slack-p437975/shared_invite/zt-1iw5x1fw7-A6rVolqjP2z8V09~WwFUiA

Contribution

Please make sure to read the Contributing Guide before making a pull request.

Contributor

<a href="https://github.com/Dtstack/Taier/graphs/contributors"> <img src="https://contrib.rocks/image?repo=Dtstack/Taier" /> </a>

License

Taier is under the Apache 2.0 license. See the LICENSE file for
details.