This action will force synchronization from StreamxHub/StreamX, which will overwrite any changes that you have made since you forked the repository, and can not be recovered!!!
Synchronous operation will process in the background and will refresh the page when finishing processing. Please be patient.
English | 中文
Make Flink|Spark easier
A magical framework that makes Flink development easier
The original intention of
StreamX is to make the development of
StreamX focuses on the management of
development phases and tasks. Our ultimate goal is to build a one-stop big data solution integrating stream processing,
batch processing, data warehouse and data laker.
savepoint, resume from
Streamx consists of three parts,
streamx-core is a framework that focuses on coding, standardizes configuration, and develops in a way that is better
than configuration by convention. Also it provides a development-time
RunTime Content and a series of
of the box. At the same time, it extends
DataStream some methods, and integrates
Flink sql api to
simplify tedious operations, focus on the business itself, and improve development efficiency and development
streamx-pump is a planned data extraction component, similar to
flinkx. Based on the various
streamx-core, the purpose is to create a convenient, fast, out-of-the-box real-time data extraction and migration
component for big data, and it will be integrated into the
streamx-console is a stream processing and
Low Code platform, capable of managing
Flink tasks, integrating project
compilation, deploy, configuration, startup,
Flink SQL, monitoring and many other
features. Simplify the daily operation and maintenance of the
Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse and data laker.
Thanks to the above excellent open source projects and many outstanding open source projects that are not mentioned, for giving the greatest respect, special thanks to Apache Zeppelin , IntelliJ IDEA, Thanks to the fire-spark project for the early inspiration and help.
git clone https://github.com/streamxhub/streamx.git cd Streamx mvn clean install -DskipTests -Denv=prod
click Document for more information
Apache Zeppelin is a Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Java, Scala and more.
At the same time we also need a one-stop tool that can cover
streamx-console solves these pain points very well, positioning is a one-stop stream processing platform, and has
developed more exciting features (such as
Flink SQL WebIDE,
task rollback ,
FlinkX is a distributed offline and real-time data synchronization framework based on flink widely used in DTStack, which realizes efficient data migration between multiple heterogeneous data sources.
StreamX focuses on the management of development phases and tasks. The
streamx-pump module is also under planning,
dedicated to solving data source migration, and will eventually be integrated into the
You can quickly submit an issue. Before submitting, please check the problem and try to use the following contact information! Maybe your question has already been asked by others, or it has already been answered. Thank you!
You can contact us or ask questions via:
Are you enjoying this project ? 👋
If you like this framework, and appreciate the work done for it to exist, you can still support the developers by donating ☀️ 👊
Welcome individuals and enterprises to sponsor, your support will help us better develop the project
Thank you to all our backers!
StreamX enters the high-speed development stage, we need your contribution.