Apache NiFi Alternatives

Apache Flume is a free and open source, distributed software for efficiently collecting, aggregating, and moving large amounts of log data. With Apache Flume you can create data pipelines for you log data with a simple and flexible architecture based on streaming data flows. Apache Flume uses a simple extensible data model that allows you to create online analytic applications that are fault tolerant and reliable with many failover and recovery mechanisms.

With RabbitMQ your applications gets a common platform to send and receive messages, and your messages a safe place to live until received. Allowing your application to handle long-running or blocking tasks, and respond quickly to requests instead of being forced to perform computationally intensive tasks on the spot. The software is developed and released as open-source and is currently the most widley used free and open-source message-broker. Commercial, enterprise releases of RabbitMQ is also avalible for a subscription fee.

Apache Spark is a free and open-source, unified analytics engine for large-scale data processing. Apache Spark achieves high performance for both batch and streaming data, using a state-of-the-art DAG scheduler, a query optimizer, and a physical execution engine. With Apache Spark, you can write application quickly in Java, Scala, Python, R, and SQL. Spark also offers over 80 high-level operators that make it easy to build parallel apps. You can run Apache Spark anywhere, as a standalone product, in the cloud or on Hadoop, Apache Mesos or Kubernetes.

Trusted by more than 80% of all Fortune 100 companies. Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. The software is used for both real-time and batch data processing, and is the chosen event log technology for Amadeus microservice-based streaming applications. Apache Kafka is also used for operational use cases such as application and service logs collection.

Rundeck is an open source automation service with a web console, command line tools and a WebAPI. With Rundeck you easily run automation tasks across a set of nodes. Rundeck is avalible as two versions, Rundeck Community and Rundeck Enterprise, where the first mentiond is built for small teams. It addresses the technical complexity of Runbook Automation for solving non-production self-service. The later is aimed at teams and organizations at scale. It addresses the organizational complexity of teams and multiple clusters with self-service, incident response, and compliance and auditing features.

With Zapier you can connect apps and automate your workflows. Zapier is an automation service that let's you link third-party web applications together so they can share data and events with each other. These workflow events are called Zaps and can be used to build process and automation chains, so that you can get more done.

Apache Storm makes it easy to reliably process unbounded streams of data for real-time processing. It is a distributed stream processing computation framework written predominantly in the programming language Clojure. The software is released free and open-source under the Apache License. In a nutshell, Apache Storm does to real-time processing, what Apache Hadoop did to bactch processing. Large corporations like Weather Channel, FullContact, Twitter, Yahoo, Spotify, and Alibaba use and trust Apache Storm for big data analytics with fault-tolerance and fast data processing.

Apache Airflow is a community created workflow management platform. The software is both free and open-source, and can be used to reduce complexity in organizations workflow. Apache Airflow is modular by nature, and has an architecture that makes it easy to customize to organizations specific needs. The software was was first developed at Airbnb to where it was used to programmatically author and schedule their workflows, allowing the organization to monitor them via the built-in Airflow dashboard.

Apache Flink is a free and open-source stream framework used for processing big data. The software is developed openly by the Apache Software Foundation and the community. The core of Apache Flink is written in Java and Scala as a distributed streaming data-flow engine. Data-flows executed by Flink programs are pipelined and run parallel to maximize efficiency.

Apache Camel is an open-source integration framework that empowers you to quickly and easily integrate various systems consuming or producing data.