Open Source Development & DevOps Software
Apache Flume
Apache Flume is a free and open source, distributed software for efficiently collecting, aggregating, and moving large amounts of log data. With Apache Flume you can create data pipelines for you log data with a simple and flexible architecture based on streaming data flows. Apache Flume uses a simple extensible data model that allows you to create online analytic applications that are fault tolerant and reliable with many failover and recovery mechanisms.
Apache Spark
Apache Spark is a free and open-source, unified analytics engine for large-scale data processing. Apache Spark achieves high performance for both batch and streaming data, using a state-of-the-art DAG scheduler, a query optimizer, and a physical execution engine. With Apache Spark, you can write application quickly in Java, Scala, Python, R, and SQL. Spark also offers over 80 high-level operators that make it easy to build parallel apps. You can run Apache Spark anywhere, as a standalone product, in the cloud or on Hadoop, Apache Mesos or Kubernetes.
OpenStack
OpenStack is an IaaS (Infrastructure-as-a-Service) and cloud computing platform developed by the OpenStack Foundation. The project was first started in 2010 as a joint venture by Rackspace Hosting and NASA. OpenStack both free and open-source and allows you to create public or private clouds with distributed virtual servers. The OpenStack dashboard can be used by administrators of the cloud to empower user, provision resources and track the overall health of the network and infrastructure.
Tornado
A free and open-source web framework and asynchronous networking library written in Python. Tornado was originally developed at FriendFeed, and is using a non-blocking network I/O that can be used to scale applications to tens of thousands of concurrent connection. Tornado is a great framework for applications that require long-lived connections between users, and for WebSockets or long polling.
MemSQL
MemSQL is a free and open-source all-in-one relation database management system. The database lends itself for operational analytics and AI/ML-powered applications that requires fast data ingest, high performance queries and elastic scaling. MemSQL supports ANSI SQL and blended workloads, commonly referred to as translytical, HTAP, HOAP, and ATP workloads. The developer MemSQL Inc, also provides commercially hosted version of the database called MemSQL Helios, a cloud database-as-a-service.
Apache Kafka
Trusted by more than 80% of all Fortune 100 companies. Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. The software is used for both real-time and batch data processing, and is the chosen event log technology for Amadeus microservice-based streaming applications. Apache Kafka is also used for operational use cases such as application and service logs collection.
Clojure
A modern, dynamic, and functional dialect of the Lisp and programming language that targets the JVM (Java Virtual Machine). Clojure is a compiled language, yet remains completely dynamic as it combines the approachability and interactive development of a scripting language with an efficient and robust infrastructure for multithreaded programming. The development of Clojure is completely community-driven, while being overseen by its creator Rich Hickey.
TypeScript
TypeScript is a free and open-source programming language created by Microsoft. The language is a strict syntactical superset of JavaScript and redefines the way developer writes JavaScript-based web applications and software by adding optional static typing in the mix. TypeScript is designed specifically for development of large-scale applications with a need to transcompile into JavaScript.
Ansible
Ansible is an open-source software provisioning, configuration management, and application-deployment tool. With Ansible you can streamline your deployment process, allowing you to roll out enterprise scale applications with the bush of a button or a command via the terminal. Ansible itself is written in Python and has a minimal learning curve, allowing you to build simple setup procedures that can manage all of your CI/CD needs.
