Apache NiFi: what it is and a brief overview of the features

Today, on thematic foreign sites about Big Data, one can find the mention of such a relatively new for the Hadoop ecosystem tool like Apache NiFi. This is a modern open source ETL tool. Distributed architecture for fast parallel loading and processing of data, a large number of plug-ins for sources and transformations, versioning of configurations is only part of its advantages. For all its power, NiFi remains fairly simple to use.
 
 
Apache NiFi: what it is and a brief overview of the features
 
 
At Rostelecom, we are striving to develop work with Hadoop, so we have already tried and evaluated the advantages of Apache NiFi compared to other solutions. In this article ...
+ 0 -

HTTP /2 configuration using the example of Apache 2.? PHP 7 and Ubuntu ??? LTS

I understand that, perhaps, Apache is not currently the preferred choice for launching new projects on it, nevertheless, it exists, and projects are working on it. The choice may fall on it for some personal preferences, for compatibility requirements, or for some other reasons not the essence. In this article I want to describe in points how to configure support for the HTTP /2 protocol on the Apache web server, because I myself use it in such an article 3r334. I need [/s] I needed, and I hope that someone will also need it in practice. 3r3192.  3r3204.
3r3197. 3r3192.  3r3204. What is HTTP /2? ...
+ 0 -

Moscow Apache Ignite Meetup # 5

Hello! 3r340.  
3r340.  
November 1? we invite you to the next meeting of Apache Ignite in Moscow. It will be interesting to architects and developers interested in the open source platform for distributed applications Apache Ignite. 3r340.  
3r340.  
Program 3–3–321. 3r340.  
18:30 - 19:00 - Gathering guests, welcome coffee
 
3r340.  
Reports: 3r3321. 3r340.  
 
Apache performance measurement ignite. As we do benchmarks - Ilya Suntsov (GridGain)
 
Apache Ignite TeamCity Bot: fighting unstable tests in the Open Source community - Dmitry Pavlov (GridGain) and Nikolay Kulagin (Sberbank Technologies) ...
+ 0 -

Apache Ignite + Apache Spark Data Frames:

Apache Ignite + Apache Spark Data Frames:is more fun together.Hi, Habr! My name is Nikolai Izhikov, I work for Sberbank Technology in the development team for Open Source solutions. Behind shoulders 15 years of commercial development in Java. I am an Apache Ignite committer and an Apache Kafka contributor. 3r33440.  3r33440.  Under the cat you will find a video and text version of my report on the Apache Ignite Meetup on how to use Apache Ignite with Apache Spark and what features we have implemented for this. 3r33440.  3r33440.   3r33440.   https://ignite.apache.org/community/resources.html 3r33440.  3r33427.  3r33434. The sources here are https://github.com/apache/ignite/ ...
+ 0 -

Introduction to WSGI Servers: Part One

 3r3406. 3r3-31. This article is a translation of Kevin Goldberg’s “An Introduction to Python WSGI Servers: Part 1” article blog.appdynamics.com/engineering/an-introduction-to-python-wsgi-servers-part-1 with minor additions from the translator 3r33382.  3r3406. 3r33382.  3r3406. Introduction to WSGI Servers: Part One 3r33382.  3r3406. 3r33382.  3r3406. 3r33380. A brief history of servers WSGI Python
3r33382.  3r3406. 3r33394. WSGI [/b] Servers appeared because web servers at that time could not interact with applications written in Python. 3r33394. WSGI [/b] ( Pronounced “whiz-gee” with a solid “g” ) Was developed ...
+ 0 -

Cassandra Sink for Spark Structured Streaming

A couple of months ago, I started exploring Spark, and at some point I was faced with the problem of saving Structured Streaming calculations in the Cassandra database. 3r33333.  
3r33333.  
In this post, I give a simple example of creating and using Cassandra Sink for Spark Structured Streaming. I hope that the post will be useful to those who have recently started working with Spark Structured Streaming and are wondering how to upload the results of calculations to the database. 3r33333.  
3r33333.  
The idea of ​​the application is very simple - to receive and parse messages from the Kafka...
+ 0 -

We invite you to the Mitap for Open Source in September (Moscow and St. Petersburg)

Hello!
 
We invite you to the Mitapi on Free & Open Source, where the speakers will also be the speakers of Sberteha. And read about what we do with FOS, you can here and here .
 
 
We invite you to the Mitap for Open Source in September (Moscow and St. Petersburg)  
Registration and organizational details
 
 
September 11 in Moscow Apache Ignite Moscow Meetup # 4. Let's talk about what's new in the upcoming release and how to make friends with Ignite and Spark.
 
19:00 - 20:00 - What's new in Apache Ignite 2.6 and 2.7 - Artem Shitov, GridGain
 
20:00 - 20:30 - Pizza break
 
20:30 - 21:30 - Ignite + Spark Data Frame. Together happier - Nikolai Izhikov, Senior Manager ...
+ 0 -

The book "Apache Kafka. Stream processing and data analysis »

The book "Apache Kafka. Stream processing and data analysis » When you run any enterprise-application, data is generated: log files, metrics, information about user activity, outgoing messages, and so on. Correct manipulation of all these data is just as important as the data itself. If you are an architect, developer or engineer who wants to solve such problems, but are not familiar with Apache Kafka, it is from this wonderful book that you will learn how to work with this free streaming platform that allows you to process real-time data queues.
 
 

For whom this book is intended


 
"Apache Kafka. Stream processing and data analysis "is written for developers ...[/h]
+ 0 -

Introduction to Maven from Balaji Varnasi and Sudha Belida (translation)

Introduction to Maven from Balaji Varnasi and Sudha Belida (translation) From the translator: A few years ago I set myself the goal to quickly, but rather tightly familiar with such a widely used framework, like Apache Maven . Almost instantly I was able to find the relevant literature, but I was slightly surprised by the fact that all the complex materials were exclusively in English, in Russian there was a lot of scattered articles, but I did not find a full book that could be read from cover to cover managed. As a result, for reading I chose a small book "Introducing Maven" written by Balaji Varnasi and Sudha Belida and released by Apress publishing ...
+ 0 -

Comparative analysis of HDFS 3 with HDFS 2

In our company, SberTech (Sberbank Technologies) currently uses HDFS ??? because it has a number of advantages, such as the Hadoop ecosystem, fast work with large amounts of data, it is good at analytics and much more. But in December 201? Apache Software Foundation released a new version of the open framework for the development and execution of distributed programs - Hadoop 3.0.? which includes a number of significant improvements over the previous main release line (hadoop-2.x). One of the most important and interesting updates is the support for redundancy codes (Erasure Coding). Therefore...
+ 0 -