Comparative analysis of HDFS 3 with HDFS 2

In our company, SberTech (Sberbank Technologies) currently uses HDFS ??? because it has a number of advantages, such as the Hadoop ecosystem, fast work with large amounts of data, it is good at analytics and much more. But in December 201? Apache Software Foundation released a new version of the open framework for the development and execution of distributed programs - Hadoop 3.0.? which includes a number of significant improvements over the previous main release line (hadoop-2.x). One of the most important and interesting updates is the support for redundancy codes (Erasure Coding). Therefore...
+ 0 -

RabbitMQ versus Kafka: application of Kafka in event-oriented applications

In the previous article we looked at the templates and topologies used in RabbitMQ. In this part, we turn to Kafka and compare it with RabbitMQ to get some idea of ​​their differences. It should be borne in mind that the architecture of event-oriented applications will be compared rather than data processing pipelines, although the line between these two concepts in this case will be rather blurred. In general, this is more a spectrum than a clear division. Simply, our comparison will be focused on a part of this spectrum associated with event-driven applications.
 
RabbitMQ versus Kafka: application of Kafka in event-oriented applications ...
+ 0 -

A local web server under Linux, with automatic host elevation and switching versions of PHP

Most likely some parts of this article are already familiar to many hobblers, but in connection with the purchase of a new working laptop I decided to collect all the grains together and organize a convenient tool for development. I often have to work with a lot of small projects, with different versions of PHP, often translate old projects into new versions. In the distant past, when I was a Windows user, I used OpenServer. But with the transition to Linux, I lacked the simplicity of creating hosts and switching versions that were in it. Therefore, we had to make an even more convenient solution ...
+ 0 -

Installing the certificate on the HTTP server Apache

Installing the certificate on the HTTP server Apache
 
This article offers step-by-step instructions for installing a certificate on an Apache HTTP server. Note that since Apache version 2.4.? the server configuration parameters have been changed.
 
account GlobalSign by pressing the
button.  
" Edit "To the left of the order number and having copied the certificate in PEM format. .
 
 
The private key for the certificate is created along with the certificate request (CSR), so the private key file can already be on your server. If the private key is lost, then the certificate must be reissued.
 
 
The intermediate certificate that you need ...
+ 0 -

Unity (Unet) - integration with social networks and secure WebSockets

Introduction


 
In this article I want to share my experience of integrating a network application (in my case, games) with social networks. Since I try, if possible, not to resort to third-party solutions, the network part was developed on what offers. Unity3D , namely - Unet using its low-level part ( ? LLAPI ). NetworkClient on the client connects to NetworkServer on the remote server. The game server is also written on Unity3D . Work in such a bundle, although it requires in-depth knowledge Unet , but has its indisputable advantages.
 
 
[h2] Problem ...[/h][/h]
+ 0 -

Apache Kafka: review

Hello, Habr!
 
 
Today we offer you a comparatively brief, but also sensible and informative article about the device and applications of Apache Kafka. We expect to translate and release book Niya Narkhide (Neha Narkhede) et. al until the end of the summer.
 
 
Apache Kafka: review
 
Enjoy reading!
 
Streams API .
 
 
This API is designed to be used within your own code base, it does not work on the broker. Functionally it is similar to the consumer API, facilitates the horizontal scaling of the processing of flows and its distribution between several applications (similar to consumer groups).
 
 
Processing ...
+ 0 -

Apache Ignite: distributed computing in RAM

Apache Ignite: distributed computing in RAM  
 
Hello, Habr!
 
 
We continue to be interested in new solutions from Apache. We expect to release the book in May. «High Performance Spark» Holden Karau (book in layout), and in August - the book "Kafka: The Definitive Guide" Nii Narhid (still in translation). Today we would like to offer a short introduction to Apache Ignite and assess the scope of interest to the topic.
 
 
Enjoy reading!
 
localhost : 8090 /metrics. It not only shows how much time each API method consumes, but it also displays statistics for such indicators as the number of active threads ...
+ 0 -

Install Linux + server (Nginx + Apache) + PostgreSQL + PHP on VirtualBox (Ubuntu Server ??? LTS)

On the Internet, I have not found a single recipe for installing and configuring such a rather non-standard server. I decided to write my own recipe.
 
 
The working principle is as follows:
 
 
Install Linux + server (Nginx + Apache) + PostgreSQL + PHP on VirtualBox (Ubuntu Server ??? LTS)
 
Static data (files) are given by Nginx, and the dynamics is handled by Apache. VirtualBox
 
Ubuntu Server ??? LTS (LTS - Long Time Support)
 
PuTTY
 
 

Install VirtualBox


 
 
Run the VirtualBox installer.
 
 

 
Settings will ...[/h]
+ 0 -

A bunch of Apache PHP MySQL on Solaris 11.3

Introduction
 
 
At the first acquaintance with Solaris, the only drawback for me was the fact that the packages that can be installed are quite obsolete, but fortunately the current versions can be compiled from the source code. This publication will discuss the assembly of apache and php from the source code (mysql can be downloaded as a package from mysql.com). At the time of writing, the current version of apache was ???? and php ???.
 
gcc-48 :
 
 
pkg install gcc-48

 
 
It is also necessary to define some variables for further compilation (the assembly will occur 64-bit versions):
 
 
  <...
+ 0 -