Distributed applications in C ++ with a minimum of effort

The purpose of my post is to tell you about the C ++ API of the distributed database Apache Ignite, which is called Ignite C ++, as well as its features.
 
About the very Apache Ignite on the habr have written more than once, so for sure some of you already roughly represent what it is and why you need it.
 

Briefly about Apache Ignite for those who are not familiar with it yet


 
I will not go into details about how Apache Ignite appeared and how it differs from classical databases. All these questions have already been raised here ...[/h]
+ 0 -

We collect InnoDB cluster from mysql 5.7 on centos 7

Hello!
 
 
Once there was a task on the job - there is a kind of configured test innoDB cluster on several virtualos with centos 7.? it is necessary to learn it and add a couple more nodes. You can break and scoff anything. It sounds tempting.
 
article on Habré . It seems like it was configured for a cluster of two nodes.
 
 
Well, I read the article, I was somewhat surprised at the difficulty of adding nodes and the lack of many details, but oh well. I added a new node with a sin in half (part of the commands did not come in handy, some of them broke everything), then I started experimenting ...
+ 0 -

Expand the LINSTOR store for Proxmox

Expand the LINSTOR store for Proxmox
 
LINBIT recently released their new solution for orchestrating and managing multiple DRBD arrays.
 
For example, you can have several nodes and each will have its own LVM or ZFS pool in which LINSTOR will automatically create new volumes and replicate them between nodes using the DRBD protocol.
 
LINSTOR supports thin-provisioning, snapshots and many other interesting things.
 
This solution is well suited for virtual machines and containers.
 
LINSTOR Satellites
 
I believe that you already have a Proxmox cluster, I have three nodes pve1 , pve2 and pve3 ...
+ 0 -

Bonding and SSH server in initramfs

Bonding and SSH server in initramfs
 
Every system is a compromise between security and ease of use.
 
In the built NAS , there was a serious problem: you could not reboot the system without being present, which lowered the level of data availability.
 
This problem was not critical, until the emergency power outage began: for three months two times for several hours. The UPS is designed for short-term failures and it is not supposed to work from batteries for more than half an hour (although it's really about an hour), and with each such shutdown, to go back on the system, you had to travel to another city.
...
+ 0 -

List of articles and literature about NAS

List of articles and literature about NAS
 
Within the framework of a series of articles on building a NAS, or a home server , at the request of of the users I google for you and made a short review of information sources.
 
This article contains links to most of the materials I have used. As the accumulation and processing of materials, there may be something new.
"Introduction to storage systems" 201? will allow you to determine the terminology.
 
For general development on storage it is possible to read article "Working with Neznayka - technology of anticipatory reading ...
+ 0 -

Reliable storage with DRBD9 and Proxmox (Part 2: iSCSI + LVM)

Reliable storage with DRBD9 and Proxmox (Part 2: iSCSI + LVM)
 
In the previous article I considered the possibility of creating a failover NFS server using DRBD and Proxmox. It turned out pretty good, but we will not stop there and now we will try to "squeeze out all the juices" from our store.
 
In this article I will describe how to create a fault-tolerant iSCSI-target in a similar way, which we will cut into small pieces using LVM and use it for virtual machines.
 
This approach will reduce the load and increase the speed of data access several times, this is especially advantageous when you do not need competitive access to data, for example, when you need ...
+ 0 -

Theory and practice of using HBase

Theory and practice of using HBaseGood afternoon! My name is Danil Lipova, our team at Sbertech started using HBase as a data warehouse. In the course of his study, experience accumulated, which he wanted to systematize and describe (we hope that many will be useful). All the experiments below were carried out with versions of HBase ???-cdh??? and ???-cdh???-beta1.
 
 
 
General architecture
 
Write data to HBASE
 
Reading data from HBASE
 
Caching of the data
 
Batch processing of MultiGet /MultiPut data
 
Strategy for breaking tables into regions (spiliting)
 
Fault Tolerance, Compactification and Locality of Data
 
Settings ...
+ 0 -

From the loaded MPP DBMS - a vigorous Data Lake with analytical tools: we share the details of creating

All organizations that have anything to do with data, sooner or later, face the issue of storing relational and unstructured databases. It is not easy to find simultaneously convenient, effective and inexpensive approach to this problem. And to make it so that the data can successfully work with date-sentientists with models of machine learning. We did - and although we had to tinker, the final profit was even more than expected. We will describe all the details below.
 
 
From the loaded MPP DBMS - a vigorous Data Lake with analytical tools: we share the details of creating  
Parquet . [/i] For analytical problems, so-called wide tables with many columns ...
+ 0 -

Test performance of several types of drives in a virtual environment

Test performance of several types of drives in a virtual environmentTechnologies of virtualization are in demand today not only in the segment of "big business", but also in SMB and home users. In particular, for small server companies, virtualization can be used to implement a number of not very resource-intensive services. In this case, it usually refers to stand-alone servers based on single- or dual-processor platforms, with a relatively small amount of RAM in 32-64 GB and without special high-performance storage. But for all the benefits, you need to be aware that in terms of performance, virtual systems are different from real ones. In this article, we compare ...
+ 0 -

Testing of caching technology for RAID arrays Adaptec

Testing of caching technology for RAID arrays AdaptecSolutions for working with RAID arrays from hard drives have been used for a long time. In general, they continue to be popular in many areas, when a relatively inexpensive, fault-tolerant, large-capacity array is required. Given the size of modern hard drives, their speed, as well as other reasons, the greatest practical interest is arrays of RAID6 (or RAID6? if there are many disks). But this type of arrays has a low performance on random writes and it's not easy to do anything with it.
 
 
Of course, in this case we are talking about the speed of the "raw volume". In real life, it is added to ...
+ 0 -