Distributed data warehouse in the concept of Data Lake: installation CDH

We continue to share our experience in organizing the data warehouse, which we began to talk about in previous post . This time we want to talk about how we solved the tasks of installing CDH.
 
 
Distributed data warehouse in the concept of Data Lake: installation CDH  
) Www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html ). In this case, you need to download the Spark 2 CSD file (available on the Version and Packaging Information page - cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html ), Install it on the host with Cloudera ...
+ 0 -

Seminar "Virtual infrastructure for developers: opportunities, applications and services", June 2? St. Petersburg

Seminar "Virtual infrastructure for developers: opportunities, applications and services", June 2? St. Petersburg
 
 
Hello, Habr! We close the DataLine Universities season with a seminar in St. Petersburg .
 
 
28 June We are waiting for you at the seminar "Virtual infrastructure for developers: capabilities, applications and services" . Let's talk about how the cloud infrastructure and services can be useful for developers. Consider examples of deploying test environments and working with containers and applications.
 
 
There are only a few places left, ...
+ 0 -

Analysis of blockage, or why the mixer broke?

Based on the materials of my report at the conference "Digital Transformation" in Moscow on April 1? 201?
 
I'm interested in how the blockade works. Not only what are the algorithms, cryptography, platforms and crypto-currencies. For me, blockade is not only a technology, but also a new kind of life, a new universe. If you doubt this, take a look at this Aragon tokens sales graph:
 
Analysis of blockage, or why the mixer broke?
 
All these addresses, smart contracts, tokens constantly interact with each other, and behind them stand the actions of people, organizations and robots. Without this interaction, the blocking and crypto-currencies would ...
+ 0 -

Fujitsu fi-4750C in Windows 10 through Adaptec 78xx SCSI

Fujitsu fi-4750C in Windows 10 through Adaptec 78xx SCSIThe story may seem trivial and look only as an example of a successful use of the search engine. However, it contains a working solution, found through a long selection of working options, and I hope to help someone put into operation the iron that collects in the warehouse.
 
unofficial drivers 64 bit on the site http://r-massive.cellarseer.com (unfortunately, the site is silent about the history of their creation), which should have been guaranteed to start in Windows 8.? and as practice also showed in Windows 10.
 
For installation, it was necessary to disable signature verification ...
+ 0 -

Abstract of the book Practical Guide to Testing in DevOps, Katrina Clokie

The book tells how to build a test to not just catch bugs, but to avoid their appearance. We liked it very much, so we decided to support the tradition of the abstracts on Habré on the rights of the old-timers and lay out the most interesting theses.
 
 
Abstract of the book Practical Guide to Testing in DevOps, Katrina Clokie  
- here the author explains why these items are highlighted and what they are important.
 
 

Practice of cooperation in DevOps


 
The more people communicate, the more they understand what their colleagues are doing and how they can be helped. Therefore, Katrina suggests that they discuss testing more often. This can be done in several ways:
 
 
 
Review ch...[/h]
+ 0 -

Where is his button ?! As a simple person to download data from Kibana and Elasticsearch and do not strain the developers

Where is his button ?! As a simple person to download data from Kibana and Elasticsearch and do not strain the developersElasticsearch, Kibana and Logstash (ELK) are an excellent set of tools for collecting and visualizing large amounts of data.
 
 
Logs, logs, events - all of this is quite easy to gather, map and displayed in a single tool. Logstash stores data, Elasticsearch stores it, and Kibana displays it in graphical form.
 
 
With all the power of this bundle, of course, there are tasks that can not be realized through the built-in capabilities.
 
 
For example, Kibana perfectly displays data within a single table (index), but as soon as it comes to combining different indexes into one sample, it helplessly ...
+ 0 -

100500 ways of caching in Oracle Database

100500 ways of caching in Oracle DatabaseTelling what caches are, what a Result Cache is, how it is made in Oracle and in other databases is not very interesting and rather patterned. But everything gets completely different colors when it comes to specific examples.
Alexander Tokarev
( Shtock ) Built his report on Highload ++ 2017 on the basis of cases. And it was based on the cases, he told me when the home-made cache can be handy, what the pain of the server-side Result Cache is and how to replace it with the client, and in general brought up a number of useful tips for setting up Result Cache in Oracle.
 
 
+ 0 -

How to make friends of all operators in the stadium and not sow it with hundreds of

How to make friends of all operators in the stadium and not sow it with hundreds ofantennas.The FIFA World Cup has already begun, and in this regard, in several arenas of the championship, we deployed our new infrastructure. One of the arenas - "St. Petersburg", home stadium FC "Zenith". In this post we will talk about how the connection is made on one of the main venues of the tournament, where we hide the antennas, and why our engineers go four thousand steps before each match (if not more often).     material on how to monitor the mobile network in Moscow ...
+ 0 -

Release of the unofficial MTProto proxy in Python, features protocol

Release of the unofficial MTProto proxy in Python, features protocol

 
Recently, Telegram developers have laid out the source of a proxy server that uses the MTProto protocol. On the hub came out articles about features of its assembly and repackaging the container docker with it . The official proxy server, written in C, surprises with the amount of code - about 23 thousand lines. At the same time, and sometimes a little earlier, several alternative implementations came out, but none of them supported the possibility of advertising their channel.
 
 
In this article I would like to tell you about the little-known peculiarities of the proxy server communication ...
+ 0 -

Development of TELNET-server based on W5500 and ATMEGA8

Development of TELNET-server based on W5500 and ATMEGA8Recently, the hardware and software complex Arduino has become very popular, which is designed to develop various interesting electronic designs. The constructions are made by connecting the Arduino baseplate with additional necessary modules. On the Arduino baseboard is a microcontroller, the firmware for which is written in a special development environment for Arduino, using, as a rule, ready-made libraries for a particular module.
 
 
One of the modules - W5500 - is designed for the manufacture of electronic structures that will be connected to the Internet. In this case, most often, it means ...
+ 0 -