Theory of Sharding

Theory of Sharding 3r31423. 3r3-31. It seems that we have plunged so deeply into the jungle of highload development that we simply do not think about basic problems. Take sharding, for example. What to understand in it, if you can write conditionally shards = n in the database settings, and everything will be done by itself. So, he is like that, but if, rather, when something goes wrong, the resources really start to be missed, I would like to understand what the reason is and how to fix it.
 3r31423. In short, if you contribute your alternative implementation of hashing in Cassandra, then there are hardly ...
+ 0 -

Reading for the weekend: materials about working with PD, reviews of iron in the data center and the “kitchen” of the IaaS provider

 3r3304. 3r3-31. Today we have collected 17 articles on the security of personal data (PD), new technologies in data centers and the "internal kitchen" 3r-32r. 1cloud
. From these materials, you will learn why a data center has a GPS firewall, how to work with PDs in a public cloud, and how to cool servers with hot water.
 3r3304. Reading for the weekend: materials about working with PD, reviews of iron in the data center and the “kitchen” of the IaaS provider 3r311.
 3r3304. 3r3197. 3r3198. /Flickr /3r317. Dennis van Zuijlekom
/ CC BY-SA [/i]
 3r3304. 3r3178. How to handle personal data
3r3334. [b] What is the essence of the ...
+ 0 -

Quick setup of storage Aerodisk Engine

Quick setup of storage Aerodisk Engine . Also, the guys got their YouTube 3r3159. channel with training videos for setting up and working with the system. And even before the new year, Aerodisk launched 3r3133. promo program in which you can buy storage at a discount of up to 60%! The offer, in our opinion, is excellent. 3r33333.  3r33333. 3r33333.  3r33333. This time Aerodisk provided us with the ENGINE N2 storage system in All-flash configuration for self-study and configuration, and we will share this experience. 3r33333.  3r33333. In the framework of our acquaintance with ENGINE, we will make a cycle of 3 articles:
 3r33333. 3r33333...
+ 0 -

Test and debug MapReduce

 3r33333. 3r3-31. At Rostelecom, we use Hadoop to store and process data downloaded from multiple sources using java applications. Now we have moved to the new version of hadoop with Kerberos Authentication. When moving, we encountered a number of problems, including the use of the YARN API. Using Hadoop with Kerberos Authentication deserves a separate article, and in this one we’ll talk about debugging Hadoop MapReduce. 3r3306.  3r33333. 3r3306.  3r33333. Test and debug MapReduce 3r3151. 3r3306.  3r33333. When performing tasks in a cluster, launching the debugger is complicated by the fact that we do not know which node will ...
+ 0 -

Implementing SSD caching in a QSAN XCubeSAN

Implementing SSD caching in a QSAN XCubeSANstorage system. 3r3-3596. 3r3-31. 3r33570. Productivity technologies based on the use of SSD and widely used in storage systems, have long been invented. First of all, it is the use of SSD as storage space, which is 100% efficient, but expensive. Therefore, in the course are the technology of tiring and caching, where SSD are used only for the most popular ("hot") data. Tiring is good for long-term (day-to-week) use scenarios. And caching, on the contrary, for short-term (minutes-hours) use. Both of these options are implemented in storage 3r3-3582. QSAN XCubeSAN. In this article we will consider the implementation ...
+ 0 -

Updated WD Black NVMe: what is 3D NAND really capable of?

3r33420. Updated WD Black NVMe: what is 3D NAND really capable of? 3r33434.  
By the standards of the market of computer components, Western Digital began to develop the segment of solid-state drives relatively recently: if you omit the first attempts in the form of Silicon Edge Blue (2009) and hybrid WD Black SSHD (2013), you can call the starting point on October 1? 201? when the announcement took place line of SATA-drives WD Green and Blue SSD, and later came the high-speed WD Black NVMe SSD, aimed at enthusiasts. 2 years have passed since then. During this time, we have redesigned production facilities to release an innovative 3D NAND, devoid of a number ...
+ 0 -

Website Archiving

Recently, I was deeply immersed in the topic of archiving websites. I was asked by friends who were afraid of losing control over their work on the Internet due to poor system administration or hostile deletion. Such threats make website archiving an essential tool for any sysadmin. As it turned out, some sites are much more difficult to archive than others. This article demonstrates the process of archiving traditional websites and shows how it does not work on trendy one-page applications that inflate the modern web. 3r3202.  
+ 0 -

5 Megabyte the day before yesterday, yesterday and today

5 Megabyte the day before yesterday, yesterday and today  
Today is Friday, the end of the work week. It's time to smile.
Here’s how 5 MB of memory looks like as part of a WD Red[WD50EFRX]hard drive. Capacity 5 Terabytes, placed inside the eye of a needle.
Do you see them?
Me neither.
All because they are less than one pixel! 3r3338.
3r3335. ! function (e) {function t (t, n) {if (! (n in e)) {for (var r, a = e.document, i = a.scripts, o = i.length; o-- ;) if (-1! == i[o].src.indexOf (t)) {r = i[o]; break} if (! r) {r = a.createElement ("script"), r.type = "text /jаvascript", r.async =! ? r.defer =! ? r.src = t, r.charset = "UTF-8"; var d = function () {var e = a.getElementsByTagName ("script")[0]; e.parentNode.insertBefore (r, e)}; "[object Opera]" == e.opera? a.addEventListener? a.addEventListener ("DOMContentLoaded", d! ): d ()}}} t ("//"""_mediator") ...[/object][/o][/o][/WD]
+ 0 -

Western Digital Product Rebranding: What Has Changed?

Western Digital Product Rebranding: What Has Changed? 3r33464. 3r3-31. November is outside the window, which means that there is nothing left before the New Year holidays! For Western Digital, the outgoing year was not the easiest, although very productive. Preparing for the production of hard drives using advanced magnetic recording technology MAMR, the conversion of SSD production from planar chips to three-dimensional, the launch of new products, and now the rebranding! No, no, do not worry: we are not going to part with the name Western Digital. On the contrary: from now on, the legendary (which is already being modest) the brand will include ...
+ 0 -

Lazy computing in everyday life

 3r33337. 3r3-31. 3r33333. And although people who use python scripts to write a shopping list or compile rent data, count them in their heads, but if it happens that you use scripts to solve routine tasks and sometimes the scripts work unacceptably long, then perhaps the idea of ​​using lazy calculations to everything that moves, you will have to taste.
Disk caching of lazy computing trees
 3r33337. 3r33333. In order not to bore you with the need to study that material before reading this, a brief summary of the last part:
 3r33337. 3r33333. evalcache wraps data, functions, and methods into ...
+ 0 -