• Guest
HabraHabr
  • Main
  • Users

  • Development
    • Programming
    • Information Security
    • Website development
    • JavaScript
    • Game development
    • Open source
    • Developed for Android
    • Machine learning
    • Abnormal programming
    • Java
    • Python
    • Development of mobile applications
    • Analysis and design of systems
    • .NET
    • Mathematics
    • Algorithms
    • C#
    • System Programming
    • C++
    • C
    • Go
    • PHP
    • Reverse engineering
    • Assembler
    • Development under Linux
    • Big Data
    • Rust
    • Cryptography
    • Entertaining problems
    • Testing of IT systems
    • Testing Web Services
    • HTML
    • Programming microcontrollers
    • API
    • High performance
    • Developed for iOS
    • CSS
    • Industrial Programming
    • Development under Windows
    • Image processing
    • Compilers
    • FPGA
    • Professional literature
    • OpenStreetMap
    • Google Chrome
    • Data Mining
    • PostgreSQL
    • Development of robotics
    • Visualization of data
    • Angular
    • ReactJS
    • Search technologies
    • Debugging
    • Test mobile applications
    • Browsers
    • Designing and refactoring
    • IT Standards
    • Solidity
    • Node.JS
    • Git
    • LaTeX
    • SQL
    • Haskell
    • Unreal Engine
    • Unity3D
    • Development for the Internet of things
    • Functional Programming
    • Amazon Web Services
    • Google Cloud Platform
    • Development under AR and VR
    • Assembly systems
    • Version control systems
    • Kotlin
    • R
    • CAD/CAM
    • Customer Optimization
    • Development of communication systems
    • Microsoft Azure
    • Perfect code
    • Atlassian
    • Visual Studio
    • NoSQL
    • Yii
    • Mono и Moonlight
    • Parallel Programming
    • Asterisk
    • Yandex API
    • WordPress
    • Sports programming
    • Lua
    • Microsoft SQL Server
    • Payment systems
    • TypeScript
    • Scala
    • Google API
    • Development of data transmission systems
    • XML
    • Regular expressions
    • Development under Tizen
    • Swift
    • MySQL
    • Geoinformation services
    • Global Positioning Systems
    • Qt
    • Dart
    • Django
    • Development for Office 365
    • Erlang/OTP
    • GPGPU
    • Eclipse
    • Maps API
    • Testing games
    • Browser Extensions
    • 1C-Bitrix
    • Development under e-commerce
    • Xamarin
    • Xcode
    • Development under Windows Phone
    • Semantics
    • CMS
    • VueJS
    • GitHub
    • Open data
    • Sphinx
    • Ruby on Rails
    • Ruby
    • Symfony
    • Drupal
    • Messaging Systems
    • CTF
    • SaaS / S+S
    • SharePoint
    • jQuery
    • Puppet
    • Firefox
    • Elm
    • MODX
    • Billing systems
    • Graphical shells
    • Kodobred
    • MongoDB
    • SCADA
    • Hadoop
    • Gradle
    • Clojure
    • F#
    • CoffeeScript
    • Matlab
    • Phalcon
    • Development under Sailfish OS
    • Magento
    • Elixir/Phoenix
    • Microsoft Edge
    • Layout of letters
    • Development for OS X
    • Forth
    • Smalltalk
    • Julia
    • Laravel
    • WebGL
    • Meteor.JS
    • Firebird/Interbase
    • SQLite
    • D
    • Mesh-networks
    • I2P
    • Derby.js
    • Emacs
    • Development under Bada
    • Mercurial
    • UML Design
    • Objective C
    • Fortran
    • Cocoa
    • Cobol
    • Apache Flex
    • Action Script
    • Joomla
    • IIS
    • Twitter API
    • Vkontakte API
    • Facebook API
    • Microsoft Access
    • PDF
    • Prolog
    • GTK+
    • LabVIEW
    • Brainfuck
    • Cubrid
    • Canvas
    • Doctrine ORM
    • Google App Engine
    • Twisted
    • XSLT
    • TDD
    • Small Basic
    • Kohana
    • Development for Java ME
    • LiveStreet
    • MooTools
    • Adobe Flash
    • GreaseMonkey
    • INFOLUST
    • Groovy & Grails
    • Lisp
    • Delphi
    • Zend Framework
    • ExtJS / Sencha Library
    • Internet Explorer
    • CodeIgniter
    • Silverlight
    • Google Web Toolkit
    • CakePHP
    • Safari
    • Opera
    • Microformats
    • Ajax
    • VIM
  • Administration
    • System administration
    • IT Infrastructure
    • *nix
    • Network technologies
    • DevOps
    • Server Administration
    • Cloud computing
    • Configuring Linux
    • Wireless technologies
    • Virtualization
    • Hosting
    • Data storage
    • Decentralized networks
    • Database Administration
    • Data Warehousing
    • Communication standards
    • PowerShell
    • Backup
    • Cisco
    • Nginx
    • Antivirus protection
    • DNS
    • Server Optimization
    • Data recovery
    • Apache
    • Spam and antispam
    • Data Compression
    • SAN
    • IPv6
    • Fidonet
    • IPTV
    • Shells
    • Administering domain names
  • Design
    • Interfaces
    • Web design
    • Working with sound
    • Usability
    • Graphic design
    • Design Games
    • Mobile App Design
    • Working with 3D-graphics
    • Typography
    • Working with video
    • Work with vector graphics
    • Accessibility
    • Prototyping
    • CGI (graphics)
    • Computer Animation
    • Working with icons
  • Control
    • Careers in the IT industry
    • Project management
    • Development Management
    • Personnel Management
    • Product Management
    • Start-up development
    • Managing the community
    • Service Desk
    • GTD
    • IT Terminology
    • Agile
    • Business Models
    • Legislation and IT-business
    • Sales management
    • CRM-systems
    • Product localization
    • ECM / EDS
    • Freelance
    • Venture investments
    • ERP-systems
    • Help Desk Software
    • Media management
    • Patenting
    • E-commerce management
    • Creative Commons
  • Marketing
    • Conferences
    • Promotion of games
    • Internet Marketing
    • Search Engine Optimization
    • Web Analytics
    • Monetize Web services
    • Content marketing
    • Monetization of IT systems
    • Monetize mobile apps
    • Mobile App Analytics
    • Growth Hacking
    • Branding
    • Monetize Games
    • Display ads
    • Contextual advertising
    • Increase Conversion Rate
  • Sundry
    • Reading room
    • Educational process in IT
    • Research and forecasts in IT
    • Finance in IT
    • Hakatonas
    • IT emigration
    • Education abroad
    • Lumber room
    • I'm on my way

How to speed up machine learning on a GPU - a new open source platform

Nvidia submitted 3r3244. open source platform Rapids, whose task is to speed up the work of machine learning algorithms on the GPU. We talk about the features of the instrument and its analogues.
 
 
3r311.
Martin Brigden CC 3r33112. 3r3113.
 
 
3r3146. The problem of learning neural networks 3r3r147.
 
Nvidia’s technology list has a parallel computing architecture called CUDA. Its goal is to speed up computations by transferring part of the GPU tasks instead of the CPU. In some cases, this is allows you to speed up the work of applications and algorithms 18 times.
 
 
For this reason, it has found widespread use in machine learning. For example, researchers from universities in Florida and North Carolina develop with it the engine of the neural network 3r3224. for quantum simulations.
 
 
A large number of different libraries are used to develop MO algorithms. Many
of them are written in Python
. But not all of them support working with CUDA. An example of such tools is the scikit-learn and pandas Python libraries for machine learning. To run Python code in the CUDA architecture, researchers use separate Numba or PyCUDA libraries. In this case, the code of some components is rewrite manually, which is difficult, because you need to know the features of programming for the GPU.
 
 
3r3146. Solution from Nvidia
 
In order to automate the transfer of code, the company Nvidia introduced a new open platform Rapids. Developers do not need to resort to different libraries: they simply write code in Python, and Rapids automatically optimizes it to run on the GPU.
 
 
To compare processes, Rapids uses a common database that resides in the memory of the GPU. Data is stored in 3r36161.
format. Apache Arrow, uniform for all platform tools. This solution helps speed up the machine learning process 50 times compared to systems that use both graphics and central processing units.
 
 
At the same time, tools are available on the Rapids platform that can be used to conduct the entire process of working with neural networks on a graphics chip: from data preparation to outputting the result.
 
 
Number of solutions in 3r371. GitHub Rapids
repositories. actively replenished. For example, there is a library cuDF for data preparation and neural network training, and a 3r375 library. cuML
allows you to develop machine learning algorithms, without going into the details of programming for CUDA.
 
 
Nvidia will continue to develop the platform. The creators of the project plan to add tools for data visualization, graph analysis and deep learning to Rapids. Also in program 3r395. integrate 3r32424. Apache Spark framework.
 
 
3r3146. What think of the platform 3r3147.
 
In the technology community, the Rapids release was supported, but its further development caused several questions from experts and users.
 
 
For example, managers of Cisco, Dell, NetApp, Lenovo and other companies expressed support for the new solution. Anaconda CEO Scott Collison said that Rapids will simplify the collection and preparation of data for training complex AI systems. The creator of Apache Arrow and pandas Wes McKinney (Wes McKinney) agrees. According to him, Rapids will lead to an increase in productivity in tasks related to the creation of features ( Feature engineering ).
 
 
How to speed up machine learning on a GPU - a new open source platform  
[i] /photo 3r3108. Sander van der Wel
3r31-10. CC
3r33112. 3r3113.
 
 
However, the community also has 3r3118. There is an opinion 3r32424. that Rapids cannot be considered a truly open source project. The system only works with Nvidia cards, and the release of the platform can be a marketing ploy to attract new customers. The company has not yet specified whether the platform will work with devices from other manufacturers.
 
 
3r3146. Who is already using Rapids
 
IBM 3r3128. plans to
implement the platform in services for working with artificial intelligence systems: PowerAI, Watson and IBM Cloud. Support for Rapids has also been announced by Oracle, the 3-3-33130 platform. Available
on the Oracle Cloud infrastructure.
 
 
New product Nvidia also tested Walmart and Uber. The first rapids helped improve algorithms of the system responsible for inventory management. By 3r3138. According to 3r324. representatives of the retailer, Rapids accelerated the development of machine learning algorithms. As for Uber, the company 3r3-3140. uses
Rapids in the development of systems of unmanned vehicles.
 
 
3r3146. Alternative Solution 3r3147.
 
Not only Nvidia is developing a platform to accelerate MO. For example, AMD is engaged in the project 3r3-3150. ROCm 3r33224. (Radeon Open Compute). This is an open platform for high performance GPU computing.
 
 
The peculiarity of ROCm is that it does not depend on the programming language and is able to work with almost any video card. Including with Nvidia cards. For this used A special C ++ dialect called HIP. It simplifies the conversion of CUDA applications into portable C ++ code. The code is converted automatically by a special system Hipify.
 
 
At the same time ROCm 3r3162. supports
A large number of libraries Math Acceleration Libraries. Among them are BLAS, FFT and 3r3r164. convolution of the tensor
.
 
 
IT industry experts point out that open source solutions for accelerating heterogeneous and GPU computing, like ROCm and Rapids, allow developers to more efficiently use computing resources and get more performance from the available hardware.
 
 
 
P.S. Some materials from the First corporate IaaS blog:
 
 
 
3r3184. How IaaS helps grow a business: three tasks that the
cloud will solve.
 
3r3189. The effect of the GDPR: how the new regulations affected the IT ecosystem 3r3224.
 
3r3194. "How is VMware doing?": 3r32424 review of solutions.
 
 
 
P.P.S. Briefly about IaaS-technologies - in ours 3r3204. Telegram channel
:
 
 
 
NetApp from A to Z: a ​​review of vendor technology
 
Why a good IaaS provider does not build its data center
 
What else VMware has: virtualization tools
 
 

It may be interesting

  • Comments
  • About article
  • Similar news
This publication has no comments.

weber

Author

10-11-2018, 16:14

Publication Date

High performance / IT Standards

Category
  • Comments: 0
  • Views: 342
MatLab /Octave machine learning:
Machine learning is increasingly used
The new Google Compute Engine VM images
Neuronki for 5 minutes
Neural machine translation Google
Neural network Uber recognizes the
Write a comment
Name:*
E-Mail:


Comments
I genuinely believed you would probably have something useful to say. All I hear is a bunch of whining about something that you can fix if you were not too busy looking for attention. After all, I know it was my choice to read .. [url = https: //gamebnat.net] 먹튀 [/ url]

Today, 15:56

raymond weber

Lots of interesting comments, but it feels like users are really experts in their field, and it's very cool!
Today, 15:49

claudedufont

This is a good idea, thank you very much to the author!
Today, 15:47

claudedufont

I learned a lot of interesting things on this topic, and it really interested me! Good and smart comments from users!
Today, 15:47

claudedufont


We have years of experience in repairing fences and we can give you one that you will love! No matter what type of fence you have, we can fix it for you. Check Out:
All fences cape coral



Today, 15:03

noorseo

Adv
Website for web developers. New scripts, best ideas, programming tips. How to write a script for you here, we have a lot of information about various programming languages. You are a webmaster or a beginner programmer, it does not matter, useful articles will help to make your favorite business faster.

Login

Registration Forgot password