Ai And Big Data On Ibm Power Systems Servers

Author : Scott Vetter,Ivaylo B. Bozhinov,Anto A John,Rafael Freitas de Lima,Ahmed.(Mash) Mashhour,James Van Oosten,Fernando Vermelho,Allison White,IBM Redbooks
Publisher : IBM Redbooks
Page : 162 pages
File Size : 47,5 Mb
Release : 2019-04-10
Category : Computers
ISBN : 9780738457512

Get Book

AI and Big Data on IBM Power Systems Servers by Scott Vetter,Ivaylo B. Bozhinov,Anto A John,Rafael Freitas de Lima,Ahmed.(Mash) Mashhour,James Van Oosten,Fernando Vermelho,Allison White,IBM Redbooks Pdf

As big data becomes more ubiquitous, businesses are wondering how they can best leverage it to gain insight into their most important business questions. Using machine learning (ML) and deep learning (DL) in big data environments can identify historical patterns and build artificial intelligence (AI) models that can help businesses to improve customer experience, add services and offerings, identify new revenue streams or lines of business (LOBs), and optimize business or manufacturing operations. The power of AI for predictive analytics is being harnessed across all industries, so it is important that businesses familiarize themselves with all of the tools and techniques that are available for integration with their data lake environments. In this IBM® Redbooks® publication, we cover the best practices for deploying and integrating some of the best AI solutions on the market, including: IBM Watson Machine Learning Accelerator (see note for product naming) IBM Watson Studio Local IBM Power SystemsTM IBM SpectrumTM Scale IBM Data Science Experience (IBM DSX) IBM Elastic StorageTM Server Hortonworks Data Platform (HDP) Hortonworks DataFlow (HDF) H2O Driverless AI We map out all the integrations that are possible with our different AI solutions and how they can integrate with your existing or new data lake. We also walk you through some of our client use cases and show you how some of the industry leaders are using Hortonworks, IBM PowerAI, and IBM Watson Studio Local to drive decision making. We also advise you on your deployment options, when to use a GPU, and why you should use the IBM Elastic Storage Server (IBM ESS) to improve storage management. Lastly, we describe how to integrate IBM Watson Machine Learning Accelerator and Hortonworks with or without IBM Watson Studio Local, how to access real-time data, and security. Note: IBM Watson Machine Learning Accelerator is the new product name for IBM PowerAI Enterprise. Note: Hortonworks merged with Cloudera in January 2019. The new company is called Cloudera. References to Hortonworks as a business entity in this publication are now referring to the merged company. Product names beginning with Hortonworks continue to be marketed and sold under their original names.

Author : Ivaylo B. Bozhinov
Publisher : Unknown
Page : 128 pages
File Size : 43,9 Mb
Release : 2019
Category : Artificial intelligence
ISBN : OCLC:1099564733

Get Book

AI and Big Data on IBM Power Systems Servers by Ivaylo B. Bozhinov Pdf

Author : Scott Vetter,Glen Corneau,Andrew Laidlaw,Marcos Quezada,IBM Redbooks
Publisher : IBM Redbooks
Page : 64 pages
File Size : 43,6 Mb
Release : 2019-09-25
Category : Computers
ISBN : 9780738458052

Get Book

IBM Power Systems Enterprise AI Solutions by Scott Vetter,Glen Corneau,Andrew Laidlaw,Marcos Quezada,IBM Redbooks Pdf

This IBM® Redpaper publication helps the line of business (LOB), data science, and information technology (IT) teams develop an information architecture (IA) for their enterprise artificial intelligence (AI) environment. It describes the challenges that are faced by the three roles when creating and deploying enterprise AI solutions, and how they can collaborate for best results. This publication also highlights the capabilities of the IBM Cognitive Systems and AI solutions: IBM Watson® Machine Learning Community Edition IBM Watson Machine Learning Accelerator (WMLA) IBM PowerAI Vision IBM Watson Machine Learning IBM Watson Studio Local IBM Video Analytics H2O Driverless AI IBM Spectrum® Scale IBM Spectrum Discover This publication examines the challenges through five different use case examples: Artificial vision Natural language processing (NLP) Planning for the future Machine learning (ML) AI teaming and collaboration This publication targets readers from LOBs, data science teams, and IT departments, and anyone that is interested in understanding how to build an IA to support enterprise AI development and deployment.

Author : Dino Quintero,Bing He,Bruno C. Faria,Alfonso Jara,Chris Parsons,Shota Tsukamoto,Richard Wale,IBM Redbooks
Publisher : IBM Redbooks
Page : 278 pages
File Size : 51,8 Mb
Release : 2019-06-05
Category : Computers
ISBN : 9780738442945

Get Book

IBM PowerAI: Deep Learning Unleashed on IBM Power Systems Servers by Dino Quintero,Bing He,Bruno C. Faria,Alfonso Jara,Chris Parsons,Shota Tsukamoto,Richard Wale,IBM Redbooks Pdf

This IBM® Redbooks® publication is a guide about the IBM PowerAI Deep Learning solution. This book provides an introduction to artificial intelligence (AI) and deep learning (DL), IBM PowerAI, and components of IBM PowerAI, deploying IBM PowerAI, guidelines for working with data and creating models, an introduction to IBM SpectrumTM Conductor Deep Learning Impact (DLI), and case scenarios. IBM PowerAI started as a package of software distributions of many of the major DL software frameworks for model training, such as TensorFlow, Caffe, Torch, Theano, and the associated libraries, such as CUDA Deep Neural Network (cuDNN). The IBM PowerAI software is optimized for performance by using the IBM Power SystemsTM servers that are integrated with NVLink. The AI stack foundation starts with servers with accelerators. graphical processing unit (GPU) accelerators are well-suited for the compute-intensive nature of DL training, and servers with the highest CPU to GPU bandwidth, such as IBM Power Systems servers, enable the high-performance data transfer that is required for larger and more complex DL models. This publication targets technical readers, including developers, IT specialists, systems architects, brand specialist, sales team, and anyone looking for a guide about how to understand the IBM PowerAI Deep Learning architecture, framework configuration, application and workload configuration, and user infrastructure.

Author : Scott Vetter,Tobias Elpelt,Rico Franke,Yanil Zeledón Miranda,IBM Redbooks
Publisher : IBM Redbooks
Page : 62 pages
File Size : 48,7 Mb
Release : 2018-04-26
Category : Computers
ISBN : 9780738456836

Get Book

Networking Design for HPC and AI on IBM Power Systems by Scott Vetter,Tobias Elpelt,Rico Franke,Yanil Zeledón Miranda,IBM Redbooks Pdf

This publication provides information about networking design for IBM® High Performance Computing (HPC) and AI for Power SystemsTM. This paper will help you understand the basic requirements when designing a solution, the components in an infrastructure for HPC and AI Systems, the designing of interconnect and data networks with use cases based in real life scenarios, the administration and the Out-Of-Band management networks. We cover all the necessary requirements, provide a good understanding of the technology and include examples for small, medium and large cluster environments. This paper is intended for IT architects, system designers, data center planners, and system administrators who must design or provide a solution for the infrastructure of a HPC cluster.

Author : Scott Vetter,Ivaylo Bozhinov,Boran Lee,Gustavo Santos,IBM Redbooks
Publisher : IBM Redbooks
Page : 58 pages
File Size : 42,7 Mb
Release : 2019-10-17
Category : Computers
ISBN : 9780738458113

Get Book

Cognitive Computing Featuring the IBM Power System AC922 by Scott Vetter,Ivaylo Bozhinov,Boran Lee,Gustavo Santos,IBM Redbooks Pdf

This IBM® Redpaper publication describes the advantages of using IBM Power System AC922 for cognitive solutions, and how it can enhance clients' businesses. In order to optimize the hardware and software, IBM partners with NVIDIA, Mellanox, H2O.ai, SQream, Kinetica, and other prominent companies to design the Power AC922 server, specifically enhanced for the cognitive era. Most of its outstanding hardware features, such as NVIDIA NVLink 2.0 and PCIe 4.0, are described in this publication to illustrate the advantages that clients can realize in comparison with IBM competitors. We also include a brief description about what cognitive computing is, and how to use IBM Watson® Machine Learning cognitive solutions to bring more value to your business ecosystem. Additionally, we show performance charts that show the advantages of using Power AC922 versus x86 competitors. In the last chapter, we describe the most remarkable use cases in which IBM solves real problems using cognitive solutions. This IBM Redpaper publication is aimed at IT technical audiences, especially decision-making levels that need a full look at the benefits and improvements that an IBM Cognitive Solution can offer. It also provides valuable information to data science professionals, enabling them to plan their modeling needs. Finally, it offers information to the infrastructure support group in charge of maintaining the solution.

Author : Dino Quintero,Daniel Casali,Alain Fisher,Federico Fros,Miguel Gomez Gonzalez,Felix Gonzalez,Paulo Sergio Lemes Queiroz,Sudipto Pal,Bogdan Savu,Richard Wale,IBM Redbooks
Publisher : IBM Redbooks
Page : 128 pages
File Size : 40,7 Mb
Release : 2020-09-10
Category : Computers
ISBN : 9780738459073

Get Book

Red Hat OpenShift V4.3 on IBM Power Systems Reference Guide by Dino Quintero,Daniel Casali,Alain Fisher,Federico Fros,Miguel Gomez Gonzalez,Felix Gonzalez,Paulo Sergio Lemes Queiroz,Sudipto Pal,Bogdan Savu,Richard Wale,IBM Redbooks Pdf

This IBM® Redpaper publication describes how to deploy Red Hat OpenShift V4.3 on IBM Power Systems servers. This book presents reference architectures for deployment, initial sizing guidelines for server, storage, and IBM Cloud® Paks. Moreover, this publication delivers information about initial supported Power System configurations for Red Hat OpenShift V4.3 deployment (bare metal, IBM PowerVM® LE LPARs, and others). This book serves as a guide for how to deploy Red Hat OpenShift V4.3 and provide start guidelines and recommended practices for implementing it on Power Systems and completing it with the supported IBM Cloud Paks. The publication addresses topics for developers, IT architects, IT specialists, sellers, and anyone who wants to implement a Red Hat OpenShift V4.3 and IBM Cloud Paks on IBM Power Systems. This book also provides technical content to transfer how-to skills to the support teams, and solution guidance to the sales team. This book compliments the documentation that is available at IBM Knowledge Center, and also aligns with the educational offerings that are provided by the IBM Systems Technical Education (SSE).

Author : Glen Corneau,Andrew Laidlaw,Marcos Quezada
Publisher : Unknown
Page : 128 pages
File Size : 42,9 Mb
Release : 2019
Category : Artificial intelligence
ISBN : OCLC:1125343546

Get Book

IBM Power Systems Enterprise AI Solutions by Glen Corneau,Andrew Laidlaw,Marcos Quezada Pdf

Author : Dino Quintero,Cesar Maciel,Marcos Quezada,IBM Redbooks
Publisher : IBM Redbooks
Page : 22 pages
File Size : 52,8 Mb
Release : 2018-02-14
Category : Computers
ISBN : 9780738456676

Get Book

IBM Power Systems Bits: Understanding IBM Patterns for Cognitive Systems by Dino Quintero,Cesar Maciel,Marcos Quezada,IBM Redbooks Pdf

This IBM® RedpaperTM publication addresses IBM Patterns for Cognitive Systems topics to anyone developing, implementing, and using Cognitive Solutions on IBM Power SystemsTM servers. Moreover, this publication provides documentation to transfer the knowledge to the sales and technical teams. This publication describes IBM Patterns for Cognitive Systems. Think of a pattern as a use case for a specific scenario, such as event-based real-time marketing for real-time analytics, anti-money laundering, and addressing data oceans by reducing the cost of Hadoop. These examples are just a few of the cognitive patterns that are now available. Patterns identify and address challenges for cognitive infrastructures. These entry points then help you understand where you are on the cognitive journey and enables IBM to demonstrate the set of solutions capabilities for each lifecycle stage. This book targets technical readers, including IT specialist, systems architects, data scientists, developers, and anyone looking for a guide about how to unleash the cognitive capabilities of IBM Power Systems by using patterns.

Author : Scott Vetter,Ahmed Azraq,Soheel Chughtai,Ahmed (Mash) Mashhour,Duy V Nguyen,Reginaldo Marcelo Dos Santos,IBM Redbooks
Publisher : IBM Redbooks
Page : 218 pages
File Size : 45,6 Mb
Release : 2018-04-12
Category : Computers
ISBN : 9780738443027

Get Book

Enhancing the IBM Power Systems Platform with IBM Watson Services by Scott Vetter,Ahmed Azraq,Soheel Chughtai,Ahmed (Mash) Mashhour,Duy V Nguyen,Reginaldo Marcelo Dos Santos,IBM Redbooks Pdf

This IBM® Redbooks® publication provides an introduction to the IBM POWER® processor architecture. It describes the IBM POWER processor and IBM Power SystemsTM servers, highlighting the advantages and benefits of IBM Power Systems servers, IBM AIX®, IBM i, and Linux on Power. This publication showcases typical business scenarios that are powered by Power Systems servers. It provides an introduction to the artificial intelligence (AI) capabilities that IBM Watson® services enable, and how these AI capabilities can be augmented in existing applications by using an agile approach to embed intelligence into every operational process. For each use case, the business benefits of adding Watson services are detailed. This publication gives an overview about each Watson service, and how each one is commonly used in real business scenarios. It gives an introduction to the Watson API explorer, which you can use to try the application programming interfaces (APIs) and their capabilities. The Watson services are positioned against the machine learning capabilities of IBM PowerAI. In this publication, you have a guide about how to set up a development environment on Power Systems servers, a sample code implementation of one of the business cases, and a description of preferred practices to move any application that you develop into production. This publication is intended for technical professionals who are interested in learning about or implementing IBM Watson services on AIX, IBM i, and Linux.

Author : Scott Vetter,Helen Lu,Maciej Olejniczak,IBM Redbooks
Publisher : IBM Redbooks
Page : 82 pages
File Size : 45,9 Mb
Release : 2018-01-31
Category : Computers
ISBN : 9780738456607

Get Book

Enterprise Data Warehouse Optimization with Hadoop on IBM Power Systems Servers by Scott Vetter,Helen Lu,Maciej Olejniczak,IBM Redbooks Pdf

Data warehouses were developed for many good reasons, such as providing quick query and reporting for business operations, and business performance. However, over the years, due to the explosion of applications and data volume, many existing data warehouses have become difficult to manage. Extract, Transform, and Load (ETL) processes are taking longer, missing their allocated batch windows. In addition, data types that are required for business analysis have expanded from structured data to unstructured data. The Apache open source Hadoop platform provides a great alternative for solving these problems. IBM® has committed to open source since the early years of open Linux. IBM and Hortonworks together are committed to Apache open source software more than any other company. IBM Power SystemsTM servers are built with open technologies and are designed for mission-critical data applications. Power Systems servers use technology from the OpenPOWER Foundation, an open technology infrastructure that uses the IBM POWER® architecture to help meet the evolving needs of big data applications. The combination of Power Systems with Hortonworks Data Platform (HDP) provides users with a highly efficient platform that provides leadership performance for big data workloads such as Hadoop and Spark. This IBM RedpaperTM publication provides details about Enterprise Data Warehouse (EDW) optimization with Hadoop on Power Systems. Many people know Power Systems from the IBM AIX® platform, but might not be familiar with IBM PowerLinuxTM, so part of this paper provides a Power Systems overview. A quick introduction to Hadoop is provided for those not familiar with the topic. Details of HDP on Power Reference architecture are included that will help both software architects and infrastructure architects understand the design. In the optimization chapter, we describe various topics: traditional EDW offload, sizing guidelines, performance tuning, IBM Elastic StorageTM Server (ESS) for data-intensive workload, IBM Big SQL as the common structured query language (SQL) engine for Hadoop platform, and tools that are available on Power Systems that are related to EDW optimization. We also dedicate some pages to the analytics components (IBM Data Science Experience (IBM DSX) and IBM SpectrumTM Conductor for Spark workload) for the Hadoop infrastructure.

Author : Dino Quintero,Miguel Gomez Gonzalez,Ahmad Y Hussein,Jan-Frode Myklebust,IBM Redbooks
Publisher : IBM Redbooks
Page : 352 pages
File Size : 42,5 Mb
Release : 2019-05-02
Category : Computers
ISBN : 9780738457451

Get Book

IBM High-Performance Computing Insights with IBM Power System AC922 Clustered Solution by Dino Quintero,Miguel Gomez Gonzalez,Ahmad Y Hussein,Jan-Frode Myklebust,IBM Redbooks Pdf

This IBM® Redbooks® publication documents and addresses topics to set up a complete infrastructure environment and tune the applications to use an IBM POWER9TM hardware architecture with the technical computing software stack. This publication is driven by a CORAL project solution. It explores, tests, and documents how to implement an IBM High-Performance Computing (HPC) solution on a POWER9 processor-based system by using IBM technical innovations to help solve challenging scientific, technical, and business problems. This book documents the HPC clustering solution with InfiniBand on IBM Power SystemsTM AC922 8335-GTH and 8335-GTX servers with NVIDIA Tesla V100 SXM2 graphics processing units (GPUs) with NVLink, software components, and the IBM SpectrumTM Scale parallel file system. This solution includes recommendations about the components that are used to provide a cohesive clustering environment that includes job scheduling, parallel application tools, scalable file systems, administration tools, and a high-speed interconnect. This book is divided into three parts: Part 1 focuses on the planners of the solution, Part 2 focuses on the administrators, and Part 3 focuses on the developers. This book targets technical professionals (consultants, technical support staff, IT architects, and IT specialists) who are responsible for delivering cost-effective HPC solutions that help uncover insights among clients' data so that they can act to optimize business results, product development, and scientific discoveries.

Author : Dino Quintero,Kanako Harada,Reinaldo Tetsuo Katahira,Antonio Moreira de Oliveira Neto,Robert Simon,Brian Yaeger,IBM Redbooks
Publisher : IBM Redbooks
Page : 294 pages
File Size : 41,7 Mb
Release : 2016-06-01
Category : Computers
ISBN : 9780738441689

Get Book

Implementing an Optimized Analytics Solution on IBM Power Systems by Dino Quintero,Kanako Harada,Reinaldo Tetsuo Katahira,Antonio Moreira de Oliveira Neto,Robert Simon,Brian Yaeger,IBM Redbooks Pdf

This IBM® Redbooks® publication addresses topics to use the virtualization strengths of the IBM POWER8® platform to solve clients' system resource utilization challenges and maximize systems' throughput and capacity. This book addresses performance tuning topics that will help answer clients' complex analytic workload requirements, help maximize systems' resources, and provide expert-level documentation to transfer the how-to-skills to the worldwide teams. This book strengthens the position of IBM Analytics and Big Data solutions with a well-defined and documented deployment model within a POWER8 virtualized environment, offering clients a planned foundation for security, scaling, capacity, resilience, and optimization for analytics workloads. This book is targeted toward technical professionals (analytics consultants, technical support staff, IT Architects, and IT Specialists) who are responsible for providing analytics solutions and support on IBM Power SystemsTM.

Author : Simon Lorenz,Gero Schmidt,Thomas Schoenemeyer,IBM Redbooks
Publisher : IBM Redbooks
Page : 80 pages
File Size : 54,7 Mb
Release : 2020-11-30
Category : Computers
ISBN : 9780738459097

Get Book

Deployment and Usage Guide for Running AI Workloads on Red Hat OpenShift and NVIDIA DGX Systems with IBM Spectrum Scale by Simon Lorenz,Gero Schmidt,Thomas Schoenemeyer,IBM Redbooks Pdf

This IBM® Redpaper publication describes the architecture, installation procedure, and results for running a typical training application that works on an automotive data set in an orchestrated and secured environment that provides horizontal scalability of GPU resources across physical node boundaries for deep neural network (DNN) workloads. This paper is mostly relevant for systems engineers, system administrators, or system architects that are responsible for data center infrastructure management and typical day-to-day operations such as system monitoring, operational control, asset management, and security audits. This paper also describes IBM Spectrum® LSF® as a workload manager and IBM Spectrum Discover as a metadata search engine to find the right data for an inference job and automate the data science workflow. With the help of this solution, the data location, which may be on different storage systems, and time of availability for the AI job can be fully abstracted, which provides valuable information for data scientists.

Author : Dino Quintero,Frank N. Lee,IBM Redbooks
Publisher : IBM Redbooks
Page : 88 pages
File Size : 50,9 Mb
Release : 2019-09-08
Category : Computers
ISBN : 9780738456904

Get Book

IBM Reference Architecture for High Performance Data and AI in Healthcare and Life Sciences by Dino Quintero,Frank N. Lee,IBM Redbooks Pdf

This IBM® Redpaper publication provides an update to the original description of IBM Reference Architecture for Genomics. This paper expands the reference architecture to cover all of the major vertical areas of healthcare and life sciences industries, such as genomics, imaging, and clinical and translational research. The architecture was renamed IBM Reference Architecture for High Performance Data and AI in Healthcare and Life Sciences to reflect the fact that it incorporates key building blocks for high-performance computing (HPC) and software-defined storage, and that it supports an expanding infrastructure of leading industry partners, platforms, and frameworks. The reference architecture defines a highly flexible, scalable, and cost-effective platform for accessing, managing, storing, sharing, integrating, and analyzing big data, which can be deployed on-premises, in the cloud, or as a hybrid of the two. IT organizations can use the reference architecture as a high-level guide for overcoming data management challenges and processing bottlenecks that are frequently encountered in personalized healthcare initiatives, and in compute-intensive and data-intensive biomedical workloads. This reference architecture also provides a framework and context for modern healthcare and life sciences institutions to adopt cutting-edge technologies, such as cognitive life sciences solutions, machine learning and deep learning, Spark for analytics, and cloud computing. To illustrate these points, this paper includes case studies describing how clients and IBM Business Partners alike used the reference architecture in the deployments of demanding infrastructures for precision medicine. This publication targets technical professionals (consultants, technical support staff, IT Architects, and IT Specialists) who are responsible for providing life sciences solutions and support.