Modern Data Architecture On Aws

Modern Data Architecture On Aws Book in PDF, ePub and Kindle version is available to download in english. Read online anytime anywhere directly from your device. Click on the download button below to get a free pdf file of Modern Data Architecture On Aws book. This book definitely worth reading, it is an incredibly well-written.

Modern Data Architecture on AWS

Author : Behram Irani
Publisher : Packt Publishing Ltd
Page : 420 pages
File Size : 54,8 Mb
Release : 2023-08-31
Category : Computers
ISBN : 9781801810128

Get Book

Modern Data Architecture on AWS by Behram Irani Pdf

Discover all the essential design and architectural patterns in one place to help you rapidly build and deploy your modern data platform using AWS services Key Features Learn to build modern data platforms on AWS using data lakes and purpose-built data services Uncover methods of applying security and governance across your data platform built on AWS Find out how to operationalize and optimize your data platform on AWS Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionMany IT leaders and professionals are adept at extracting data from a particular type of database and deriving value from it. However, designing and implementing an enterprise-wide holistic data platform with purpose-built data services, all seamlessly working in tandem with the least amount of manual intervention, still poses a challenge. This book will help you explore end-to-end solutions to common data, analytics, and AI/ML use cases by leveraging AWS services. The chapters systematically take you through all the building blocks of a modern data platform, including data lakes, data warehouses, data ingestion patterns, data consumption patterns, data governance, and AI/ML patterns. Using real-world use cases, each chapter highlights the features and functionalities of numerous AWS services to enable you to create a scalable, flexible, performant, and cost-effective modern data platform. By the end of this book, you’ll be equipped with all the necessary architectural patterns and be able to apply this knowledge to efficiently build a modern data platform for your organization using AWS services.What you will learn Familiarize yourself with the building blocks of modern data architecture on AWS Discover how to create an end-to-end data platform on AWS Design data architectures for your own use cases using AWS services Ingest data from disparate sources into target data stores on AWS Build data pipelines, data sharing mechanisms, and data consumption patterns using AWS services Find out how to implement data governance using AWS services Who this book is for This book is for data architects, data engineers, and professionals creating data platforms. The book's use case–driven approach helps you conceptualize possible solutions to specific use cases, while also providing you with design patterns to build data platforms for any organization. It's beneficial for technical leaders and decision makers to understand their organization's data architecture and how each platform component serves business needs. A basic understanding of data & analytics architectures and systems is desirable along with beginner’s level understanding of AWS Cloud.

Modern Data Architecture on AWS

Author : Behram Irani
Publisher : Packt Publishing Ltd
Page : 420 pages
File Size : 46,5 Mb
Release : 2023-08-31
Category : Computers
ISBN : 9781801810128

Get Book

Modern Data Architecture on AWS by Behram Irani Pdf

Discover all the essential design and architectural patterns in one place to help you rapidly build and deploy your modern data platform using AWS services Key Features Learn to build modern data platforms on AWS using data lakes and purpose-built data services Uncover methods of applying security and governance across your data platform built on AWS Find out how to operationalize and optimize your data platform on AWS Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionMany IT leaders and professionals are adept at extracting data from a particular type of database and deriving value from it. However, designing and implementing an enterprise-wide holistic data platform with purpose-built data services, all seamlessly working in tandem with the least amount of manual intervention, still poses a challenge. This book will help you explore end-to-end solutions to common data, analytics, and AI/ML use cases by leveraging AWS services. The chapters systematically take you through all the building blocks of a modern data platform, including data lakes, data warehouses, data ingestion patterns, data consumption patterns, data governance, and AI/ML patterns. Using real-world use cases, each chapter highlights the features and functionalities of numerous AWS services to enable you to create a scalable, flexible, performant, and cost-effective modern data platform. By the end of this book, you’ll be equipped with all the necessary architectural patterns and be able to apply this knowledge to efficiently build a modern data platform for your organization using AWS services.What you will learn Familiarize yourself with the building blocks of modern data architecture on AWS Discover how to create an end-to-end data platform on AWS Design data architectures for your own use cases using AWS services Ingest data from disparate sources into target data stores on AWS Build data pipelines, data sharing mechanisms, and data consumption patterns using AWS services Find out how to implement data governance using AWS services Who this book is for This book is for data architects, data engineers, and professionals creating data platforms. The book's use case–driven approach helps you conceptualize possible solutions to specific use cases, while also providing you with design patterns to build data platforms for any organization. It's beneficial for technical leaders and decision makers to understand their organization's data architecture and how each platform component serves business needs. A basic understanding of data & analytics architectures and systems is desirable along with beginner’s level understanding of AWS Cloud.

Optimizing Your Modernization Journey with AWS

Author : Mridula Grandhi
Publisher : Packt Publishing Ltd
Page : 419 pages
File Size : 46,5 Mb
Release : 2023-07-07
Category : Computers
ISBN : 9781803236179

Get Book

Optimizing Your Modernization Journey with AWS by Mridula Grandhi Pdf

A strategic guide that will help you make key decisions related to cloud-based architectures, modernize your infrastructure and applications, and transform your business using AWS with real-world case studies Key Features Learn cloud migration and modernization strategies on AWS Innovate your applications, data, architecture and networking by adopting AWS Leverage AWS technologies with real world use-cases to implement cloud operations Purchase of the print or Kindle book includes a free eBook in the PDF format Book Description AWS cloud technologies help businesses scale and innovate, however, adopting modern architecture and applications can be a real challenge. This book is a comprehensive guide that ensures your switch to AWS services is smooth and hitch-free. It will enable you to make optimal decisions to bring out the best ROI from AWS cloud adoption. Beginning with nuances of cloud transformation on AWS, you'll be able to plan and implement the migration steps. The book will facilitate your system modernization journey by getting you acquainted with various technical domains, namely, applications, databases, big data, analytics, networking, and security. Once you've learned about the different operations, budgeting, and management best practices such as the 6 Rs of migration approaches and the AWS Well-Architected Framework, you'll be able to achieve operational excellence in cloud adoption. You'll also learn how to deploy some of the important AWS tools and services with real-life case studies and use cases. By the end of this book, you'll be able to successfully implement cloud migration and modernization on AWS and make decisions that best suit your organization. What you will learn Strategize approaches for cloud adoption and digital transformation Understand the catalysts for business reinvention Select the right tools for cloud migration and modernization processes Leverage the potential of AWS to maximize the value of cloud investments Understand the importance of implementing secure workloads on the cloud Explore AWS services such as computation, databases, security, and networking Implement various real-life use cases and technology case studies for modernization Discover the benefits of operational excellence on the cloud Who this book is for If you are a cloud enthusiast, solutions architect, enterprise technologist, or a C-suite executive and want to learn about the strategies and AWS services to transform your IT portfolio, this book is for you. Basic knowledge of AWS services and an understanding of technologies such as computation, databases, networking, and security will be helpful.

Architecting a Modern Data Warehouse for Large Enterprises

Author : Anjani Kumar,Abhishek Mishra,Sanjeev Kumar
Publisher : Apress
Page : 0 pages
File Size : 52,8 Mb
Release : 2024-01-24
Category : Computers
ISBN : 9798868800283

Get Book

Architecting a Modern Data Warehouse for Large Enterprises by Anjani Kumar,Abhishek Mishra,Sanjeev Kumar Pdf

Design and architect new generation cloud-based data warehouses using Azure and AWS. This book provides an in-depth understanding of how to build modern cloud-native data warehouses, as well as their history and evolution. The book starts by covering foundational data warehouse concepts, and introduces modern features such as distributed processing, big data storage, data streaming, and processing data on the cloud. You will gain an understanding of the synergy, relevance, and usage data warehousing standard practices in the modern world of distributed data processing. The authors walk you through the essential concepts of Data Mesh, Data Lake, Lakehouse, and Delta Lake. And they demonstrate the services and offerings available on Azure and AWS that deal with data orchestration, data democratization, data governance, data security, and business intelligence. After completing this book, you will be ready to design and architect enterprise-grade, cloud-based modern data warehouses using industry best practices and guidelines. What You Will Learn Understand the core concepts underlying modern data warehouses Design and build cloud-native data warehouses Gain a practical approach to architecting and building data warehouses on Azure and AWS Implement modern data warehousing components such as Data Mesh, Data Lake, Delta Lake, and Lakehouse Process data through pandas and evaluate your model’s performance using metrics such as F1-score, precision, and recall Apply deep learning to supervised, semi-supervised, and unsupervised anomaly detection tasks for tabular datasets and time series applications Who This Book Is For Experienced developers, cloud architects, and technology enthusiasts looking to build cloud-based modern data warehouses using Azure and AWS

Geospatial Data Analytics on AWS

Author : Scott Bateman,Janahan Gnanachandran,Jeff DeMuth
Publisher : Packt Publishing Ltd
Page : 276 pages
File Size : 49,9 Mb
Release : 2023-06-30
Category : Computers
ISBN : 9781804610572

Get Book

Geospatial Data Analytics on AWS by Scott Bateman,Janahan Gnanachandran,Jeff DeMuth Pdf

Build an end-to-end geospatial data lake in AWS using popular AWS services such as RDS, Redshift, DynamoDB, and Athena to manage geodata Purchase of the print or Kindle book includes a free PDF eBook. Key Features Explore the architecture and different use cases to build and manage geospatial data lakes in AWS Discover how to leverage AWS purpose-built databases to store and analyze geospatial data Learn how to recognize which anti-patterns to avoid when managing geospatial data in the cloud Book DescriptionManaging geospatial data and building location-based applications in the cloud can be a daunting task. This comprehensive guide helps you overcome this challenge by presenting the concept of working with geospatial data in the cloud in an easy-to-understand way, along with teaching you how to design and build data lake architecture in AWS for geospatial data. You’ll begin by exploring the use of AWS databases like Redshift and Aurora PostgreSQL for storing and analyzing geospatial data. Next, you’ll leverage services such as DynamoDB and Athena, which offer powerful built-in geospatial functions for indexing and querying geospatial data. The book is filled with practical examples to illustrate the benefits of managing geospatial data in the cloud. As you advance, you’ll discover how to analyze and visualize data using Python and R, and utilize QuickSight to share derived insights. The concluding chapters explore the integration of commonly used platforms like Open Data on AWS, OpenStreetMap, and ArcGIS with AWS to enable you to optimize efficiency and provide a supportive community for continuous learning. By the end of this book, you’ll have the necessary tools and expertise to build and manage your own geospatial data lake on AWS, along with the knowledge needed to tackle geospatial data management challenges and make the most of AWS services.What you will learn Discover how to optimize the cloud to store your geospatial data Explore management strategies for your data repository using AWS Single Sign-On and IAM Create effective SQL queries against your geospatial data using Athena Validate postal addresses using Amazon Location services Process structured and unstructured geospatial data efficiently using R Use Amazon SageMaker to enable machine learning features in your application Explore the free and subscription satellite imagery data available for use in your GIS Who this book is forIf you understand the importance of accurate coordinates, but not necessarily the cloud, then this book is for you. This book is best suited for GIS developers, GIS analysts, data analysts, and data scientists looking to enhance their solutions with geospatial data for cloud-centric applications. A basic understanding of geographic concepts is suggested, but no experience with the cloud is necessary for understanding the concepts in this book.

Actionable Insights with Amazon QuickSight

Author : Manos Samatas
Publisher : Packt Publishing Ltd
Page : 242 pages
File Size : 40,7 Mb
Release : 2022-01-28
Category : Computers
ISBN : 9781801072007

Get Book

Actionable Insights with Amazon QuickSight by Manos Samatas Pdf

Build interactive dashboards and storytelling reports at scale with the cloud-native BI tool that integrates embedded analytics and ML-powered insights effortlessly Key FeaturesExplore Amazon QuickSight, manage data sources, and build and share dashboardsLearn best practices from an AWS certified big data solutions architect Manage and monitor dashboards using the QuickSight API and other AWS services such as Amazon CloudTrailBook Description Amazon Quicksight is an exciting new visualization that rivals PowerBI and Tableau, bringing several exciting features to the table – but sadly, there aren't many resources out there that can help you learn the ropes. This book seeks to remedy that with the help of an AWS-certified expert who will help you leverage its full capabilities. After learning QuickSight's fundamental concepts and how to configure data sources, you'll be introduced to the main analysis-building functionality of QuickSight to develop visuals and dashboards, and explore how to develop and share interactive dashboards with parameters and on-screen controls. You'll dive into advanced filtering options with URL actions before learning how to set up alerts and scheduled reports. Next, you'll familiarize yourself with the types of insights before getting to grips with adding ML insights such as forecasting capabilities, analyzing time series data, adding narratives, and outlier detection to your dashboards. You'll also explore patterns to automate operations and look closer into the API actions that allow us to control settings. Finally, you'll learn advanced topics such as embedded dashboards and multitenancy. By the end of this book, you'll be well-versed with QuickSight's BI and analytics functionalities that will help you create BI apps with ML capabilities. What you will learnUnderstand the wider AWS analytics ecosystem and how QuickSight fits within itSet up and configure data sources with Amazon QuickSightInclude custom controls and add interactivity to your BI application using parametersAdd ML insights such as forecasting, anomaly detection, and narrativesExplore patterns to automate operations using QuickSight APIsCreate interactive dashboards and storytelling with Amazon QuickSightDesign an embedded multi-tenant analytics architectureFocus on data permissions and how to manage Amazon QuickSight operationsWho this book is for This book is for business intelligence (BI) developers and data analysts who are looking to create interactive dashboards using data from Lake House on AWS with Amazon QuickSight. It will also be useful for anyone who wants to learn Amazon QuickSight in depth using practical, up-to-date examples. You will need to be familiar with general data visualization concepts before you get started with this book, however, no prior experience with Amazon QuickSight is required.

Amazon Redshift: The Definitive Guide

Author : Rajesh Francis,Rajiv Gupta,Milind Oke
Publisher : "O'Reilly Media, Inc."
Page : 523 pages
File Size : 46,8 Mb
Release : 2023-10-03
Category : Electronic
ISBN : 9781098135263

Get Book

Amazon Redshift: The Definitive Guide by Rajesh Francis,Rajiv Gupta,Milind Oke Pdf

Amazon Redshift powers analytic cloud data warehouses worldwide, from startups to some of the largest enterprise data warehouses available today. This practical guide thoroughly examines this managed service and demonstrates how you can use it to extract value from your data immediately, rather than go through the heavy lifting required to run a typical data warehouse. Analytic specialists Rajesh Francis, Rajiv Gupta, and Milind Oke detail Amazon Redshift's underlying mechanisms and options to help you explore out-of-the box automation. Whether you're a data engineer who wants to learn the art of the possible or a DBA looking to take advantage of machine learning-based auto-tuning, this book helps you get the most value from Amazon Redshift. By understanding Amazon Redshift features, you'll achieve excellent analytic performance at the best price, with the least effort. This book helps you: Build a cloud data strategy around Amazon Redshift as foundational data warehouse Get started with Amazon Redshift with simple-to-use data models and design best practices Understand how and when to use Redshift Serverless and Redshift provisioned clusters Take advantage of auto-tuning options inherent in Amazon Redshift and understand manual tuning options Transform your data platform for predictive analytics using Redshift ML and break silos using data sharing Learn best practices for security, monitoring, resilience, and disaster recovery Leverage Amazon Redshift integration with other AWS services to unlock additional value

Data Analytics in the AWS Cloud

Author : Joe Minichino
Publisher : John Wiley & Sons
Page : 426 pages
File Size : 41,6 Mb
Release : 2023-04-06
Category : Computers
ISBN : 9781119909255

Get Book

Data Analytics in the AWS Cloud by Joe Minichino Pdf

A comprehensive and accessible roadmap to performing data analytics in the AWS cloud In Data Analytics in the AWS Cloud: Building a Data Platform for BI and Predictive Analytics on AWS, accomplished software engineer and data architect Joe Minichino delivers an expert blueprint to storing, processing, analyzing data on the Amazon Web Services cloud platform. In the book, you’ll explore every relevant aspect of data analytics—from data engineering to analysis, business intelligence, DevOps, and MLOps—as you discover how to integrate machine learning predictions with analytics engines and visualization tools. You’ll also find: Real-world use cases of AWS architectures that demystify the applications of data analytics Accessible introductions to data acquisition, importation, storage, visualization, and reporting Expert insights into serverless data engineering and how to use it to reduce overhead and costs, improve stability, and simplify maintenance A can't-miss for data architects, analysts, engineers and technical professionals, Data Analytics in the AWS Cloud will also earn a place on the bookshelves of business leaders seeking a better understanding of data analytics on the AWS cloud platform.

AWS for Solutions Architects

Author : Saurabh Shrivastava,Neelanjali Srivastav,Alberto Artasanchez,Imtiaz Sayed,Dr. Siddhartha Choubey Ph.D
Publisher : Packt Publishing Ltd
Page : 693 pages
File Size : 48,7 Mb
Release : 2023-04-28
Category : Computers
ISBN : 9781803244822

Get Book

AWS for Solutions Architects by Saurabh Shrivastava,Neelanjali Srivastav,Alberto Artasanchez,Imtiaz Sayed,Dr. Siddhartha Choubey Ph.D Pdf

Become a master Solutions Architect with this comprehensive guide, featuring cloud design patterns and real-world solutions for building scalable, secure, and highly available systems Purchase of the print or Kindle book includes a free eBook in PDF format. Key Features Gain expertise in automating, networking, migrating, and adopting cloud technologies using AWS Use streaming analytics, big data, AI/ML, IoT, quantum computing, and blockchain to transform your business Upskill yourself as an AWS solutions architect and explore details of the new AWS certification Book Description Are you excited to harness the power of AWS and unlock endless possibilities for your business? Look no further than the second edition of AWS for Solutions Architects! Packed with all-new content, this book is a must-have guide for anyone looking to build scalable cloud solutions and drive digital transformation using AWS. This updated edition offers in-depth guidance for building cloud solutions using AWS. It provides detailed information on AWS well-architected design pillars and cloud-native design patterns. You'll learn about networking in AWS, big data and streaming data processing, CloudOps, and emerging technologies such as machine learning, IoT, and blockchain. Additionally, the book includes new sections on storage in AWS, containers with ECS and EKS, and data lake patterns, providing you with valuable insights into designing industry-standard AWS architectures that meet your organization's technological and business requirements. Whether you're an experienced solutions architect or just getting started with AWS, this book has everything you need to confidently build cloud-native workloads and enterprise solutions. What you will learn Optimize your Cloud Workload using the AWS Well-Architected Framework Learn methods to migrate your workload using the AWS Cloud Adoption Framework Apply cloud automation at various layers of application workload to increase efficiency Build a landing zone in AWS and hybrid cloud setups with deep networking techniques Select reference architectures for business scenarios, like data lakes, containers, and serverless apps Apply emerging technologies in your architecture, including AI/ML, IoT and blockchain Who this book is for This book is for application and enterprise architects, developers, and operations engineers who want to become well versed with AWS architectural patterns, best practices, and advanced techniques to build scalable, secure, highly available, highly tolerant, and cost-effective solutions in the cloud. Existing AWS users are bound to learn the most, but it will also help those curious about how leveraging AWS can benefit their organization. Prior knowledge of any computing language is not needed, and there's little to no code. Prior experience in software architecture design will prove helpful.

Mastering the Modern Data Stack

Author : Nick Jewell, PhD
Publisher : TinyTechMedia LLC
Page : 129 pages
File Size : 51,7 Mb
Release : 2023-09-28
Category : Computers
ISBN : 9798985822786

Get Book

Mastering the Modern Data Stack by Nick Jewell, PhD Pdf

In the age of digital transformation, becoming overwhelmed by the sheer volume of potential data management, analytics, and AI solutions is common. Then it's all too easy to become distracted by glossy vendor marketing, and then chase the latest shiny tool, rather than focusing on building resilient, valuable platforms that will outperform the competition. This book aims to fix a glaring gap for data professionals: a comprehensive guide to the full Modern Data Stack that's rooted in real-world capabilities, not vendor hype. It is full of hard-earned advice on how to get maximum value from your investments through tangible insights, actionable strategies, and proven best practices. It comprehensively explains how the Modern Data Stack is truly utilized by today's data-driven companies. Mastering the Modern Data Stack: An Executive Guide to Unified Business Analytics is crafted for a diverse audience. It's for business and technology leaders who understand the importance and potential value of data, analytics, and AI—but don’t quite see how it all fits together in the big picture. It's for enterprise architects and technology professionals looking for a primer on the data analytics domain, including definitions of essential components and their usage patterns. It's also for individuals early in their data analytics careers who wish to have a practical and jargon-free understanding of how all the gears and pulleys move behind the scenes in a Modern Data Stack to turn data into actual business value. Whether you're starting your data journey with modest resources, or implementing digital transformation in the cloud, you'll find that this isn't just another textbook on data tools or a mere overview of outdated systems. It's a powerful guide to efficient, modern data management and analytics, with a firm focus on emerging technologies such as data science, machine learning, and AI. If you want to gain a competitive advantage in today’s fast-paced digital world, this TinyTechGuide™ is for you. Remember, it’s not the tech that’s tiny, just the book!™

Azure Modern Data Architecture

Author : Anouar BEN ZAHRA
Publisher : Anouar BEN ZAHRA
Page : 319 pages
File Size : 53,6 Mb
Release : 2024-05-25
Category : Computers
ISBN : 8210379456XXX

Get Book

Azure Modern Data Architecture by Anouar BEN ZAHRA Pdf

Key Features Discover the key drivers of successful Azure architecture Practical guidance Focus on scalability and performance Expert authorship Book Description This book presents a guide to design and implement scalable, secure, and efficient data solutions in the Azure cloud environment. It provides Data Architects, developers, and IT professionals who are responsible for designing and implementing data solutions in the Azure cloud environment with the knowledge and tools needed to design and implement data solutions using the latest Azure data services. It covers a wide range of topics, including data storage, data processing, data analysis, and data integration. In this book, you will learn how to select the appropriate Azure data services, design a data processing pipeline, implement real-time data processing, and implement advanced analytics using Azure Databricks and Azure Synapse Analytics. You will also learn how to implement data security and compliance, including data encryption, access control, and auditing. Whether you are building a new data architecture from scratch or migrating an existing on premises solution to Azure, the Azure Data Architecture Guidelines are an essential resource for any organization looking to harness the power of data in the cloud. With these guidelines, you will gain a deep understanding of the principles and best practices of Azure data architecture and be equipped to build data solutions that are highly scalable, secure, and cost effective. What You Need to Use this Book? To use this book, it is recommended that readers have a basic understanding of data architecture concepts and data management principles. Some familiarity with cloud computing and Azure services is also helpful. The book is designed for data architects, data engineers, data analysts, and anyone involved in designing, implementing, and managing data solutions on the Azure cloud platform. It is also suitable for students and professionals who want to learn about Azure data architecture and its best practices.

AWS for Solutions Architects

Author : Saurabh Shrivastava,Neelanjali Srivastav,Alberto Artasanchez,Imtiaz Sayed,Dr. Siddhartha Choubey Ph.D
Publisher : Packt Publishing Ltd
Page : 693 pages
File Size : 55,7 Mb
Release : 2023-04-28
Category : Computers
ISBN : 9781803244822

Get Book

AWS for Solutions Architects by Saurabh Shrivastava,Neelanjali Srivastav,Alberto Artasanchez,Imtiaz Sayed,Dr. Siddhartha Choubey Ph.D Pdf

Become a master Solutions Architect with this comprehensive guide, featuring cloud design patterns and real-world solutions for building scalable, secure, and highly available systems Purchase of the print or Kindle book includes a free eBook in PDF format. Key Features Gain expertise in automating, networking, migrating, and adopting cloud technologies using AWS Use streaming analytics, big data, AI/ML, IoT, quantum computing, and blockchain to transform your business Upskill yourself as an AWS solutions architect and explore details of the new AWS certification Book Description Are you excited to harness the power of AWS and unlock endless possibilities for your business? Look no further than the second edition of AWS for Solutions Architects! Packed with all-new content, this book is a must-have guide for anyone looking to build scalable cloud solutions and drive digital transformation using AWS. This updated edition offers in-depth guidance for building cloud solutions using AWS. It provides detailed information on AWS well-architected design pillars and cloud-native design patterns. You'll learn about networking in AWS, big data and streaming data processing, CloudOps, and emerging technologies such as machine learning, IoT, and blockchain. Additionally, the book includes new sections on storage in AWS, containers with ECS and EKS, and data lake patterns, providing you with valuable insights into designing industry-standard AWS architectures that meet your organization's technological and business requirements. Whether you're an experienced solutions architect or just getting started with AWS, this book has everything you need to confidently build cloud-native workloads and enterprise solutions. What you will learn Optimize your Cloud Workload using the AWS Well-Architected Framework Learn methods to migrate your workload using the AWS Cloud Adoption Framework Apply cloud automation at various layers of application workload to increase efficiency Build a landing zone in AWS and hybrid cloud setups with deep networking techniques Select reference architectures for business scenarios, like data lakes, containers, and serverless apps Apply emerging technologies in your architecture, including AI/ML, IoT and blockchain Who this book is for This book is for application and enterprise architects, developers, and operations engineers who want to become well versed with AWS architectural patterns, best practices, and advanced techniques to build scalable, secure, highly available, highly tolerant, and cost-effective solutions in the cloud. Existing AWS users are bound to learn the most, but it will also help those curious about how leveraging AWS can benefit their organization. Prior knowledge of any computing language is not needed, and there's little to no code. Prior experience in software architecture design will prove helpful.

Architecting Modern Data Platforms

Author : Jan Kunigk,Ian Buss,Paul Wilkinson,Lars George
Publisher : O'Reilly Media
Page : 633 pages
File Size : 46,9 Mb
Release : 2018-12-05
Category : Computers
ISBN : 9781491969243

Get Book

Architecting Modern Data Platforms by Jan Kunigk,Ian Buss,Paul Wilkinson,Lars George Pdf

There’s a lot of information about big data technologies, but splicing these technologies into an end-to-end enterprise data platform is a daunting task not widely covered. With this practical book, you’ll learn how to build big data infrastructure both on-premises and in the cloud and successfully architect a modern data platform. Ideal for enterprise architects, IT managers, application architects, and data engineers, this book shows you how to overcome the many challenges that emerge during Hadoop projects. You’ll explore the vast landscape of tools available in the Hadoop and big data realm in a thorough technical primer before diving into: Infrastructure: Look at all component layers in a modern data platform, from the server to the data center, to establish a solid foundation for data in your enterprise Platform: Understand aspects of deployment, operation, security, high availability, and disaster recovery, along with everything you need to know to integrate your platform with the rest of your enterprise IT Taking Hadoop to the cloud: Learn the important architectural aspects of running a big data platform in the cloud while maintaining enterprise security and high availability

Data Engineering with AWS

Author : Gareth Eagar
Publisher : Packt Publishing Ltd
Page : 482 pages
File Size : 55,7 Mb
Release : 2021-12-29
Category : Computers
ISBN : 9781800569041

Get Book

Data Engineering with AWS by Gareth Eagar Pdf

The missing expert-led manual for the AWS ecosystem — go from foundations to building data engineering pipelines effortlessly Purchase of the print or Kindle book includes a free eBook in the PDF format. Key Features Learn about common data architectures and modern approaches to generating value from big data Explore AWS tools for ingesting, transforming, and consuming data, and for orchestrating pipelines Learn how to architect and implement data lakes and data lakehouses for big data analytics from a data lakes expert Book DescriptionWritten by a Senior Data Architect with over twenty-five years of experience in the business, Data Engineering for AWS is a book whose sole aim is to make you proficient in using the AWS ecosystem. Using a thorough and hands-on approach to data, this book will give aspiring and new data engineers a solid theoretical and practical foundation to succeed with AWS. As you progress, you’ll be taken through the services and the skills you need to architect and implement data pipelines on AWS. You'll begin by reviewing important data engineering concepts and some of the core AWS services that form a part of the data engineer's toolkit. You'll then architect a data pipeline, review raw data sources, transform the data, and learn how the transformed data is used by various data consumers. You’ll also learn about populating data marts and data warehouses along with how a data lakehouse fits into the picture. Later, you'll be introduced to AWS tools for analyzing data, including those for ad-hoc SQL queries and creating visualizations. In the final chapters, you'll understand how the power of machine learning and artificial intelligence can be used to draw new insights from data. By the end of this AWS book, you'll be able to carry out data engineering tasks and implement a data pipeline on AWS independently.What you will learn Understand data engineering concepts and emerging technologies Ingest streaming data with Amazon Kinesis Data Firehose Optimize, denormalize, and join datasets with AWS Glue Studio Use Amazon S3 events to trigger a Lambda process to transform a file Run complex SQL queries on data lake data using Amazon Athena Load data into a Redshift data warehouse and run queries Create a visualization of your data using Amazon QuickSight Extract sentiment data from a dataset using Amazon Comprehend Who this book is for This book is for data engineers, data analysts, and data architects who are new to AWS and looking to extend their skills to the AWS cloud. Anyone new to data engineering who wants to learn about the foundational concepts while gaining practical experience with common data engineering services on AWS will also find this book useful. A basic understanding of big data-related topics and Python coding will help you get the most out of this book but it’s not a prerequisite. Familiarity with the AWS console and core services will also help you follow along.

Amazon Redshift: The Definitive Guide

Author : Rajesh Francis,Rajiv Gupta,Milind Oke
Publisher : "O'Reilly Media, Inc."
Page : 523 pages
File Size : 42,6 Mb
Release : 2023-10-03
Category : Electronic
ISBN : 9781098135263

Get Book

Amazon Redshift: The Definitive Guide by Rajesh Francis,Rajiv Gupta,Milind Oke Pdf

Amazon Redshift powers analytic cloud data warehouses worldwide, from startups to some of the largest enterprise data warehouses available today. This practical guide thoroughly examines this managed service and demonstrates how you can use it to extract value from your data immediately, rather than go through the heavy lifting required to run a typical data warehouse. Analytic specialists Rajesh Francis, Rajiv Gupta, and Milind Oke detail Amazon Redshift's underlying mechanisms and options to help you explore out-of-the box automation. Whether you're a data engineer who wants to learn the art of the possible or a DBA looking to take advantage of machine learning-based auto-tuning, this book helps you get the most value from Amazon Redshift. By understanding Amazon Redshift features, you'll achieve excellent analytic performance at the best price, with the least effort. This book helps you: Build a cloud data strategy around Amazon Redshift as foundational data warehouse Get started with Amazon Redshift with simple-to-use data models and design best practices Understand how and when to use Redshift Serverless and Redshift provisioned clusters Take advantage of auto-tuning options inherent in Amazon Redshift and understand manual tuning options Transform your data platform for predictive analytics using Redshift ML and break silos using data sharing Learn best practices for security, monitoring, resilience, and disaster recovery Leverage Amazon Redshift integration with other AWS services to unlock additional value