Google Bigquery

Google Bigquery Book in PDF, ePub and Kindle version is available to download in english. Read online anytime anywhere directly from your device. Click on the download button below to get a free pdf file of Google Bigquery book. This book definitely worth reading, it is an incredibly well-written.

Learning Google BigQuery

Author : Eric Brown,Thirukkumaran Haridass
Publisher : Packt Publishing Ltd
Page : 255 pages
File Size : 52,6 Mb
Release : 2017-12-22
Category : Computers
ISBN : 9781787286290

Get Book

Learning Google BigQuery by Eric Brown,Thirukkumaran Haridass Pdf

Get a fundamental understanding of how Google BigQuery works by analyzing and querying large datasets About This Book Get started with BigQuery API and write custom applications using it Learn how BigQuery API can be used for storing, managing, and query massive datasets with ease A practical guide with examples and use-cases to teach you everything you need to know about Google BigQuery Who This Book Is For If you are a developer, data analyst, or a data scientist looking to run complex queries over thousands of records in seconds, this book will help you. No prior experience of working with BigQuery is assumed. What You Will Learn Get a hands-on introduction to Google Cloud Platform and its services Understand the different data types supported by Google BigQuery Migrate your enterprise data to BigQuery and query it using the legacy and standard SQL techniques Use partition tables in your project and query external data sources and wild card tables Create tables and data sets dynamically using the BigQuery API Perform real-time inserting of records for analytics using Python and C# Visualize your BigQuery data by connecting it to third party tools such as Tableau and R Master the Google Cloud Pub/Sub for implementing real-time reporting and analytics of your Big Data In Detail Google BigQuery is a popular cloud data warehouse for large-scale data analytics. This book will serve as a comprehensive guide to mastering BigQuery, and how you can utilize it to quickly and efficiently get useful insights from your Big Data. You will begin with getting a quick overview of the Google Cloud Platform and the various services it supports. Then, you will be introduced to the Google BigQuery API and how it fits within in the framework of GCP. The book covers useful techniques to migrate your existing data from your enterprise to Google BigQuery, as well as readying and optimizing it for analysis. You will perform basic as well as advanced data querying using BigQuery, and connect the results to various third party tools for reporting and visualization purposes such as R and Tableau. If you're looking to implement real-time reporting of your streaming data running in your enterprise, this book will also help you. This book also provides tips, best practices and mistakes to avoid while working with Google BigQuery and services that interact with it. By the time you're done with it, you will have set a solid foundation in working with BigQuery to solve even the trickiest of data problems. Style and Approach This book follows a step-by-step approach to teach readers the concepts of Google BigQuery using SQL. To explain various data querying processes, large-scale datasets are used wherever required.

Google BigQuery Analytics

Author : Jordan Tigani,Siddartha Naidu
Publisher : John Wiley & Sons
Page : 528 pages
File Size : 53,8 Mb
Release : 2014-05-21
Category : Computers
ISBN : 9781118824795

Get Book

Google BigQuery Analytics by Jordan Tigani,Siddartha Naidu Pdf

How to effectively use BigQuery, avoid common mistakes, and execute sophisticated queries against large datasets Google BigQuery Analytics is the perfect guide for business and data analysts who want the latest tips on running complex queries and writing code to communicate with the BigQuery API. The book uses real-world examples to demonstrate current best practices and techniques, and also explains and demonstrates streaming ingestion, transformation via Hadoop in Google Compute engine, AppEngine datastore integration, and using GViz with Tableau to generate charts of query results. In addition to the mechanics of BigQuery, the book also covers the architecture of the underlying Dremel query engine, providing a thorough understanding that leads to better query results. Features a companion website that includes all code and data sets from the book Uses real-world examples to explain everything analysts need to know to effectively use BigQuery Includes web application examples coded in Python

Google BigQuery: The Definitive Guide

Author : Valliappa Lakshmanan,Jordan Tigani
Publisher : "O'Reilly Media, Inc."
Page : 522 pages
File Size : 40,5 Mb
Release : 2019-10-23
Category : Computers
ISBN : 9781492044413

Get Book

Google BigQuery: The Definitive Guide by Valliappa Lakshmanan,Jordan Tigani Pdf

Work with petabyte-scale datasets while building a collaborative, agile workplace in the process. This practical book is the canonical reference to Google BigQuery, the query engine that lets you conduct interactive analysis of large datasets. BigQuery enables enterprises to efficiently store, query, ingest, and learn from their data in a convenient framework. With this book, you’ll examine how to analyze data at scale to derive insights from large datasets efficiently. Valliappa Lakshmanan, tech lead for Google Cloud Platform, and Jordan Tigani, engineering director for the BigQuery team, provide best practices for modern data warehousing within an autoscaled, serverless public cloud. Whether you want to explore parts of BigQuery you’re not familiar with or prefer to focus on specific tasks, this reference is indispensable.

Google BigQuery Analytics

Author : Jordan Tigani
Publisher : CreateSpace
Page : 530 pages
File Size : 48,7 Mb
Release : 2014-10-05
Category : Computers
ISBN : 1502703211

Get Book

Google BigQuery Analytics by Jordan Tigani Pdf

How to effectively use BigQuery, avoid common mistakes, and execute sophisticated queries against large datasets Google BigQuery Analytics is the perfect guide for business and data analysts who want the latest tips on running complex queries and writing code to communicate with the BigQuery API. The book uses real-world examples to demonstrate current best practices and techniques, and also explains and demonstrates streaming ingestion, transformation via Hadoop in Google Compute engine, AppEngine datastore integration, and using GViz with Tableau to generate charts of query results. In addition to the mechanics of BigQuery, the book also covers the architecture of the underlying Dremel query engine, providing a thorough understanding that leads to better query results. Features a companion website that includes all code and data sets from the book Uses real-world examples to explain everything analysts need to know to effectively use BigQuery Includes web application examples coded in Python

Planning for Big Data

Author : Edd Wilder-James
Publisher : "O'Reilly Media, Inc."
Page : 83 pages
File Size : 46,7 Mb
Release : 2012-03-12
Category : Computers
ISBN : 9781449329648

Get Book

Planning for Big Data by Edd Wilder-James Pdf

In an age where everything is measurable, understanding big data is an essential. From creating new data-driven products through to increasing operational efficiency, big data has the potential to make your organization both more competitive and more innovative. As this emerging field transitions from the bleeding edge to enterprise infrastructure, it's vital to understand not only the technologies involved, but the organizational and cultural demands of being data-driven. Written by O'Reilly Radar's experts on big data, this anthology describes: The broad industry changes heralded by the big data era What big data is, what it means to your business, and how to start solving data problems The software that makes up the Hadoop big data stack, and the major enterprise vendors' Hadoop solutions The landscape of NoSQL databases and their relative merits How visualization plays an important part in data work

Enabling Blockchain Technology for Secure Networking and Communications

Author : Ben Mnaouer, Adel,Fourati, Lamia Chaari
Publisher : IGI Global
Page : 339 pages
File Size : 54,6 Mb
Release : 2021-06-11
Category : Computers
ISBN : 9781799858416

Get Book

Enabling Blockchain Technology for Secure Networking and Communications by Ben Mnaouer, Adel,Fourati, Lamia Chaari Pdf

In recent years, the surge of blockchain technology has been rising due to is proven reliability in ensuring secure and effective transactions, even between untrusted parties. Its application is broad and covers public and private domains varying from traditional communication networks to more modern networks like the internet of things and the internet of energy crossing fog and edge computing, among others. As technology matures and its standard use cases are established, there is a need to gather recent research that can shed light on several aspects and facts on the use of blockchain technology in different fields of interest. Enabling Blockchain Technology for Secure Networking and Communications consolidates the recent research initiatives directed towards exploiting the advantages of blockchain technology for benefiting several areas of applications that vary from security and robustness to scalability and privacy-preserving and more. The chapters explore the current applications of blockchain for networking and communications, the future potentials of blockchain technology, and some not-yet-prospected areas of research and its application. This book is ideal for practitioners, stakeholders, researchers, academicians, and students interested in the concepts of blockchain technology and the potential and pitfalls of its application in different utilization domains.

Google Bigquery

Author : Valliappa Lakshmanan,Jordan Tigani
Publisher : Unknown
Page : 0 pages
File Size : 45,7 Mb
Release : 2019
Category : Big data
ISBN : 1492044458

Get Book

Google Bigquery by Valliappa Lakshmanan,Jordan Tigani Pdf

Work with petabyte-scale datasets while building a collaborative, agile workplace in the process. This practical book is the canonical reference to Google BigQuery, the query engine that lets you conduct interactive analysis of large datasets. BigQuery enables enterprises to efficiently store, query, ingest, and learn from their data in a convenient framework. With this book, you'll examine how to analyze data at scale to derive insights from large datasets efficiently. Valliappa Lakshmanan, tech lead for Google Cloud Platform, and Jordan Tigani, engineering director for the BigQuery team, provide best practices for modern data warehousing within an autoscaled, serverless public cloud. Whether you want to explore parts of BigQuery you're not familiar with or prefer to focus on specific tasks, this reference is indispensable.

BigQuery for Data Warehousing

Author : Mark Mucchetti
Publisher : Apress
Page : 400 pages
File Size : 50,6 Mb
Release : 2020-12-20
Category : Computers
ISBN : 1484261852

Get Book

BigQuery for Data Warehousing by Mark Mucchetti Pdf

Create a data warehouse, complete with reporting and dashboards using Google’s BigQuery technology. This book takes you from the basic concepts of data warehousing through the design, build, load, and maintenance phases. You will build capabilities to capture data from the operational environment, and then mine and analyze that data for insight into making your business more successful. You will gain practical knowledge about how to use BigQuery to solve data challenges in your organization. BigQuery is a managed cloud platform from Google that provides enterprise data warehousing and reporting capabilities. Part I of this book shows you how to design and provision a data warehouse in the BigQuery platform. Part II teaches you how to load and stream your operational data into the warehouse to make it ready for analysis and reporting. Parts III and IV cover querying and maintaining, helping you keep your information relevant with other Google Cloud Platform services and advanced BigQuery. Part V takes reporting to the next level by showing you how to create dashboards to provide at-a-glance visual representations of your business situation. Part VI provides an introduction to data science with BigQuery, covering machine learning and Jupyter notebooks. What You Will Learn Design a data warehouse for your project or organization Load data from a variety of external and internal sources Integrate other Google Cloud Platform services for more complex workflows Maintain and scale your data warehouse as your organization grows Analyze, report, and create dashboards on the information in the warehouse Become familiar with machine learning techniques using BigQuery ML Who This Book Is For Developers who want to provide business users with fast, reliable, and insightful analysis from operational data, and data analysts interested in a cloud-based solution that avoids the pain of provisioning their own servers.

Data Exploration and Preparation with BigQuery

Author : Mike Kahn
Publisher : Packt Publishing Ltd
Page : 264 pages
File Size : 45,7 Mb
Release : 2023-11-29
Category : Computers
ISBN : 9781805123422

Get Book

Data Exploration and Preparation with BigQuery by Mike Kahn Pdf

Leverage BigQuery to understand and prepare your data to ensure that it's accurate, reliable, and ready for analysis and modeling Key Features Use mock datasets to explore data with the BigQuery web UI, bq CLI, and BigQuery API in the Cloud console Master optimization techniques for storage and query performance in BigQuery Engage with case studies on data exploration and preparation for advertising, transportation, and customer support data Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionData professionals encounter a multitude of challenges such as handling large volumes of data, dealing with data silos, and the lack of appropriate tools. Datasets often arrive in different conditions and formats, demanding considerable time from analysts, engineers, and scientists to process and uncover insights. The complexity of the data life cycle often hinders teams and organizations from extracting the desired value from their data assets. Data Exploration and Preparation with BigQuery offers a holistic solution to these challenges. The book begins with the basics of BigQuery while covering the fundamentals of data exploration and preparation. It then progresses to demonstrate how to use BigQuery for these tasks and explores the array of big data tools at your disposal within the Google Cloud ecosystem. The book doesn’t merely offer theoretical insights; it’s a hands-on companion that walks you through properly structuring your tables for query efficiency and ensures adherence to data preparation best practices. You’ll also learn when to use Dataflow, BigQuery, and Dataprep for ETL and ELT workflows. The book will skillfully guide you through various case studies, demonstrating how BigQuery can be used to solve real-world data problems. By the end of this book, you’ll have mastered the use of SQL to explore and prepare datasets in BigQuery, unlocking deeper insights from data.What you will learn Assess the quality of a dataset and learn best practices for data cleansing Prepare data for analysis, visualization, and machine learning Explore approaches to data visualization in BigQuery Apply acquired knowledge to real-life scenarios and design patterns Set up and organize BigQuery resources Use SQL and other tools to navigate datasets Implement best practices to query BigQuery datasets Gain proficiency in using data preparation tools, techniques, and strategies Who this book is for This book is for data analysts seeking to enhance their data exploration and preparation skills using BigQuery. It guides anyone using BigQuery as a data warehouse to extract business insights from large datasets. A basic understanding of SQL, reporting, data modeling, and transformations will assist with understanding the topics covered in this book.

Handbook of Intelligent Computing and Optimization for Sustainable Development

Author : Mukhdeep Singh Manshahia,Valeriy Kharchenko,Elias Munapo,J. Joshua Thomas,Pandian Vasant
Publisher : John Wiley & Sons
Page : 948 pages
File Size : 50,7 Mb
Release : 2022-03-15
Category : Technology & Engineering
ISBN : 9781119791829

Get Book

Handbook of Intelligent Computing and Optimization for Sustainable Development by Mukhdeep Singh Manshahia,Valeriy Kharchenko,Elias Munapo,J. Joshua Thomas,Pandian Vasant Pdf

HANDBOOK OF INTELLIGENT COMPUTING AND OPTIMIZATION FOR SUSTAINABLE DEVELOPMENT This book provides a comprehensive overview of the latest breakthroughs and recent progress in sustainable intelligent computing technologies, applications, and optimization techniques across various industries. Optimization has received enormous attention along with the rapidly increasing use of communication technology and the development of user-friendly software and artificial intelligence. In almost all human activities, there is a desire to deliver the highest possible results with the least amount of effort. Moreover, optimization is a very well-known area with a vast number of applications, from route finding problems to medical treatment, construction, finance, accounting, engineering, and maintenance schedules in plants. As far as optimization of real-world problems is concerned, understanding the nature of the problem and grouping it in a proper class may help the designer employ proper techniques which can solve the problem efficiently. Many intelligent optimization techniques can find optimal solutions without the use of objective function and are less prone to local conditions. The 41 chapters comprising the Handbook of Intelligent Computing and Optimization for Sustainable Development by subject specialists, represent diverse disciplines such as mathematics and computer science, electrical and electronics engineering, neuroscience and cognitive sciences, medicine, and social sciences, and provide the reader with an integrated understanding of the importance that intelligent computing has in the sustainable development of current societies. It discusses the emerging research exploring the theoretical and practical aspects of successfully implementing new and innovative intelligent techniques in a variety of sectors, including IoT, manufacturing, optimization, and healthcare. Audience It is a pivotal reference source for IT specialists, industry professionals, managers, executives, researchers, scientists, and engineers seeking current research in emerging perspectives in the field of artificial intelligence in the areas of Internet of Things, renewable energy, optimization, and smart cities.

Ethical Hacking

Author : Alana Maurushat
Publisher : University of Ottawa Press
Page : 273 pages
File Size : 50,8 Mb
Release : 2019-04-09
Category : Law
ISBN : 9780776627939

Get Book

Ethical Hacking by Alana Maurushat Pdf

How will governments and courts protect civil liberties in this new era of hacktivism? Ethical Hacking discusses the attendant moral and legal issues. The first part of the 21st century will likely go down in history as the era when ethical hackers opened governments and the line of transparency moved by force. One need only read the motto “we open governments” on the Twitter page for Wikileaks to gain a sense of the sea change that has occurred. Ethical hacking is the non-violent use of a technology in pursuit of a cause—political or otherwise—which is often legally and morally ambiguous. Hacktivists believe in two general but spirited principles: respect for human rights and fundamental freedoms, including freedom of expression and personal privacy; and the responsibility of government to be open, transparent and fully accountable to the public. How courts and governments will deal with hacking attempts which operate in a grey zone of the law and where different ethical views collide remains to be seen. What is undisputed is that Ethical Hacking presents a fundamental discussion of key societal questions. A fundamental discussion of key societal questions. This book is published in English. - La première moitié du XXIe siècle sera sans doute reconnue comme l’époque où le piratage éthique a ouvert de force les gouvernements, déplaçant les limites de la transparence. La page twitter de Wikileaks enchâsse cet ethos à même sa devise, « we open governments », et sa volonté d’être omniprésent. En parallèle, les grandes sociétés de technologie comme Apple se font compétition pour produire des produits de plus en plus sécuritaires et à protéger les données de leurs clients, alors même que les gouvernements tentent de limiter et de décrypter ces nouvelles technologies d’encryption. Entre-temps, le marché des vulnérabilités en matière de sécurité augmente à mesure que les experts en sécurité informatique vendent des vulnérabilités de logiciels des grandes technologies, dont Apple et Google, contre des sommes allant de 10 000 à 1,5 million de dollars. L’activisme en sécurité est à la hausse. Le piratage éthique est l’utilisation non-violence d’une technologie quelconque en soutien d’une cause politique ou autre qui est souvent ambigue d’un point de vue juridique et moral. Le hacking éthique peut désigner les actes de vérification de pénétration professionnelle ou d’experts en sécurité informatique, de même que d’autres formes d’actions émergentes, comme l’hacktivisme et la désobéissance civile en ligne. L’hacktivisme est une forme de piratage éthique, mais également une forme de militantisme des droits civils à l’ère numérique. En principe, les adeptes du hacktivisme croient en deux grands principes : le respect des droits de la personne et les libertés fondamentales, y compris la liberté d’expression et à la vie privée, et la responsabilité des gouvernements d’être ouverts, transparents et pleinement redevables au public. En pratique, toutefois, les antécédents comme les agendas des hacktivistes sont fort diversifiés. Il n’est pas clair de quelle façon les tribunaux et les gouvernements traiteront des tentatives de piratage eu égard aux zones grises juridiques, aux approches éthiques conflictuelles, et compte tenu du fait qu’il n’existe actuellement, dans le monde, presque aucune exception aux provisions, en matière de cybercrime et de crime informatique, liées à la recherche sur la sécurité ou l’intérêt public. Il sera également difficile de déterminer le lien entre hacktivisme et droits civils. Ce livre est publié en anglais.

Machine Learning with BigQuery ML

Author : Alessandro Marrandino
Publisher : Packt Publishing Ltd
Page : 344 pages
File Size : 51,5 Mb
Release : 2021-06-11
Category : Computers
ISBN : 9781800562189

Get Book

Machine Learning with BigQuery ML by Alessandro Marrandino Pdf

Manage different business scenarios with the right machine learning technique using Google's highly scalable BigQuery ML Key FeaturesGain a clear understanding of AI and machine learning services on GCP, learn when to use these, and find out how to integrate them with BigQuery MLLeverage SQL syntax to train, evaluate, test, and use ML modelsDiscover how BigQuery works and understand the capabilities of BigQuery ML using examplesBook Description BigQuery ML enables you to easily build machine learning (ML) models with SQL without much coding. This book will help you to accelerate the development and deployment of ML models with BigQuery ML. The book starts with a quick overview of Google Cloud and BigQuery architecture. You'll then learn how to configure a Google Cloud project, understand the architectural components and capabilities of BigQuery, and find out how to build ML models with BigQuery ML. The book teaches you how to use ML using SQL on BigQuery. You'll analyze the key phases of a ML model's lifecycle and get to grips with the SQL statements used to train, evaluate, test, and use a model. As you advance, you'll build a series of use cases by applying different ML techniques such as linear regression, binary and multiclass logistic regression, k-means, ARIMA time series, deep neural networks, and XGBoost using practical use cases. Moving on, you'll cover matrix factorization and deep neural networks using BigQuery ML's capabilities. Finally, you'll explore the integration of BigQuery ML with other Google Cloud Platform components such as AI Platform Notebooks and TensorFlow along with discovering best practices and tips and tricks for hyperparameter tuning and performance enhancement. By the end of this BigQuery book, you'll be able to build and evaluate your own ML models with BigQuery ML. What you will learnDiscover how to prepare datasets to build an effective ML modelForecast business KPIs by leveraging various ML models and BigQuery MLBuild and train a recommendation engine to suggest the best products for your customers using BigQuery MLDevelop, train, and share a BigQuery ML model from previous parts with AI Platform NotebooksFind out how to invoke a trained TensorFlow model directly from BigQueryGet to grips with BigQuery ML best practices to maximize your ML performanceWho this book is for This book is for data scientists, data analysts, data engineers, and anyone looking to get started with Google's BigQuery ML. You'll also find this book useful if you want to accelerate the development of ML models or if you are a business user who wants to apply ML in an easy way using SQL. Basic knowledge of BigQuery and SQL is required.

Developing Blockchain Solutions in the Cloud

Author : Stefano Tempesta,Michael John Peña
Publisher : Packt Publishing Ltd
Page : 380 pages
File Size : 41,6 Mb
Release : 2024-04-26
Category : Technology & Engineering
ISBN : 9781837638871

Get Book

Developing Blockchain Solutions in the Cloud by Stefano Tempesta,Michael John Peña Pdf

Learn how to implement, deploy, and manage blockchain solutions across AWS, Azure, and GCP with the help of hands-on labs and real-world use cases Key Features Learn architecture design patterns and access code samples for building Web3 apps in the cloud Master the latest tools and cloud technologies for integrating DevOps in blockchain applications Strengthen your understanding of cloud-native blockchain through real-world use cases and best practices Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionAs Web3 technologies continue to gain momentum across industries, businesses are looking for new ways to leverage the benefits of Web3 and stay at the forefront of technological innovation. This comprehensive guide offers an in-depth exploration of cloud-native blockchain fundamentals, providing valuable insights into the benefits and challenges of deploying these technologies in the cloud. From foundational concepts to advanced techniques, the book covers everything you need to know about developing and deploying secure, scalable blockchain solutions on AWS, Azure, and GCP. Through hands-on tutorials and projects, you’ll explore the latest tools, technologies, real-world use cases, and best practices to expand your understanding of the field’s complexities and opportunities. This book ensures easy comprehension through practical examples and access to source code on GitHub. As you advance, you’ll master platform selection and apply your newfound knowledge to tackle complex problems and deliver innovative cloud-native blockchain solutions tailored for your specific needs. By the end of this book, you’ll have a deep understanding of cloud-native blockchain deployment and implementation, and you’ll be equipped with the skills and knowledge to build secure and scalable solutions.What you will learn Discover the benefits and challenges of deploying Web3 solutions in the cloud Deploy secure and scalable blockchain networks leveraging AWS, Azure, and GCP resources Follow step-by-step tutorials and code samples to build Web3 solutions in the cloud Use hosted Kubernetes platforms, such as EKS, AKS, and GKE, for custom blockchains Compare the blockchain capabilities and offerings of AWS, Azure, and Google Cloud Familiarize yourself with the tools and techniques for automating DevOps practices tailored to Web3 apps Who this book is for The book is for cloud developers and DevOps engineers who want to leverage blockchain technologies in their cloud-native solutions. Whether you’re an IT professional deploying and maintaining Web3 solutions in the enterprise or in public settings, or a business leader evaluating blockchain's potential, this resource is invaluable. Entrepreneurs, students, academics, and hobbyists exploring the latest Web3 development trends will also benefit from this book. Prior knowledge of cloud computing and blockchain concepts is recommended to make the best use of the expert insights, hands-on tutorials, and real-world use cases presented.

Google Cloud Platform an Architect's Guide

Author : Alasdair Gilchrist
Publisher : Alasdair Gilchrist
Page : 607 pages
File Size : 41,5 Mb
Release : 2024-07-02
Category : Computers
ISBN : 8210379456XXX

Get Book

Google Cloud Platform an Architect's Guide by Alasdair Gilchrist Pdf

Learn fundamental to advanced GCP architectural techniques using 30 + real-world use cases. The 'Google Cloud Platform an Architect's Guide' is a comprehensive handbook that covers everything that you need to know from GCP fundamentals to advanced cloud architecture topics. The book covers what you need to understand to pass the Google certification exams but goes far further and deeper as it explores real-world use cases and business scenarios. But you don't need to be an IT expert as the book is designed to cater for both beginners and those experienced in other cloud or on other on-premises networks. To that end, the book is split into distinct parts that caters for all levels of expertise. Part -1 is aimed at the novice someone new to a cloud architecture environment that needs to become familiar with the fundamentals of cloud architecture and industry best practices so the more experienced reader may wish to skip this section. Part-2 takes a far deeper dive into GCP theory and practice as well as providing real-world use cases and practical tips that are beneficial for architects at all levels. Part-3 delves much deeper into GCP practical theory on elasticity, scalability and resilience. It also covers Kubernetes in greater detail and touches on High-Performance Computing and IoT designs. The book closes with a final part dealing with cloud-native design practices and as such it covers design, monitoring, notification and remediation techniques to ensure best practice in cloud-native application design, deployment, stabilisation and commissioning.

Google Cloud Platform for Data Engineering

Author : Alasdair Gilchrist
Publisher : Alasdair Gilchrist
Page : 357 pages
File Size : 41,8 Mb
Release : 2024-07-02
Category : Computers
ISBN : 8210379456XXX

Get Book

Google Cloud Platform for Data Engineering by Alasdair Gilchrist Pdf

Google Cloud Platform for Data Engineering is designed to take the beginner through a journey to become a competent and certified GCP data engineer. The book, therefore, is split into three parts; the first part covers fundamental concepts of data engineering and data analysis from a platform and technology-neutral perspective. Reading part 1 will bring a beginner up to speed with the generic concepts, terms and technologies we use in data engineering. The second part, which is a high-level but comprehensive introduction to all the concepts, components, tools and services available to us within the Google Cloud Platform. Completing this section will provide the beginner to GCP and data engineering with a solid foundation on the architecture and capabilities of the GCP. Part 3, however, is where we delve into the moderate to advanced techniques that data engineers need to know and be able to carry out. By this time the raw beginner you started the journey at the beginning of part 1 will be a knowledgable albeit inexperienced data engineer. However, by the conclusion of part 3, they will have gained the advanced knowledge of data engineering techniques and practices on the GCP to pass not only the certification exam but also most interviews and practical tests with confidence. In short part 3, will provide the prospective data engineer with detailed knowledge on setting up and configuring DataProc - GCPs version of the Spark/Hadoop ecosystem for big data. They will also learn how to build and test streaming and batch data pipelines using pub/sub/ dataFlow and BigQuery. Furthermore, they will learn how to integrate all the ML and AI Platform components and APIs. They will be accomplished in connecting data analysis and visualisation tools such as Datalab, DataStudio and AI notebooks amongst others. They will also by now know how to build and train a TensorFlow DNN using APIs and Keras and optimise it to run large public data sets. Also, they will know how to provision and use Kubeflow and Kube Pipelines within Google Kubernetes engines to run container workloads as well as how to take advantage of serverless technologies such as Cloud Run and Cloud Functions to build transparent and seamless data processing platforms. The best part of the book though is its compartmental design which means that anyone from a beginner to an intermediate can join the book at whatever point they feel comfortable.