Big Data & Machine Learning 1 2 Agenda 3 5 Message-oriented architectures 6 7 Serverless data pipelines 8 GCP Reference Architecture 9 10 11 12 13 14 15 16 17 Big Data & Machine Learning Cloud OnBoard 1 2 1 Asynchronous processing is useful for 3 P1 P2 P3 Producers 2 long-lived tasks or to have loose 5 3 coupling between two systems 6 5 7 6 8 7 9 Potential use cases: 8 Message 10 9 Queue 1. Send an SMS 11 2. Train ML model 10 12 3. Process data from multiple sources 11 4. Weekly reports … 13 12 14 13 15 14 16 15 C1 C2 C3 Consumers 1716 17 18 71
Google Cloud Manual Page 72 Page 74