中圖網小程序
一鍵登錄
更方便
本類五星書更多>
-
>
全國計算機等級考試最新真考題庫模擬考場及詳解·二級MSOffice高級應用
-
>
決戰行測5000題(言語理解與表達)
-
>
軟件性能測試.分析與調優實踐之路
-
>
第一行代碼Android
-
>
JAVA持續交付
-
>
EXCEL最強教科書(完全版)(全彩印刷)
-
>
深度學習
精通APACHE PULSAR:可伸縮云原生事件流實踐 版權信息
- ISBN：9787121467172
- 條形碼：9787121467172 ; 978-7-121-46717-2
- 裝幀：平裝-膠訂
- 冊數：暫無
- 重量：暫無
- 所屬分類：>>
精通APACHE PULSAR:可伸縮云原生事件流實踐 本書特色
本書抽絲剝繭，用生活實例輕松開啟消息系統之旅， 溯本求源，介紹Pulsar的前世今生與靈感來源， 環環相扣，剖析Pulsar的四大組件和五大功能特性， 實戰指導，展示實現*佳部署和運維的不二法寶。
精通APACHE PULSAR:可伸縮云原生事件流實踐 內容簡介
本書專為想要學習并掌握Apache Pulsar的讀者打造，是一本入門圖書。全書共有13章內容。第1章和第2章，從生活實例中引入實時消息系統和事件驅動的概念，幫助大家理解Apache Pulsar系統存在的必要性，以及Pulsar的獨特性和價值定位。第3章介紹了Pulsar在雅虎的起源故事、設計理念與應用場景。第4章探究了Pulsar內部的主要組件及其工作原理，幫助大家構建對Pulsar的整體架構認知。第5章到第10章，詳細介紹了Pulsar消費者、生產者的工作原理，應用于生產和消費消息且與第三方系統交互的框架Pulsar IO，以及Pulsar Functions、分層存儲、Pulsar SQL等Pulsar的獨特理念和關鍵特性。第11章與第12章，展示了如何在諸多環境中部署Pulsar，以及在運維Pulsar的過程中需要關注的指標。在第13章中，作者結合個人經驗闡述了Pulsar未來值得探索的領域和方向。 本書配圖生動形象，實例豐富，不僅提供了很多代碼示例，還提供了多篇附錄，以作參考。
精通APACHE PULSAR:可伸縮云原生事件流實踐 目錄
前言 ....................................................................................................xvii
第 1 章 實時消息的價值 ........................................................................ 1
流動的數據 ............................................................................................................1
資源效率 ................................................................................................................3
使用場景 ................................................................................................................4
銀行 .................................................................................................................5
醫療 .................................................................................................................6
安全 .................................................................................................................7
物聯網 .............................................................................................................8
小結 .....................................................................................................................10
第 2 章 事件流和事件代理 ................................................................... 11
發布 / 訂閱 ........................................................................................................... 11
隊列 .....................................................................................................................13
故障類型 ..............................................................................................................15
推送與輪詢 ..........................................................................................................15
為什么需要 Pulsar ................................................................................................16
流和隊列的統一 ............................................................................................16
模塊化 ...........................................................................................................16
性能 ...............................................................................................................18
小結 .....................................................................................................................19
第 3 章 認識 Pulsar ............................................................................ 20
Pulsar 的起源 .......................................................................................................20
Pulsar 的設計理念 ................................................................................................21
多租戶 ...........................................................................................................22
跨地域復制 ...................................................................................................23
性能 ...............................................................................................................27
模塊化 ...........................................................................................................27
Pulsar 生態 ...........................................................................................................28
Pulsar Functions ............................................................................................28
Pulsar IO .......................................................................................................29
Pulsar SQL ....................................................................................................30
Pulsar 成功案例 ...................................................................................................30
雅虎日本 .......................................................................................................30
Splunk ...........................................................................................................31
Iterable ..........................................................................................................32
小結 .....................................................................................................................33
第 4 章 Pulsar 內部組件 ..................................................................... 34
Broker ..................................................................................................................34
消息緩存 .......................................................................................................35
與 BookKeeper、ZooKeeper 交互 .................................................................37
Schema 校驗 ..................................................................................................38
Broker 間的通信 ............................................................................................38
Pulsar Functions 和 Pulsar IO ........................................................................39
Apache BookKeeper .............................................................................................39
預寫式日志 ...................................................................................................45
消息存儲 .......................................................................................................45
對象 /Blob 存儲 .............................................................................................46
Pravega ..........................................................................................................47
Majordodo .....................................................................................................47
Apache ZooKeeper ...............................................................................................48
命名服務 .......................................................................................................49
配置管理 .......................................................................................................49
選主 ...............................................................................................................50
通知系統 .......................................................................................................50
Apache Kafka ................................................................................................50
Apache Druid .................................................................................................51
Pulsar Proxy .........................................................................................................52
Java 虛擬機（JVM） .............................................................................................53
Netty ..............................................................................................................54
Apache Spark .................................................................................................55
Apache Lucene ..............................................................................................55
小結 .....................................................................................................................55
第 5 章 消費者 .................................................................................... 56
成為消費者意味著什么 ........................................................................................56
訂閱 .....................................................................................................................57
獨占 ...............................................................................................................60
共享 ...............................................................................................................61
鍵共享 ...........................................................................................................62
故障轉移 .......................................................................................................65
確認 .....................................................................................................................66
單條確認 .......................................................................................................66
累積確認 .......................................................................................................67
Schema .................................................................................................................67
消費者 Schema 管理 .....................................................................................68
消費模式 ..............................................................................................................68
批處理 ...........................................................................................................68
分塊 ...............................................................................................................69
高級配置 ..............................................................................................................70
延遲消息 .......................................................................................................70
保留策略 .......................................................................................................70
堆積限額 .......................................................................................................71
配置消費者 ..........................................................................................................72
回放 ...............................................................................................................73
死信主題 .......................................................................................................75
重試主題 .......................................................................................................76
小結 .....................................................................................................................76
第 6 章 生產者 .................................................................................... 77
同步生產者 ..........................................................................................................77
異步生產者 ..........................................................................................................78
生產者路由 ..........................................................................................................79
輪詢路由 .......................................................................................................79
單分區路由 ...................................................................................................80
定制分區路由 ................................................................................................81
生產者配置 ..........................................................................................................83
topicName .....................................................................................................83
producerName ...............................................................................................83
sendTimeoutMs .............................................................................................83
blockIfQueueFull ...........................................................................................84
maxPendingMessages ....................................................................................84
maxPendingMessagesAcrossPartitions ...........................................................84
messageRoutingMode ....................................................................................84
hashingScheme ..............................................................................................84
cryptoFailureAction .......................................................................................85
batchingMaxPublishDelayMicros ..................................................................85
batchingMaxMessages ...................................................................................85
batchingEnabled ............................................................................................85
compressionType ...........................................................................................85
Schema on Write ..................................................................................................86
使用 Schema Registry ....................................................................................86
非持久化主題 ......................................................................................................89
使用場景 .......................................................................................................90
使用非持久化主題 ........................................................................................90
事務 .....................................................................................................................91
小結 .....................................................................................................................92
第 7 章 Pulsar IO ............................................................................... 93
Pulsar IO 架構 ......................................................................................................93
運行時 ...........................................................................................................94
性能考量 .......................................................................................................94
使用場景 ..............................................................................................................95
簡單事件處理管道 ........................................................................................95
變化數據捕獲 ................................................................................................96
考量 .....................................................................................................................97
消息序列化 ...................................................................................................97
管道穩定性 ...................................................................................................97
故障處理 .......................................................................................................98
示例 .....................................................................................................................99
Elasticsearch ..................................................................................................99
Netty ............................................................................................................ 100
創建自己的連接器 ............................................................................................. 101
TimescaleDB ............................................................................................... 101
小結 ................................................................................................................... 102
第 8 章 Pulsar Functions .................................................................. 103
流處理 ................................................................................................................ 103
Pulsar Functions 架構 ......................................................................................... 105
運行時 ......................................................................................................... 105
隔離性 ......................................................................................................... 106
在 Kubernetes 上部署 Pulsar Functions 的隔離性 .............................................. 107
使用場景 ............................................................................................................ 107
創建 Pulsar Functions .................................................................................. 108
簡單事件處理 .............................................................................................. 108
主題清理 ..................................................................................................... 110
主題數據統計 .............................................................................................. 113
小結 ................................................................................................................... 115
第 9 章 分層存儲 .............................................................................. 116
在云端存儲數據 ................................................................................................. 117
對象存儲 ..................................................................................................... 118
使用場景 ............................................................................................................ 120
復制 ............................................................................................................. 120
CQRS .......................................................................................................... 121
災難恢復 ..................................................................................................... 122
卸載數據 ............................................................................................................ 122
Pulsar Offloader ........................................................................................... 122
檢索已卸載的數據 ............................................................................................. 129
與對象存儲數據交互 ................................................................................... 129
重填主題 ..................................................................................................... 129
使用 Pulsar 客戶端 ...................................................................................... 130
小結 ................................................................................................................... 131
第 10 章 Pulsar SQL ........................................................................ 132
流即表 ................................................................................................................ 133
SQL-on-Anything 引擎 ...................................................................................... 135
Apache Flink: 另一種視角 ........................................................................... 136
Presto/Trino ................................................................................................. 137
Pulsar SQL 的工作原理 ...................................................................................... 138
配置 Pulsar SQL ................................................................................................. 140
性能考量 ............................................................................................................ 142
小結 ................................................................................................................... 143
第 11 章 部署 Pulsar ........................................................................ 144
Docker ................................................................................................................ 144
裸金屬 ................................................................................................................ 146
*低要求 ..................................................................................................... 146
開始安裝 ..................................................................................................... 146
部署 ZooKeeper........................................................................................... 147
啟動 BookKeeper ........................................................................................ 148
啟動 Pulsar .................................................................................................. 148
公有云廠商 ........................................................................................................ 149
AWS ............................................................................................................ 151
Azure ........................................................................................................... 152
Google Cloud Platform ................................................................................ 153
Kubernetes ......................................................................................................... 153
小結 ................................................................................................................... 155
第 12 章 運維 Pulsar ........................................................................ 156
Apache BookKeeper 指標 .................................................................................. 157
服務器指標 ................................................................................................. 157
Journal 指標 ................................................................................................ 158
存儲指標 ..................................................................................................... 159
Apache ZooKeeper 指標 ..................................................................................... 159
服務器指標 ................................................................................................. 160
請求指標 ..................................................................................................... 161
主題指標 ............................................................................................................ 161
消費者指標 ........................................................................................................ 163
Pulsar 事務指標 ................................................................................................. 163
Pulsar Functions 指標 ......................................................................................... 164
高級運維技巧 .................................................................................................... 165
攔截器和追蹤機制 ...................................................................................... 165
Pulsar SQL 指標 .......................................................................................... 167
指標轉發 ............................................................................................................ 169
監控面板 ..................................................................................................... 169
小結 ................................................................................................................... 170
第 13 章 未來 ................................................................................... 171
編程語言支持 .................................................................................................... 171
擴展接口 ..................................................................................................... 171
增強 Pulsar Functions .................................................................................. 172
架構簡化 / 擴展 ........................................................................................... 175
消息平臺橋接器 .......................................................................................... 177
小結 ................................................................................................................... 180
附錄 A Pulsar Admin API ................................................................. 181
附錄 B Pulsar Admin CLI ................................................................. 189
附錄 C 跨地域復制 ........................................................................... 192
附錄 D Pulsar 中的安全、認證和鑒權 ............................................... 198
關于作者 ............................................................................................ 202
封面介紹 ............................................................................................ 202
第 1 章 實時消息的價值 ........................................................................ 1
流動的數據 ............................................................................................................1
資源效率 ................................................................................................................3
使用場景 ................................................................................................................4
銀行 .................................................................................................................5
醫療 .................................................................................................................6
安全 .................................................................................................................7
物聯網 .............................................................................................................8
小結 .....................................................................................................................10
第 2 章 事件流和事件代理 ................................................................... 11
發布 / 訂閱 ........................................................................................................... 11
隊列 .....................................................................................................................13
故障類型 ..............................................................................................................15
推送與輪詢 ..........................................................................................................15
為什么需要 Pulsar ................................................................................................16
流和隊列的統一 ............................................................................................16
模塊化 ...........................................................................................................16
性能 ...............................................................................................................18
小結 .....................................................................................................................19
第 3 章 認識 Pulsar ............................................................................ 20
Pulsar 的起源 .......................................................................................................20
Pulsar 的設計理念 ................................................................................................21
多租戶 ...........................................................................................................22
跨地域復制 ...................................................................................................23
性能 ...............................................................................................................27
模塊化 ...........................................................................................................27
Pulsar 生態 ...........................................................................................................28
Pulsar Functions ............................................................................................28
Pulsar IO .......................................................................................................29
Pulsar SQL ....................................................................................................30
Pulsar 成功案例 ...................................................................................................30
雅虎日本 .......................................................................................................30
Splunk ...........................................................................................................31
Iterable ..........................................................................................................32
小結 .....................................................................................................................33
第 4 章 Pulsar 內部組件 ..................................................................... 34
Broker ..................................................................................................................34
消息緩存 .......................................................................................................35
與 BookKeeper、ZooKeeper 交互 .................................................................37
Schema 校驗 ..................................................................................................38
Broker 間的通信 ............................................................................................38
Pulsar Functions 和 Pulsar IO ........................................................................39
Apache BookKeeper .............................................................................................39
預寫式日志 ...................................................................................................45
消息存儲 .......................................................................................................45
對象 /Blob 存儲 .............................................................................................46
Pravega ..........................................................................................................47
Majordodo .....................................................................................................47
Apache ZooKeeper ...............................................................................................48
命名服務 .......................................................................................................49
配置管理 .......................................................................................................49
選主 ...............................................................................................................50
通知系統 .......................................................................................................50
Apache Kafka ................................................................................................50
Apache Druid .................................................................................................51
Pulsar Proxy .........................................................................................................52
Java 虛擬機（JVM） .............................................................................................53
Netty ..............................................................................................................54
Apache Spark .................................................................................................55
Apache Lucene ..............................................................................................55
小結 .....................................................................................................................55
第 5 章 消費者 .................................................................................... 56
成為消費者意味著什么 ........................................................................................56
訂閱 .....................................................................................................................57
獨占 ...............................................................................................................60
共享 ...............................................................................................................61
鍵共享 ...........................................................................................................62
故障轉移 .......................................................................................................65
確認 .....................................................................................................................66
單條確認 .......................................................................................................66
累積確認 .......................................................................................................67
Schema .................................................................................................................67
消費者 Schema 管理 .....................................................................................68
消費模式 ..............................................................................................................68
批處理 ...........................................................................................................68
分塊 ...............................................................................................................69
高級配置 ..............................................................................................................70
延遲消息 .......................................................................................................70
保留策略 .......................................................................................................70
堆積限額 .......................................................................................................71
配置消費者 ..........................................................................................................72
回放 ...............................................................................................................73
死信主題 .......................................................................................................75
重試主題 .......................................................................................................76
小結 .....................................................................................................................76
第 6 章 生產者 .................................................................................... 77
同步生產者 ..........................................................................................................77
異步生產者 ..........................................................................................................78
生產者路由 ..........................................................................................................79
輪詢路由 .......................................................................................................79
單分區路由 ...................................................................................................80
定制分區路由 ................................................................................................81
生產者配置 ..........................................................................................................83
topicName .....................................................................................................83
producerName ...............................................................................................83
sendTimeoutMs .............................................................................................83
blockIfQueueFull ...........................................................................................84
maxPendingMessages ....................................................................................84
maxPendingMessagesAcrossPartitions ...........................................................84
messageRoutingMode ....................................................................................84
hashingScheme ..............................................................................................84
cryptoFailureAction .......................................................................................85
batchingMaxPublishDelayMicros ..................................................................85
batchingMaxMessages ...................................................................................85
batchingEnabled ............................................................................................85
compressionType ...........................................................................................85
Schema on Write ..................................................................................................86
使用 Schema Registry ....................................................................................86
非持久化主題 ......................................................................................................89
使用場景 .......................................................................................................90
使用非持久化主題 ........................................................................................90
事務 .....................................................................................................................91
小結 .....................................................................................................................92
第 7 章 Pulsar IO ............................................................................... 93
Pulsar IO 架構 ......................................................................................................93
運行時 ...........................................................................................................94
性能考量 .......................................................................................................94
使用場景 ..............................................................................................................95
簡單事件處理管道 ........................................................................................95
變化數據捕獲 ................................................................................................96
考量 .....................................................................................................................97
消息序列化 ...................................................................................................97
管道穩定性 ...................................................................................................97
故障處理 .......................................................................................................98
示例 .....................................................................................................................99
Elasticsearch ..................................................................................................99
Netty ............................................................................................................ 100
創建自己的連接器 ............................................................................................. 101
TimescaleDB ............................................................................................... 101
小結 ................................................................................................................... 102
第 8 章 Pulsar Functions .................................................................. 103
流處理 ................................................................................................................ 103
Pulsar Functions 架構 ......................................................................................... 105
運行時 ......................................................................................................... 105
隔離性 ......................................................................................................... 106
在 Kubernetes 上部署 Pulsar Functions 的隔離性 .............................................. 107
使用場景 ............................................................................................................ 107
創建 Pulsar Functions .................................................................................. 108
簡單事件處理 .............................................................................................. 108
主題清理 ..................................................................................................... 110
主題數據統計 .............................................................................................. 113
小結 ................................................................................................................... 115
第 9 章 分層存儲 .............................................................................. 116
在云端存儲數據 ................................................................................................. 117
對象存儲 ..................................................................................................... 118
使用場景 ............................................................................................................ 120
復制 ............................................................................................................. 120
CQRS .......................................................................................................... 121
災難恢復 ..................................................................................................... 122
卸載數據 ............................................................................................................ 122
Pulsar Offloader ........................................................................................... 122
檢索已卸載的數據 ............................................................................................. 129
與對象存儲數據交互 ................................................................................... 129
重填主題 ..................................................................................................... 129
使用 Pulsar 客戶端 ...................................................................................... 130
小結 ................................................................................................................... 131
第 10 章 Pulsar SQL ........................................................................ 132
流即表 ................................................................................................................ 133
SQL-on-Anything 引擎 ...................................................................................... 135
Apache Flink: 另一種視角 ........................................................................... 136
Presto/Trino ................................................................................................. 137
Pulsar SQL 的工作原理 ...................................................................................... 138
配置 Pulsar SQL ................................................................................................. 140
性能考量 ............................................................................................................ 142
小結 ................................................................................................................... 143
第 11 章 部署 Pulsar ........................................................................ 144
Docker ................................................................................................................ 144
裸金屬 ................................................................................................................ 146
*低要求 ..................................................................................................... 146
開始安裝 ..................................................................................................... 146
部署 ZooKeeper........................................................................................... 147
啟動 BookKeeper ........................................................................................ 148
啟動 Pulsar .................................................................................................. 148
公有云廠商 ........................................................................................................ 149
AWS ............................................................................................................ 151
Azure ........................................................................................................... 152
Google Cloud Platform ................................................................................ 153
Kubernetes ......................................................................................................... 153
小結 ................................................................................................................... 155
第 12 章 運維 Pulsar ........................................................................ 156
Apache BookKeeper 指標 .................................................................................. 157
服務器指標 ................................................................................................. 157
Journal 指標 ................................................................................................ 158
存儲指標 ..................................................................................................... 159
Apache ZooKeeper 指標 ..................................................................................... 159
服務器指標 ................................................................................................. 160
請求指標 ..................................................................................................... 161
主題指標 ............................................................................................................ 161
消費者指標 ........................................................................................................ 163
Pulsar 事務指標 ................................................................................................. 163
Pulsar Functions 指標 ......................................................................................... 164
高級運維技巧 .................................................................................................... 165
攔截器和追蹤機制 ...................................................................................... 165
Pulsar SQL 指標 .......................................................................................... 167
指標轉發 ............................................................................................................ 169
監控面板 ..................................................................................................... 169
小結 ................................................................................................................... 170
第 13 章 未來 ................................................................................... 171
編程語言支持 .................................................................................................... 171
擴展接口 ..................................................................................................... 171
增強 Pulsar Functions .................................................................................. 172
架構簡化 / 擴展 ........................................................................................... 175
消息平臺橋接器 .......................................................................................... 177
小結 ................................................................................................................... 180
附錄 A Pulsar Admin API ................................................................. 181
附錄 B Pulsar Admin CLI ................................................................. 189
附錄 C 跨地域復制 ........................................................................... 192
附錄 D Pulsar 中的安全、認證和鑒權 ............................................... 198
關于作者 ............................................................................................ 202
封面介紹 ............................................................................................ 202
展開全部
精通APACHE PULSAR:可伸縮云原生事件流實踐 作者簡介
Jowanza Joseph 是一位就職于 Finicity 的軟件工程師，他負責領導 Finicity 開放銀行平臺的網格開發。Jowanza 曾在多個項目中使用 Apache Pulsar，并利用基于 Pulsar 構建的全托管消息和流處理平臺實現了日均處理十億量級的消息。近十年中， Jowanza 在 Pluralsight 等公司的工作中都使用過Apache Kafka、Akka、Kubernetes 及其他流技術與消息技術。他還曾在 Strange Loop、Abstractions、開源峰會及 O’Reilly 的 Strata Data AI 大會上做過技術分享。蔡正昕，曾在亞馬遜工作， Pulsar 活躍貢獻者。后來加入了 StreamNative，成為 Cloud 工程師。
蔡正昕，軟件工程師。曾在亞馬遜，Streamnative等公司任職，從事數據處理系統和云服務控制面的開發。19年開始關注Apache Pulsar社區并參與討論，漏洞修復和特性開發。對Apache Pulsar，Apache BookKeeper，以及在K8S環境中運維有狀態系統有比較深入的理解。
王殿進，目前在 StreamNative 負責 Apache Pulsar 社區與市場工作。曾在云計算廠商、SaaS 公司從事過開發者社區運營與用戶增長工作。Jowanza Joseph 是一位就職于 Finicity 的軟件工程師，他負責領導 Finicity 開放銀行平臺的網格開發。Jowanza 曾在多個項目中使用 Apache Pulsar，并利用基于 Pulsar 構建的全托管消息和流處理平臺實現了日均處理十億量級的消息。近十年中， Jowanza 在 Pluralsight 等公司的工作中都使用過Apache Kafka、Akka、Kubernetes 及其他流技術與消息技術。他還曾在 Strange Loop、Abstractions、開源峰會及 O’Reilly 的 Strata Data & AI 大會上做過技術分享。蔡正昕，曾在亞馬遜工作， Pulsar 活躍貢獻者。后來加入了 StreamNative，成為 Cloud 工程師。
蔡正昕，軟件工程師。曾在亞馬遜，Streamnative等公司任職，從事數據處理系統和云服務控制面的開發。19年開始關注Apache Pulsar社區并參與討論，漏洞修復和特性開發。對Apache Pulsar，Apache BookKeeper，以及在K8S環境中運維有狀態系統有比較深入的理解。
王殿進，目前在 StreamNative 負責 Apache Pulsar 社區與市場工作。曾在云計算廠商、SaaS 公司從事過開發者社區運營與用戶增長工作。
徐文濤，曾任Talkdesk 知識管理工程師，為多個企業級 SaaS、CCaaS 與 PaaS 產品撰寫并審核英文文檔。曾任某世界五百強本地化團隊終審負責人，原 KubeSphere 開源容器平臺本地化、文檔與內容策劃負責人。曾獲美國 DZone 專欄銀牌作家，人事部 CATTI 二級口譯、二級筆譯，聯合國 UNLPP 二級筆譯，Linux 基金會認證 Kubernetes 管理員 (CKA)、應用開發者 (CKAD) 與安全專家 (CKS)等行業資格或榮譽。
書友推薦
- >
朝聞道
- >
企鵝口袋書系列·偉大的思想20:論自然選擇(英漢雙語)
- >
龍榆生：詞曲概論/大家小書
- >
史學評論
- >
煙與鏡
- >
唐代進士錄
- >
羅曼·羅蘭讀書隨筆-精裝
- >
巴金－再思錄
本類暢銷
