作者 | 郭炜过去十年,数据工程的主线,是 Modern Data Stack 对传统数仓体系的一次拆解与重组。我们把数据采集从数据库里拆出来,形成了 Data Ingestion,用 FiveTran、Airbyte、Apache SeaTunnel 来解决 ELT / CDC / Reverse ETL;把计算从存储里拆出来,形成了 Snowflake、Databricks、Iceberg、H ...
Forbes contributors publish independent expert analyses and insights. I track enterprise software application development & data management. Data engineers engineer. Obviously they do, the clue is in ...
Data engineers used to operate mostly behind the scenes, moving digital information from one system to another so analysts and executives could make sense of it later. Now, as companies rely more ...