AWS Lake Formation
Table of contents
General
AWS Lake Formation centralizes permissions management of your data and makes it easier to share across your organization and externally.
It is built on top of Glue and can:
- Start and monitor data flows;
- Define transformation jobs;
- Encrypt and manage encryption keys;
- Manage Access Control - from top Level to Granular Level: Rows, Columns, Cell-Level (with row and column filter applied simultaneously) and SQL Operations;
- Data Auditing.
ACID Compliance
You can create and manage transactional tables using open source formats such as Apache Iceberg, Apache Hudi or Linux Foundation Delta Lake.
Governed tables are deprecated
Cross-account permissions
If the grantee account is part of the same organization, the access is made available immediately.
If the grantee account is not part of the same organization, an invite is sent via AWS RAM - Resource Access Manager, which can be accepted or declined by the data lake administrator in the grantee account.
Cost
Lake Formation is free. However, any service used under the hood, such as S3, EMR, Athena, etc are not.