apache-iceberg-1.7.2

What's Changed

• 1.7.x cherry pick #11526 by @bryanck in #11629
• [1.7] Revert "Support WASB scheme in ADLSFileIO" by @mrcnc in #11817
• Core, Spark, Flink, Hive: Remove unused failsafe dependency from core and add Failsafe to runtime LICENSE(s) by @amogh-jahagirdar in #11828
• [1.7.x] AWS, Core, GCP: Support relative credential endpoint / pass OAuth2 token to credential provider by @nastra in #11971
• Spark: Fix empty scan issue when start timestamp retrieves root snapshot and end timestamp is missing (#11967) by @Fokko in #11983
• Remove slf4j-api reference in LICENSE (#12052) by @Fokko in #12068
• [1.7.x] Core: Retain current view version during expiration (#12067) by @nastra in #12084
• Bump the versions of site/mkdocs.yml by @Fokko in #12175
• [1.7.x] Kafka: Pin Kafka-Connect version to fix integration tests by @Fokko in #12354
• [1.7.x] Bump Nessie to 0.120.5 to include updated License/Notice by @Fokko in #12356
• [1.7.x] Fix {LICENSE,NOTICE} for Kafka Connect Runtime by @Fokko in #12353
• [1.7.x] Fix {LICENSE,NOTICE} for Flink Runtime by @Fokko in #12358
• [1.7.x] Fix {LICENSE,NOTICE} for GCP Bundle by @Fokko in #12359
• [1.7.x] Fix {LICENSE,NOTICE} for AWS Bundle by @Fokko in #12360
• [1.7.x] Fix {LICENSE,NOTICE} for Azure Bundle by @Fokko in #12361
• [1.7.x] Fix {LICENSE,NOTICE} for Spark Runtime by @Fokko in #12355
• [1.7.x] Align azure-storage-blob version in azure-bundle LICENSE by @jbonofre in #12445
• [1.7.x] Fix Kafka-connect LICENSE and NOTICE by @Fokko in #12400
• [1.7.x] AWS: Don't fetch credential from endpoint if properties contain a valid credential (#12504) by @nastra in #12515

Full Changelog: apache-iceberg-1.7.1...apache-iceberg-1.7.2

apache-iceberg-1.8.1

What's Changed

• [1.8.x] Revert "Core: Serialize null when there is no current snapshot" by @Fokko in #12313
• [1.8.x] Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in #12328
• [1.8.x] Core: Adjust Jackson settings to handle large metadata json (#12224) by @nastra in #12330
• [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in #12338
• [1.8.x] Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in #12341
• [1.8.x] Build: Revert AWS SDK from 2.30.11 to 2.29.52 by @nastra in #12339
• [1.8.x] Core: Remove namespace/table/view HEAD endpoints from defaults (#12351) by @nastra in #12368
• [1.8.x] Core: Don't remove trailing slash from absolute paths by @adutra in #12390
• [1.8.x] Fix versions in LICENSE/NOTICE by @jbonofre in #12365

Full Changelog: apache-iceberg-1.8.0...apache-iceberg-1.8.1

apache-iceberg-1.8.0

What's Changed

• Doc: Update rewrite data files spark procedure by @dramaticlly in #11396
• Docs: warn parallelism > 1 doesn't work for migration procedures by @manuzhang in #11417
• Core: log retry sleep time by @sullis in #11413
• Core: Use RoaringPositionBitmap in position index by @aokolnychyi in #11441
• Core: Add validation for table commit properties by @dramaticlly in #11437
• Core: Add cardinality to PositionDeleteIndex by @aokolnychyi in #11442
• Puffin: Add delete-vector-v1 blob type by @rdblue in #11238
• Spec v3: Add deletion vectors to the table spec by @rdblue in #11240
• API, Core: Add data file reference to DeleteFile by @aokolnychyi in #11443
• Build: Bump software.amazon.awssdk:bom from 2.29.1 to 2.29.6 by @dependabot in #11454
• Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.3 to 8.3.5 by @dependabot in #11452
• Build: Bump com.google.cloud:libraries-bom from 26.49.0 to 26.50.0 by @dependabot in #11451
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4 to 5.4.1 by @dependabot in #11450
• Build: Bump com.azure:azure-sdk-bom from 1.2.28 to 1.2.29 by @dependabot in #11453
• Flink: Maintenance - TableManager + ExpireSnapshots by @pvary in #11144
• Build: Bump mkdocs-material from 9.5.42 to 9.5.43 by @dependabot in #11455
• Build: Bump net.snowflake:snowflake-jdbc from 3.19.1 to 3.20.0 by @dependabot in #11447
• Build: Bump kafka from 3.8.0 to 3.8.1 by @dependabot in #11449
• Build: Bump jackson-bom from 2.18.0 to 2.18.1 by @dependabot in #11448
• Core: Fix generated position delete file spec by @aokolnychyi in #11458
• API, Core: Add content offset and size to DeleteFile by @aokolnychyi in #11446
• Build: Revert Parquet to 1.13.1 by @RussellSpitzer in #11462
• Spark 3.5: Preserve data file reference during manifest rewrites by @aokolnychyi in #11457
• Core: Make PositionDeleteIndex serializable by @aokolnychyi in #11463
• Spark 3.5: Preserve content offset and size during manifest rewrites by @aokolnychyi in #11469
• Spark 3.5: Fix flaky test due to temp directory not empty during delete by @manuzhang in #11470
• Core, Data, Flink, Spark: Improve tableDir initialization for tests by @nastra in #11460
• Core: Support DVs in DeleteFileIndex by @aokolnychyi in #11467
• Core: Adapt commit, scan, and snapshot stats for DVs by @aokolnychyi in #11464
• Spark: Merge new position deletes with old deletes during writing by @amogh-jahagirdar in #11273
• Fix ADLSLocation file parsing by @mrcnc in #11395
• open-api: Build runtime jar for test fixture by @ajantha-bhat in #11279
• Core, Puffin: Add DV file writer by @aokolnychyi in #11476
• Flink: Fix config key typo in error message of SplitComparators by @liuml07 in #11482
• API: Removes Explicit Parameterization of Schema Tests by @RussellSpitzer in #11444
• Docs: Fix verifying release candidate with Spark and Flink by @manuzhang in #11461
• Flink: Port #11144 to v1.19 by @pvary in #11473
• Docs: Fix format of verifying release candidate with Flink by @manuzhang in #11487
• Core: Support DVs in DeleteLoader by @aokolnychyi in #11481
• Infra: Update DOAP.RDF for Apache Iceberg 1.7.0 by @RussellSpitzer in #11492
• Docs: Site Update for 1.7.0 Release by @RussellSpitzer in #11494
• Infra: Add 1.7.0 to issue template by @RussellSpitzer in #11491
• Build: Let revapi compare against 1.7.0 by @RussellSpitzer in #11490
• Docs: Adds Release notes for 1.6.1 by @RussellSpitzer in #11500
• Docs: Fixes Release Formatting for 1.7.0 Release Notes by @RussellSpitzer in #11499
• Spec: Explicitly specify operation as a required field of Snapshot's summary field by @sungwy in #11355
• Exclude reading _pos column if it's not in the scan list by @huaxingao in #11390
• Build: Bump mkdocs-redirects from 1.2.1 to 1.2.2 by @dependabot in #11511
• Build: Bump mkdocs-material from 9.5.43 to 9.5.44 by @dependabot in #11510
• Build: Bump software.amazon.awssdk:bom from 2.29.6 to 2.29.9 by @dependabot in #11509
• Docs: Update multi-engine support after 1.7.0 release by @manuzhang in #11503
• Spark: Fix typo in spark ddl document by @hantangwangd in #11517
• Core: Support commits with DVs by @aokolnychyi in #11495
• Kafka Connect: fix Hadoop dependency exclusion by @bryanck in #11516
• Upgrade to Gradle 8.11.0 by @jbonofre in #11521
• Spark 3.5: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11480
• use dist/release KEYS by @kevinjqliu in #11526
• Remove iceberg-pig by @jbonofre in #11380
• Core, Flink, Spark: Verify maintenance actions with DVs by @nastra in #11485
• Spark: Use assumeThat(format).isEqualTo(FileFormat.PARQUET) instead of assumeThat(format).isEqualTo(parquet) by @huaxingao in #11540
• Spark 3.4: Support Spark Column Stats by @saitharun15 in #11532
• Docs: Fix rendering lists by @manuzhang in #11546
• Build: Bump kafka from 3.8.1 to 3.9.0 by @dependabot in #11508
• Support WASB scheme in ADLSFileIO by @mrcnc in #11504
• Docs: 4 Spaces are Required for Sublists by @RussellSpitzer in #11549
• API, Core, Spark: Ignore schema merge updates from long -> int by @rocco408 in #11419
• Docs: Fix level of Deletion Vectors by @manuzhang in #11547
• API, Core: Replace deprecated ContentFile#path usage with location by @amogh-jahagirdar in #11550
• API: Add Variant data type by @aihuaxu in #11324
• Spark 3.5: Adapt DeleteFileIndexBenchmark for DVs by @aokolnychyi in #11529
• Spark 3.5: Adapt PlanningBenchmark for DVs by @aokolnychyi in #11531
• Spark 3.5: Add DVReaderBenchmark by @aokolnychyi in #11537
• Build: Bump datamodel-code-generator from 0.26.2 to 0.26.3 by @dependabot in #11572
• Build: Bump software.amazon.awssdk:bom from 2.29.9 to 2.29.15 by @dependabot in #11568
• Build: Bump io.netty:netty-buffer from 4.1.114.Final to 4.1.115.Final by @dependabot in #11569
• Data, Flink, Spark: Test deletes with format-version=3 by @nastra in #11538
• Build: Bump nessie from 0.99.0 to 0.100.0 by @dependabot in #11567
• Build: Bump orc from 1.9.4 to 1.9.5 by @dependabot in #11571
• API, Arrow, Core, Data, Spark: Replace usage of deprecated ContentFile#path API with location API by @amogh-jahagirdar in #11563
• Core: Serialize null when there is no current snapshot by @Fokko in #11560
• Spark 3.4: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11579
• Spark 3.3: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11580
• Core: Inherited classes from SnapshotProducer has TableOperations red… by @gaborkaszab in #11578
• Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" by @nastra in #11574
• Core: delete temp metadata file when version already exists by @leesf in https://github.com/apache...

Apache Iceberg 1.7.1

What's Changed

• Kafka Connect: fix Hadoop dependency exclusion (#11516)
• Azure: Fix ADLSLocation file parsing (#11395)
• Azure: Support WASB scheme in ADLSFileIO (#11504)
• Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" (#11574)
• Spark 3.5: Fix NotSerializableException when migrating Spark tables (#11157)
• Spark: Fix changelog table bug for start time older than current snapshot (#11564)
• Revert "Core: Update TableMetadataParser to ensure all streams closed" (#11621)

Full Changelog: apache-iceberg-1.7.0...apache-iceberg-1.7.1

Apache Iceberg 1.7.0

What's Changed

• [DOCS] Fix link on Concepts page by @gaborkaszab in #10718
• Core: Support appending files with different specs by @fqaiser94 in #9860
• Remove unnecessary class-level synchronized in ManifestFiles by @findepi in #10544
• Spec: Clarify which columns can be used for equality delete files. by @emkornfield in #8981
• Build: Bump nessie from 0.92.1 to 0.93.1 by @dependabot in #10727
• Build: Bump org.testcontainers:testcontainers from 1.19.8 to 1.20.0 by @dependabot in #10730
• Build: Bump mkdocs-material from 9.5.28 to 9.5.29 by @dependabot in #10734
• Build: Bump org.roaringbitmap:RoaringBitmap from 1.2.0 to 1.2.1 by @dependabot in #10733
• Build: Bump software.amazon.awssdk:bom from 2.26.20 to 2.26.21 by @dependabot in #10729
• Build: Bump io.netty:netty-buffer from 4.1.111.Final to 4.1.112.Final by @dependabot in #10726
• Build: Bump orc from 1.9.3 to 1.9.4 by @dependabot in #10728
• Build: Bump com.google.errorprone:error_prone_annotations from 2.28.0 to 2.29.2 by @dependabot in #10731
• Flink: Migrate remaining classes to JUnit5 by @tomtongue in #10684
• Api, Build: Fix typo in comments in Table and gradlew by @hantangwangd in #10744
• Flink: parameterize Flink table source tests to test both old and FLIP-27 source implementations by @stevenzwu in #10741
• Core: Limit memory used by ParallelIterable by @findepi in #10691
• Flink: handle rescale properly and refactor statistics by @stevenzwu in #10457
• Flink: Backport other remaining classes by @tomtongue in #10749
• Spec: Clarify time travel implementation in Iceberg by @emkornfield in #8982
• Build: Let revapi compare against 1.6.0 by @ajantha-bhat in #10754
• Support for Flink's SpeculativeExecution in batch execution mode by @venkata91 in #10548
• API: Update StatisticsFile javadoc by @rice668 in #10769
• Flink: Remove JUnit4 dependency by @nastra in #10770
• Docs: Add bodo to iceberg vendors by @ritwika314 in #10756
• Core: Add estimateRowCount for Files and Entries Metadata Tables by @szehon-ho in #10759
• Update checkstyle definition by @attilakreiner in #10681
• API: Fix typo in RewriteManifestFiles java doc by @amogh-jahagirdar in #10778
• Update .asf.yaml by @ajantha-bhat in #10767
• Support building with Java 21 by @findepi in #10474
• Infra, Docs: Publish Apache Iceberg 1.6.0 release by @jbonofre in #10752
• Update iceberg version on site to 1.6.0 by @jbonofre in #10783
• Hive: close the fileIO client when closing the hive catalog by @hussein-awala in #10771
• Add jbonofre as collaborator on the project by @jbonofre in #10782
• Docs: Make compatibility example consistent. by @emkornfield in #10781
• mr：Fix issues 10639 by @lurnagao-dahua in #10661
• Flink: backport PR #10331 and PR #10457 by @stevenzwu in #10757
• Build: Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.25 by @dependabot in #10800
• Build: Bump nessie from 0.93.1 to 0.94.2 by @dependabot in #10798
• Build: Bump net.snowflake:snowflake-jdbc from 3.17.0 to 3.18.0 by @dependabot in #10801
• Build: Bump mkdocs-material from 9.5.29 to 9.5.30 by @dependabot in #10796
• Flink: Disabling flaky test TestIcebergSourceFailover.testBoundedWithSavepoint by @pvary in #10802
• Build: Bump mkdocs-awesome-pages-plugin from 2.9.2 to 2.9.3 by @dependabot in #10795
• Kafka Connect: Runtime distribution with integration tests by @bryanck in #10739
• Flink: improve snapshot compatibility check by comparing projected sort schema in SortKeySerializer by @stevenzwu in #10794
• Flink: support limit pushdown in FLIP-27 source by @stevenzwu in #10748
• Flink: Remove MiniClusterResource in Flink by @tomtongue in #10817
• Docs: Use link addresses instead of descriptions in releases.md by @lurnagao-dahua in #10815
• Build: Declare avro as an api dependency of iceberg-core by @devinrsmith in #10573
• Flink: backport PR #10748 for limit pushdown by @stevenzwu in #10813
• [DOCS] Fix header for entries metadata table by @gaborkaszab in #10826
• Support Spark Column Stats by @huaxingao in #10659
• Support for Flink's SpeculativeExecution in batch execution mode - Backport of PR #10548 by @venkata91 in #10776
• Infra: Improve feature request template by @nastra in #10825
• Core: (unit test) Replace the duplicated ALL_DATA_FILES with ALL_DELETE_FILES by @hsiang-c in #10836
• Core: Adds Basic Classes for Iceberg Table Version 3 by @RussellSpitzer in #10760
• Core: Allow SnapshotProducer to skip uncommitted manifest cleanup after commit by @grantatspothero in #10523
• Flink: a few small fixes or tuning for range partitioner by @stevenzwu in #10823
• Core: Drop support for Java 8 by @findepi in #10518
• Build: Bump com.adobe.testing:s3mock-junit5 from 2.11.0 to 2.17.0 by @nastra in #10851
• Core: Upgrade Jetty and Servlet API by @nastra in #10850
• Build for Java 11 by @snazy in #10849
• Build: Bump kafka from 3.7.1 to 3.8.0 by @dependabot in #10797
• Build: Update baseline gradle plugin to 5.58.0 by @findepi in #10788
• Flink: refactor sink tests to reduce the number of combinations with parameterized tests by @stevenzwu in #10777
• Flink: backport PR #10823 for range partitioner fixup by @stevenzwu in #10847
• Core: Remove reflection from TestParallelIterable by @findepi in #10857
• Spec: Deprecate the file system table scheme. by @rdblue in #10833
• Core, API: Add addNonDefaultSpec to UpdatePartitionSpec to not set the new partition spec as default by @shanielh in #10736
• Build: Bump com.palantir.baseline:gradle-baseline-java from 5.58.0 to 5.61.0 by @dependabot in #10864
• Build: Bump nessie from 0.94.2 to 0.94.4 by @dependabot in #10869
• Build: Bump org.xerial:sqlite-jdbc from 3.46.0.0 to 3.46.0.1 by @dependabot in #10871
• Build: Bump org.apache.commons:commons-compress from 1.26.0 to 1.26.2 by @dependabot in #10868
• Build: Bump software.amazon.awssdk:bom from 2.26.25 to 2.26.29 by @dependabot in #10866
• Build: Bump mkdocs-material from 9.5.30 to 9.5.31 by @dependabot in #10863
• Build: Fix Scala compilation by @snazy in #10860
• Build: Enable FormatStringAnnotation error-prone check by @findepi in #10856
• Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner by @nastra in #10858
• Aliyun: Replace assert usage with assertThat by @nastra in #10880
• Core: Extract filePath comparator into it's own class by @deniskuzZ in #10664
• Docs: Fix SQL in branching docs by @nakaken-churadata in #10876
• API: Add SupportsRecoveryOperations mixin for FileIO by @amogh-jahagirdar in #10711
• Spec: Clarify identity partition edge cases. by @emkornfield in #10835
• Build: Bump org.testcontainers:testcontainers from 1.20.0 to 1.20.1 by @dependabot in #10865
• Flink: add 1.20 support and remove 1.17 by @stevenzwu in #10881
• Build: Add checkstyle rule to ba...

Apache Iceberg 1.6.1

What's Changed

• Core: Limit ParallelIterable memory consumption by yielding in tasks by @raunaqmorarka in #10787
• [1.6] Core: Drop ParallelIterable's queue low water mark by @findepi in #10979
• Build: Bump orc from 1.9.3 to 1.9.4 (#10728) by @Fokko in #10988

New Contributors

• @raunaqmorarka made their first contribution in #10787

Full Changelog: apache-iceberg-1.6.0...apache-iceberg-1.6.1

Apache Iceberg 1.6.0

What's Changed

• API, Spark 3.3: Remove all usages of deprecated AssertHelpers by @findepi in #10500
• API: Fix default FileIO#newInputFile ManifestFile, DataFile and DeleteFile implementation to pass lengths by @amogh-jahagirdar in #9953
• AWS, Core: Replace .withFailMessage() usage with .as() by @nastra in #10000
• AWS: Fix TestGlueCatalogTable#testCreateTable by @aajisaka in #10221
• AWS: Make sure Signer + User Agent config are both applied by @nastra in #10198
• AWS: Retain Glue Catalog column comment after updating Iceberg table by @lawofcycles in #10276
• AWS: Retain Glue Catalog table description after updating Iceberg table by @aajisaka in #10199
• AWS: Support S3 DSSE-KMS encryption by @aajisaka in #8370
• AWS: close underlying executor for DynamoDb LockManager by @regadas in #10132
• Add 13 Dremio Blogs + Fix a few incorrect dates by @AlexMercedCoder in #9967
• Add EnumConfParser to SparkConfParser by @huaxingao in #10311
• Add Pagination To List Apis by @rahil-c in #9782
• Add bloom filter fpp config by @huaxingao in #10149
• Add checkstyle rule for uppercase constant fields by @attilakreiner in #10673
• Add issue template and docs for iceberg proposals by @danielcweeks in #9932
• Add local nightly build to test current docs changes by @bitsondatadev in #9943
• Add stale PRs management by @jbonofre in #10134
• Add support for providing output-spec-id during rewrite - spark 3.5 by @himadripal in #9803
• Address Intellij inspection findings by @snazy in #10583
• Allow Java 17 in contribute.md by @findepi in #10545
• Apply IntelliJ inspection findings to older Spark + Flink versions by @snazy in #10625
• Avoid adding a closed client to the pool by @flyrain in #10337
• Aws: Add Iceberg version to UserAgent in S3 requests by @CsengerG in #9963
• Backport Flink 1.18 JUnit5 migration to Flink 1.17 by @tomtongue in #10163
• Backport HadoopCatalog related classes in Flink by @tomtongue in #10620
• Backport source package changes in Flink to other versions by @tomtongue in #10663
• Basic manifest encryption by @ggershinsky in #8252
• Build: Align Jackson versions by @nastra in #9925
• Build: Bump Nessie to 0.90.4 by @adutra in #10492
• Build: Bump Nessie to 0.91.2 by @adutra in #10563
• Build: Bump Spark 3.5 to 3.5.1 by @manuzhang in #9832
• Build: Bump arrow from 15.0.0 to 15.0.1 by @dependabot in #9910
• Build: Bump arrow from 15.0.1 to 15.0.2 by @dependabot in #10034
• Build: Bump com.azure:azure-sdk-bom from 1.2.20 to 1.2.21 by @dependabot in #9857
• Build: Bump com.azure:azure-sdk-bom from 1.2.21 to 1.2.22 by @dependabot in #10071
• Build: Bump com.azure:azure-sdk-bom from 1.2.22 to 1.2.23 by @dependabot in #10238
• Build: Bump com.azure:azure-sdk-bom from 1.2.23 to 1.2.24 by @dependabot in #10420
• Build: Bump com.azure:azure-sdk-bom from 1.2.24 to 1.2.25 by @dependabot in #10652
• Build: Bump com.esotericsoftware:kryo from 4.0.2 to 4.0.3 by @dependabot in #9984
• Build: Bump com.google.cloud:libraries-bom from 26.28.0 to 26.43.0 by @dependabot in #10699
• Build: Bump com.google.errorprone:error_prone_annotations from 2.24.1 to 2.26.1 by @dependabot in #9972
• Build: Bump com.google.errorprone:error_prone_annotations from 2.26.1 to 2.27.0 by @dependabot in #10236
• Build: Bump com.google.errorprone:error_prone_annotations from 2.27.0 to 2.28.0 by @dependabot in #10418
• Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.4.1 to 2.4.2 by @dependabot in #10239
• Build: Bump com.palantir.gradle.gitversion:gradle-git-version from 3.0.0 to 3.1.0 by @dependabot in #10468
• Build: Bump datamodel-code-generator from 0.25.4 to 0.25.5 by @dependabot in #9979
• Build: Bump datamodel-code-generator from 0.25.5 to 0.25.6 by @dependabot in #10242
• Build: Bump datamodel-code-generator from 0.25.6 to 0.25.7 by @dependabot in #10507
• Build: Bump datamodel-code-generator from 0.25.7 to 0.25.8 by @dependabot in #10649
• Build: Bump gradle.plugin.io.morethan.jmhreport:gradle-jmh-report from 0.9.0 to 0.9.6 by @dependabot in #10193
• Build: Bump guava from 33.0.0-jre to 33.1.0-jre by @dependabot in #9977
• Build: Bump guava from 33.1.0-jre to 33.2.0-jre by @dependabot in #10271
• Build: Bump guava from 33.2.0-jre to 33.2.1-jre by @dependabot in #10414
• Build: Bump io.airlift:aircompressor from 0.26 to 0.27 by @dependabot in #10383
• Build: Bump io.delta:delta-spark_2.12 from 3.1.0 to 3.2.0 by @dependabot in #10320
• Build: Bump io.delta:delta-standalone_2.12 from 3.1.0 to 3.2.0 by @dependabot in #10321
• Build: Bump io.github.goooler.shadow:shadow-gradle-plugin from 8.1.7 to 8.1.8 by @dependabot in #10612
• Build: Bump io.netty:netty-buffer from 4.1.107.Final to 4.1.108.Final by @dependabot in #10032
• Build: Bump io.netty:netty-buffer from 4.1.108.Final to 4.1.109.Final by @dependabot in #10191
• Build: Bump io.netty:netty-buffer from 4.1.109.Final to 4.1.110.Final by @dependabot in #10384
• Build: Bump io.netty:netty-buffer from 4.1.110.Final to 4.1.111.Final by @dependabot in #10504
• Build: Bump jetty from 9.4.53.v20231009 to 9.4.54.v20240208 by @dependabot in #9982
• Build: Bump jetty from 9.4.54.v20240208 to 9.4.55.v20240627 by @dependabot in #10654
• Build: Bump kafka from 3.6.1 to 3.7.0 by @dependabot in #9855
• Build: Bump kafka from 3.7.0 to 3.7.1 by @dependabot in #10653
• Build: Bump mkdocs-material from 9.5.14 to 9.5.15 by @dependabot in #10031
• Build: Bump mkdocs-material from 9.5.15 to 9.5.17 by @dependabot in #10092
• Build: Bump mkdocs-material from 9.5.17 to 9.5.18 by @dependabot in #10189
• Build: Bump mkdocs-material from 9.5.18 to 9.5.19 by @dependabot in #10241
• Build: Bump mkdocs-material from 9.5.19 to 9.5.21 by @dependabot in #10272
• Build: Bump mkdocs-material from 9.5.21 to 9.5.23 by @dependabot in #10353
• Build: Bump mkdocs-material from 9.5.23 to 9.5.25 by @dependabot in #10413
• Build: Bump mkdocs-material from 9.5.25 to 9.5.26 by @dependabot in #10464
• Build: Bump mkdocs-material from 9.5.26 to 9.5.27 by @dependabot in #10555
• Build: Bump mkdocs-material from 9.5.27 to 9.5.28 by @dependabot in #10648
• Build: Bump mkdocs-material from 9.5.9 to 9.5.14 by @dependabot in #9983
• Build: Bump nessie from 0.77.1 to 0.79.0 by @dependabot in #9976
• Build: Bump nessie from 0.79.0 to 0.80.0 by @dependabot in #10237
• Build: Bump nessie from 0.80.0 to 0.81.1 by @dependabot in #10267
• Build: Bump nessie from 0.81.1 to 0.82.0 by @dependabot in #10318
• Build: Bump nessie from 0.82.0 to 0.83.2 by @dependabot in #10381
• Build: Bump nessie from 0.90.4 to 0.91.1 by @dependabot in #10551
• Build: Bump nessie from 0.91.2 to 0.91.3 by @dependabot in #10608
• Build: Bump nessie from 0.92.0 to 0.92.1 by @dependabot in #10697
• Build: Bump net.snowflake:snow...

Apache Iceberg 1.5.2

The 1.5.2 release has the same changes that the 1.5.1 release has. The 1.5.1 release had issues with the spark runtime artifacts; specifically certain artifacts were built with the wrong Scala version. It is strongly recommended to upgrade to 1.5.2 for any systems that are using 1.5.1.

Apache Iceberg 1.5.1

What's Changed

• [1.5.x] API: Fix default FileIO#newInputFile ManifestFile, DataFile and DeleteFile implementations by @amogh-jahagirdar in #10114
• [1.5.x] Core: Mark 502 and 504 failures as retryable to the exponential retry strategy by @amogh-jahagirdar in #10113
• Core: Fix JDBC Catalog table commit when migrating from schema V0 to V1 (#101111) by @jbonofre in #10152
• Core: Fix namespace SQL statement using ESCAPE character that works with MySQL/PostgreSQL (#10167) by @jbonofre in #10169
• (1.5.x cherry-pick) Spark 3.5: Fix system function pushdown in CoW row-level commands by @amogh-jahagirdar in #10170
• (1.5.x Cherry-pick) Spark 3.4: Fix system function pushdown in CoW row-level commands (#10119) by @amogh-jahagirdar in #10171

Full Changelog: apache-iceberg-1.5.0...apache-iceberg-1.5.1

Apache Iceberg 1.5.0

Apache Iceberg 1.5.0 was released on March 11, 2024.
The 1.5.0 release adds a variety of new features and bug fixes.

• API
  • Extend FileIO and add EncryptingFileIO. (#9592)
  • Track partition statistics in TableMetadata (#8502)
  • Add sqlFor API to views to handle resolving a representation for a dialect(#9247)
• Core
  • Add view support for REST catalog (#7913)
  • Add view support for JDBC catalog (#9487)
  • Add catalog type for glue,jdbc,nessie (#9647)
  • Support Avro file encryption with AES GCM streams (#9436)
  • Add ApplyNameMapping for Avro (#9347)
  • Add StandardEncryptionManager (#9277)
  • Add REST catalog table session cache (#8920)
  • Support view metadata compression (#8552)
  • Track partition statistics in TableMetadata (#8502)
  • Enable column statistics filtering after planning (#8803)
• Spark
  • Remove support for Spark 3.2 (#9295)
  • Support views via SQL for Spark 3.4 and 3.5 (#9423, #9421, #9343, #9513, #9582)
  • Support executor cache locality (#9563)
  • Added support for delete manifest rewrites (#9020)
  • Support encrypted output files (#9435)
  • Add Spark UI metrics from Iceberg scan metrics (#8717)
  • Parallelize reading files in add_files procedure (#9274)
  • Support file and partition delete granularity (#9384)
• Flink
  • Remove Flink 1.15
  • Adds support for 1.18 version #9211
  • Emit watermarks from the IcebergSource (#8553)
  • Watermark read options (#9346)
• Parquet
  • Support reading INT96 column in row group filter (#8988)
  • Add system config for unsafe Parquet ID fallback. (#9324)
• Kafka-Connect
  • Initial project setup and event data structures (#8701)
  • Sink connector with data writers and converters (#9466)
• Spec
  • Add partition stats spec (#7105)
  • add nanosecond timestamp types (#8683)
  • Add multi-arg transform (#8579)
• Vendor Integrations
  • AWS: Support setting description for Glue table (#9530)
  • AWS: Update S3FileIO test to run when CLIENT_FACTORY is not set (#9541)
  • AWS: Add S3 Access Grants Integration (#9385)
  • AWS: Glue catalog strip trailing slash on DB URI (#8870)
  • Azure: Add FileIO that supports ADLSv2 storage (#8303)
  • Azure: Make ADLSFileIO implement DelegateFileIO (#8563)
  • Nessie: Support views for NessieCatalog (#8909)
  • Nessie: Strip trailing slash for warehouse location (#9415)
  • Nessie: Infer default API version from URI (#9459)
• Dependencies
  • Bump Nessie to 0.77.1
  • Bump ORC to 1.9.2
  • Bump Arrow to 15.0.0
  • Bump AWS Java SDK to 2.24.5
  • Bump Azure Java SDK to 1.2.20
  • Bump Google cloud libraries to 26.28.0

Note:

1. To enable view support for JDBC catalog, configure jdbc.schema-version to V1 in catalog properties.

New Contributors

• @reswqa made their first contribution in #7745
• @maxdebayser made their first contribution in #7796
• @mderoy made their first contribution in #7801
• @cxzl25 made their first contribution in #7825
• @tilman151 made their first contribution in #7781
• @TaoZex made their first contribution in #7761
• @Rondiz made their first contribution in #7829
• @grobgl made their first contribution in #7645
• @guiyanakuang made their first contribution in #7839
• @littlecatjianjiao made their first contribution in #7908
• @DaVincii made their first contribution in #7874
• @mumuhhh made their first contribution in #7866
• @Ewan-Keith made their first contribution in #7917
• @nikam14 made their first contribution in #7093
• @hsiang-c made their first contribution in #7920
• @ktk1012 made their first contribution in #8026
• @joan38 made their first contribution in #8002
• @coded9 made their first contribution in #8058
• @rustyconover made their first contribution in #8074
• @mr-brobot made their first contribution in #8061
• @Neuw84 made their first contribution in #7988
• @lintingbin made their first contribution in #8111
• @mrcnc made their first contribution in #8193
• @s-akhtar-baig made their first contribution in #8205
• @MaxNevermind made their first contribution in #7694
• @bmaisonn made their first contribution in #8209
• @HonahX made their first contribution in #8215
• @onerishabh made their first contribution in #8214
• @kengtin made their first contribution in #7161
• @aless10 made their first contribution in #8286
• @advancedxy made their first contribution in #8320
• @dacort made their first contribution in #8341
• @gegef2009 made their first contribution in #8154
• @TjuAachen made their first contribution in #8401
• @baiyangtx made their first contribution in #8416
• @hiteshbedre made their first contribution in #8491
• @harshm-dev made their first contribution in #8385
• @wForget made their first contribution in #8445
• @andreacfm made their first contribution in #8528
• @Paddy0523 made their first contribution in #8547
• @rushilshah1 made their first contribution in #8589
• @lanemoseley made their first contribution in #8618
• @tlm365 made their first contribution in #8447
• @jbonofre made their first contribution in #8612
• @jayceslesar made their first contribution in #8558
• @MehulBatra made their first contribution in #8408
• @clettieri made their first contribution in #8192
• @nk1506 made their first contribution in #8640
• @johanhenriksson made their first contribution in #8751
• @ashutosh-roy made their first contribution in #8707
• @Priyansh121096 made their first contribution in #8748
• @PickBas made their first contribution in #8819
• @jongwooo made their first contribution in #8666
• @rice668 made their first contribution in #8873
• @geruh made their first contribution in #8914
• @bknbkn made their first contribution in #8868
• @wangtaohz made their ...