Skip to content

[spark] Correct MigrateTableProcedureTest with set target table iterations#8167

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/fix-ut
Open

[spark] Correct MigrateTableProcedureTest with set target table iterations#8167
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/fix-ut

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • MigrateTable UT is flaky and causes CI failures.
  • The UT runs 3 migrate $format for (parquet/orc/avro) with the same hive_tbl_$random and target_$random (same random shared at class level).
  • Run 2 re-uses cached HMS values from SessionCatalog.tableRelationCache from run 1, which is a parquet file, and appends .orc to it. (making it an invalid .parquet.orc when the entries are cached).
  • This causes the UT to fail, ensure we can use different names to avoid cache collision

Tests

  • UT now passes

@ArnavBalyan

Copy link
Copy Markdown
Member Author

cc @JingsongLi @leaves12138 could you pls take a look when possible thanks!

@ArnavBalyan ArnavBalyan changed the title [spark] Correct MigrateTableProcedureTest "with set target table" iterations [spark] Correct MigrateTableProcedureTest with set target table iterations Jun 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant