Skip to content

ci: fix dbt release detection in the release check - #346

Merged
tnazarew merged 1 commit into
mainfrom
ci/fix-dbt-release-check
Oct 21, 2026
Merged

tnazarew merged 1 commit into
mainfrom
ci/fix-dbt-release-check

Conversation

@tnazarew

Copy link
Copy Markdown
Collaborator

The daily release check (main_new_release.yml → scripts/select_components.sh) has never detected a dbt release after 1.8.0. generated-files/releases.json still says 1.8.0, while PyPI has 1.12.6.

Cause

The latest version was read from the LATEST: line of pip index versions dbt-core. pip index is experimental, and its current output no longer has that line (it prints dbt-core (1.12.6) and Available versions: ...). So:

  1. latest_dbt came out empty.
  2. version_sum "" evaluated to 0.
  3. The check concluded nothing was newer.

There was no error anywhere, as the last run's log shows.

Fix

  • The version comes from PyPI's JSON API: https://pypi.org/pypi/dbt-core/json, .info.version.
  • If the lookup returns nothing, the script prints an ::error:: annotation and keeps the current version, instead of failing silently.

Effect on the next daily run

  • releases.json is updated to 1.12.6, and 1.12.6 is added to the dbt matrix.
  • No dbt tests will actually run for it yet: the only scenario, csv_to_postgres, is limited to dbt 1.8.0–1.8.0 in its config.json, so the dbt job finds no valid scenarios for 1.12.6. Testing newer dbt needs that limit raised, and possibly new expected events. That's a separate change.

Testing

Ran scripts/select_components.sh locally with a scratch GITHUB_OUTPUT. Output: ol_release=1.54.0, dbt_release=1.12.6, releases_updated=true, and updated-releases.json has dbt 1.12.6.

🤖 Generated with Claude Code

select_components.sh took the latest dbt-core version from the LATEST: line of
`pip index versions`, an experimental command whose output no longer has that line.
The version came out empty, counted as 0, and releases.json stayed at dbt 1.8.0
while PyPI has 1.12.6. The version now comes from PyPI's JSON API, and an empty
result is reported as an error annotation instead of being silently ignored.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>
@tnazarew
tnazarew marked this pull request as ready for review October 21, 2026 21:29
@tnazarew
tnazarew force-pushed the ci/fix-dbt-release-check branch from 7ba24e8 to c8fa07c Compare October 21, 2026 21:29
@tnazarew
tnazarew merged commit 8d394d4 into main Oct 21, 2026
10 checks passed
@tnazarew
tnazarew deleted the ci/fix-dbt-release-check branch October 21, 2026 21:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant