sync with open source how #118
Draft
+927,308
−259,979
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#36737) * [BEAM-36736] Add state sampling for timer processing * Force CI to rebuild * Fix error with no state found * Fix error for Regex test * Resolve linting error * Add test case to test full functionality * Fix suffix issue * Fix formatting issues using tox -e yapf-check * Add test cases to test code paths * Address comments and remove extra test case * Remove user state context variable * Adjust state duration for test to avoid flakiness * Add different tests, remove no op scoped state, and address formatting/lint issues * Add patch to deal with CI presubmit errors * Adjust test case to not use dofn_runner * Test case failing presubmits, attempting to fix * Fix mocking for tests and ensure all pass * Remove extra test and increase retries on the process timer tests to avoid flakiness * Remove upper bound restriction and reduce retries * Remove unused suffix param. --------- Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com>
* Fix CSP issues * Add css folder to rat exclusion list.
* Fix inconsistent handling of Firestore Project and Database ID in routing header (resolves #36894) * Update CHANGED.md * Address reviewer comments from yixiaoshen * Fix unit tests * revert unnecessary change to read test * Revert unnecessary change to test helper
* fix retry scenario for query to table materialization * fix retry scenario for query to table materialization
* split hdfs into extra * CHANGES * tox * try/catch * test fixes * add to coverage tasks
* Test docker config to fix workflow. * enable buildx and load in python docker. * Another attempt by setting buildx project property. * Another attempt * Re-enable workflow and sickbay some failed tests for now. * Add release trigger
Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.20.11 to 1.20.12. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](aws/aws-sdk-go-v2@service/sns/v1.20.11...service/sns/v1.20.12) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager dependency-version: 1.20.12 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.57.1 to 1.57.2. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@storage/v1.57.1...storage/v1.57.2) --- updated-dependencies: - dependency-name: cloud.google.com/go/storage dependency-version: 1.57.2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
The beam-linkage-check.sh script previously used 'git rev-parse --abbrev-ref HEAD' to save the current position before switching branches. When in detached HEAD state (common when verifying PRs), this returns the string 'HEAD' instead of a valid ref, causing the cleanup function to fail to restore the original position. This change: - Uses 'git rev-parse HEAD' to get the full commit SHA instead of branch name - Adds '-c advice.detachedHead=false' to suppress warnings in cleanup - Adds explanatory comments Fixes #20558
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.44.0 to 0.45.0. - [Commits](golang/crypto@v0.44.0...v0.45.0) --- updated-dependencies: - dependency-name: golang.org/x/crypto dependency-version: 0.45.0 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Upgrade bom. * Test fix. * License. * License.
* Support for EnvoyRateLimiter in Apache Beam * fix format issues * fix test formatting * Fix test and syntax * fix lint * Add dependency based on python version * revert setup to separete pr * fix lint * fix formatting * resolve comments * Support Ratelimiter through RemoteModelHandler * fix lint * fix lint * fix comments * Add custom RateLimited Exception * fix doc * fix test * fix lint
* [Docs] Fix grammar: 'should triggered' -> 'should be triggered' * Apply spotless formatting
Co-authored-by: damccorm <actions@main-runner-vplcm-7jpcs.local>
Bumps [github.com/aws/aws-sdk-go-v2/credentials](https://github.com/aws/aws-sdk-go-v2) from 1.19.6 to 1.19.7. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](aws/aws-sdk-go-v2@service/m2/v1.19.6...service/m2/v1.19.7) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/credentials dependency-version: 1.19.7 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Add final exand pipeline ut * add gemini recommendation
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.95.0 to 1.95.1. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](aws/aws-sdk-go-v2@service/s3/v1.95.0...service/s3/v1.95.1) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/service/s3 dependency-version: 1.95.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…ks (#37292) Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.32.6 to 1.32.7. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](aws/aws-sdk-go-v2@v1.32.6...v1.32.7) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/config dependency-version: 1.32.7 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…#37155) * feat: Add support for custom prediction routes in Vertex AI inference using the `invoke_route` parameter and custom response parsing. * lint * lint 2 * fix: ensure invoke response is bytes and add type hint for request_body * test: mock `aiplatform.init` in VertexAI inference tests to prevent global state pollution. * lint * added the IT * added license * lint * updated endpoint * trigger postcommit * lint * lint * lint * fixed the response
Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.20.18 to 1.20.19. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](aws/aws-sdk-go-v2@service/emr/v1.20.18...feature/s3/manager/v1.20.19) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager dependency-version: 1.20.19 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Update trivial inference for Python 3.14 * correct comment * Address review coments * avoid none case being incorrect * fix docstring
* Catch Import Error * import order
* Update users.yml - fix bad role label @ksobrenat32 - is this correct? looks like only `beam_writer` failed. fyi @yalah5084 the previous change did not add the privileges so I'm trying to fix it here. * Update users.yml
…s. (#37294) Co-authored-by: Claude <cvandermerwe@google.com>
* Update neo4j resource manager * Fix a test log spam in it/common * Add back javadoc
Bumps [golang.org/x/sys](https://github.com/golang/sys) from 0.39.0 to 0.40.0. - [Commits](golang/sys@v0.39.0...v0.40.0) --- updated-dependencies: - dependency-name: golang.org/x/sys dependency-version: 0.40.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.48.0 to 0.49.0. - [Commits](golang/net@v0.48.0...v0.49.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-version: 0.49.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Remove standalone uses of the apitools HttpError class * Update sdks/python/apache_beam/testing/pipeline_verifiers_test.py Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * linting and formatting * more linting and formatting * even more linting --------- Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Please add a meaningful description for your change here
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, commentfixes #<ISSUE NUMBER>instead.CHANGES.mdwith noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.