sync with open source how - #118

Draft

lesterhaynes wants to merge 9698 commits into

linkedin:li_trunkfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Jul 22, 2026

Add drain states to PipelineResult (#39020)
lalitium
authored
51b2ad6
Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks (#39425)
dependabot[bot]
authored
ee44102
Interview with Raj Katakam from Intuit Credit Karma (#39412)

janaom
and
damccorm
authored
0dd4788
Document job management and interactive API protos (#39294)
damccorm
authored
22a5951
Prefer binary wheels when installing Python container dependencies (#39402)
aIbrahiim
authored
d2d7ef8
Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#39421)

dependabot[bot]
and
derrickaw
authored
3f3f18a
Bump cloud.google.com/go/storage from 1.63.1 to 1.64.0 in /sdks (#39422)

dependabot[bot]
and
derrickaw
authored
aa8869c
Fix pyrefly check bad-context-manager (#39418)
jrmccluskey
authored
583601b
[Experimental] Use zstd compression in Docker builds (#39409)
jrmccluskey
authored
aaad9b4
Fix silent per-char iteration when DoFn returns str/bytes/dict (#38429)

chrisqiqiu
and
jrmccluskey
authored
abe3fc7
Replace port with listeners in LocalKafka configuration
sjvanrossum
committed
7356d4b
Merge pull request #39043: Improve WithKeys coder inference context
adityaRaj369
authored
a15b880
Fix pyrefly check bad-specialization (#39419)
jrmccluskey
authored
b04ca1e
Fix pyrefly check bad-argument-count (#39416)
jrmccluskey
authored
c8a689f
[Gemini] Fix pyrefly check invalid-yield (#39417)
jrmccluskey
authored
da7693c
docs: Document pipeline runner API protos (#39292)
damccorm
authored
f1d9c3e

Commits on Jul 23, 2026

Commits on Jul 24, 2026

Commits on Jul 25, 2026

update tour of beam workflow go version (#39486)
derrickaw
authored
72d7ae3

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Bump torch (#39512)
dependabot[bot]
authored
dec8d23
OTEL in kafka. (#39151)
stankiewicz
authored
4160995
Bump golang.org/x/oauth2 from 0.7.0 to 0.27.0 in /playground/backend (#39524)
dependabot[bot]
authored
ec93d37
sdks/java: re-enable nullness checks in WithKeys (#39506)
kennknowles
authored
ad1e278
[Solace] Close the HTTP response content stream in BrokerResponse (#39404)
PDGGK
authored
9ae08d5
Avoid output inside try-catch in Java IO (#39124)

Aryankn29
and
gemini-code-assist[bot]
authored
9c82e05
Fix flaky AsyncWrapper reset_state test on Python 3.14 (#39521)
bvolpato
authored
dd463fa
Bump github.com/moby/moby/client from 0.5.0 to 0.5.1 in /sdks (#39517)
dependabot[bot]
authored
2eb3323
Bump github.com/aws/smithy-go from 1.27.4 to 1.27.5 in /sdks (#39519)
dependabot[bot]
authored
905ade4
Bump actions/stale from 10 to 11 (#39520)
dependabot[bot]
authored
cae3e17
Refactoring
Amar3tto
committed
2541fc7
Fix python formatter
Amar3tto
committed
315ed95
Bump scikit-learn (#39525)
dependabot[bot]
authored
f456c02
[Gemini] Fix pyrefly check bad-typed-dict-key (#39415)
jrmccluskey
authored
39c0dde
Add registerSqlOperator() to BeamSqlEnv for custom SQL operators (#39432)
damccorm
authored
2434619
OTEL in pubsub (#39150)
stankiewicz
authored
f258e3e
Add the directory with staged files to sys.path and document the usage (#39434)
tvalentyn
authored
55fde07
Replace non-PEP 585 types in watch.py (#39527)
jrmccluskey
authored
fc0d989
Update ruff and pyrefly dependencies (#39531)
jrmccluskey
authored
f20da8a
[Java IO] Add ArrowFlight IO connector (#37904)
bvolpato
authored
8473d90
Support JmsIO SchemaTransform and cross-lang (#39437)
Abacn
authored
2ee432b

Commits on Jul 29, 2026

Commits on Jul 30, 2026

Bump cloud.google.com/go/spanner from 1.93.0 to 1.94.0 in /sdks (#39550)
dependabot[bot]
authored
2c735b6
Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#39551)
dependabot[bot]
authored
c6e0f5b
Remove primaryKeyColumns options
Amar3tto
committed
b85646b
Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks (#39554)
dependabot[bot]
authored
2fd6af9
Fix spotless
Amar3tto
committed
5178343
Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#39553)
dependabot[bot]
authored
61fad4f
Set envs
Amar3tto
committed
bc991d9
Provide a better error when beam plugin was supplied but wasn't staged. (#39440)
tvalentyn
authored
525780e
Updates the Delta Lake source to support reading bounded change data (#39426)
chamikaramj
authored
f65e0e0
Fix module-level side effects and global random seeding in univariate ML anomaly tests (#39462)
Abacn
authored
4f93483
Merge pull request #39558 from apache/fix-auditkeys
Amar3tto
authored
8a7c972
Merge pull request #39457 from apache/debezium-io-yaml
Amar3tto
authored
0de9a67
Bump docker/login-action from 4.5.2 to 4.6.0 (#39552)
dependabot[bot]
authored
b9e4e2f
Preserve partitioning on temp FILE_LOADS tables (#38833)
PRADDZY
authored
f7d8d7c
fix AddFilesIT filter for BigLake (#39533)
aIbrahiim
authored
141804a
Enhance Python Timestamp to be precision-variable up to nanos, and map it to Timestamp logical type (#39537)

ahmedabu98
and
Ahmed Abualsaud
authored
f5feab8
Buffer BufferedLogger by newline to avoid log splitting (#39288)
shunping
authored
7b9380b
Fix DataflowOutputCounter calculation for ValueInEmptyWindows (#39487)
shunping
authored
03db1a0
[IcebergIO] Upgrade Iceberg dependency to 1.11.0 (#39559)

peterphitran
and
Abacn
authored
b8d77b8

Commits on Jul 31, 2026

Commits on Aug 1, 2026

update containers (#39575)
ahmedabu98
authored
5196676

Commits on Aug 3, 2026

Fix flaky FileIOTest.testMatchWatchForNewFiles test under CI filesystems (#38047)
bvolpato
authored
e4779cf
Bump google.golang.org/grpc from 1.82.1 to 1.83.0 in /sdks (#39585)
dependabot[bot]
authored
7f96ee4
Bump github/codeql-action from 4.37.3 to 4.37.4 (#39586)
dependabot[bot]
authored
93af678
Support core dump analysis with pystack and gdb. (#39484)
tvalentyn
authored
8b4c675
Bump github.com/nats-io/nats-server/v2 from 2.14.3 to 2.14.4 in /sdks (#39584)
dependabot[bot]
authored
a72451d
[Docs] Update Flink version references on the Flink runner page (#39212)
Eliaaazzz
authored
3a02af8
Fix dataframe CSV tests on Windows (#39563)
Guflly
authored
539b048
Support array-valued schema options in Python (#39583)
bvolpato
authored
4d3e1f0
Feat: new cleaning rule to orphaned subscriptions (#39538)
HansMarcus01
authored
f073408
[Docs] Add CHANGES entries for Python UnboundedSource and Watch (#39579)

authored
db57e4a
Fix internal test failure after #39487 (#39591)
shunping
authored
a6b3399
Add query_output_schema to ReadFromBigQuery for BEAM_ROW + query support (#39160)

nikitagrover19
and
Nikita Grover
authored
52f6e46
[DebeziumIO] Upgrade to Debezium 3.5.2.Final (#39569)
tkaymak
authored
f3e12fe
[Python] Bound Watch state with a timestamp cursor (#39090)
Eliaaazzz
authored
82c6ee4
Redistribute - trace propagation (#39590)
stankiewicz
authored
789e1d1
update containers (#39596)
ahmedabu98
authored
83821eb
remove gsutil usage (#39448)
derrickaw
authored
a89b9f7
[Iceberg CDC] Add Changelog readers and update resolver (#38837)

ahmedabu98
and
Ahmed Abualsaud
authored
c4b4bda

Commits on Aug 4, 2026

Commits on Aug 5, 2026

Bump zizmorcore/zizmor-action from 0.6.1 to 0.6.2 (#39604)
dependabot[bot]
authored
14c61d1
Adds the Delta Lake CDC read transforms to the Managed I/O API (#39599)
chamikaramj
authored
86ca053
mention otel in changes (#39618)
stankiewicz
authored
aa7f74c
Support sharded coder for Prism runner cross-lang (#39623)
Abacn
authored
1508227
Fix Dataflow ValueProvider serialization (#39614)
bvolpato
authored
c2c910a
Deflake JmsIO tests (#39571)
Abacn
authored
a0f3518
[Docs] Add a contributor guide for running Python on a local Flink cluster (#39580)
Eliaaazzz
authored
16f471e
fix PostCommit Python Dependency
aIbrahiim
committed
7ec43af
Merge pull request #39637 from aIbrahiim/fix-postcommit-pydep-pyarrow
Amar3tto
authored
7712ac6
fix(dataframe): claim remaining restriction range on empty/header-only CSV reads (#39581)
ManvithPanyam
authored
48c9e1f
[Iceberg CDC] Finish wiring CDC source together and add external API (#39600)

ahmedabu98
and
Ahmed Abualsaud
authored
c60b021
Updates CHANGES.md to include Delta Lake CDC
chamikaramj
committed
cb75d1b
Merge pull request #39644 from chamikaramj/update_change_log
Amar3tto
authored
8a5d5d2
add Timestamp.MICROS for iceberg timestamptz (#39592)
aIbrahiim
authored
e793e8a
Add google-api-python-client to Python 3.14 container (#39640)
Abacn
authored
e2ae447

Commits on Aug 6, 2026

add aws hadoop to DeltaIO (#39617)
derrickaw
authored
8bf709c
[Dataflow Streaming] Remove finalizeCommits from processWork (#39648)
arunpandianp
authored
02ff297
Update CHANGES.md for new release
Amar3tto
committed
71a7efe
Moving to 2.77.0-SNAPSHOT on master branch.

Amar3tto
authored and
Amar3tto
committed
cc822c0
Bump github/codeql-action from 4.37.4 to 4.37.5 (#39651)
dependabot[bot]
authored
92de1e4
[Dataflow Streaming] Remove redundant onKeyTransition call (#39652)
arunpandianp
authored
eea1e03
Fix Python 3.14 Container Build, Streamline Installation (#39659)
jrmccluskey
authored
c7a8f93

Commits on Aug 7, 2026

Commits on Aug 8, 2026

fix ensurepip bundled pip cleanup for Python 3.12+ containers (#39683)
aIbrahiim
authored
559d22c

Commits on Aug 10, 2026

Commits on Aug 11, 2026

Commits on Aug 12, 2026

Commits on Aug 13, 2026

[IcebergIO] Serialize using json partition (#39705)
ahmedabu98
authored
369409e

Commits on Aug 14, 2026

Commits on Aug 15, 2026

Commits on Aug 17, 2026

Commits on Aug 18, 2026

Commits on Aug 19, 2026