Skip to content

[SYSTEMDS-3958] Add XML options for sparse rewrites - #2579

Open
ywcb00 wants to merge 4 commits into
apache:mainfrom
ywcb00:feat/sparsity/rewrites/integrate
Open

[SYSTEMDS-3958] Add XML options for sparse rewrites#2579
ywcb00 wants to merge 4 commits into
apache:mainfrom
ywcb00:feat/sparsity/rewrites/integrate

Conversation

@ywcb00

@ywcb00 ywcb00 commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

This PR adds the XML options for enabling rewrites based on sparsity estimates and for specifying the respective sparsity estimator. Additionally, this PR introduces the enumeration for the estimator type and renames the previous activation flag, which now only applies to transposition rewrites.

ywcb00 added 2 commits August 5, 2026 15:29
…rsity estimator

	NOTE: This option also enables the sparsity rewrites. This will be separated into an individual option soon.

feat(main/hops/EstimationUtils.java): create static method to get the sparsity estimator by a given string identifier

refactor(main/hops/rewrite/ProgramRewriter.java): separate the conditioned cases for enabling sparsity mm chain rewrites and transpose mm chain rewrites

refactor(main/hops/OptimizerUtils.java): rename flag for enabling transpose mm chain rewrites

chore(test/**): adapt to the changes above
…ng sparsity rewrites

	change sparsity estimator option from being the string identifier to the actual enumeration item

refactor(main/hops/estim/EstimationUtils.java): add method to get estimator type from identifier string
	add method to obtain an estimator object directly

chore(**): adapt to the above changes

chore(test/functions/rewrite/RewriteMatrixMultChainOptSparseTest.java): adapt to separate CLI option for enabling sparsity rewrites
@codecov

codecov Bot commented Aug 5, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 63.63636% with 12 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.48%. Comparing base (f45b14a) to head (806352a).
⚠️ Report is 5 commits behind head on main.

Files with missing lines Patch % Lines
...a/org/apache/sysds/hops/estim/EstimationUtils.java 52.00% 11 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2579      +/-   ##
============================================
+ Coverage     71.44%   71.48%   +0.03%     
- Complexity    50406    50444      +38     
============================================
  Files          1629     1629              
  Lines        195331   195491     +160     
  Branches      38078    38114      +36     
============================================
+ Hits         139561   139749     +188     
+ Misses        44836    44796      -40     
- Partials      10934    10946      +12     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ywcb00 ywcb00 changed the title [SYSTEMDS-3958] Add CLI options for sparse rewrites [SYSTEMDS-3958] Add XML options for sparse rewrites Aug 6, 2026
ywcb00 added 2 commits August 6, 2026 16:30
…sity rewrites and for selecting the respective sparsity estimator

fix(main/api/DMLOptions.java): revert adding the cli options for enabling sparsity rewrites and selecting the sparsity estimator

fix(main/api/DMLScript.java): revert adding the cli options for enabling sparsity rewrites and selecting the sparsity estimator

chore(main/hops/rewrite/ProgramRewriter.java): adapt to the changes above

chore(test/RewriteMatrixMultChainOptSparseTest.java): rewrite the XML config file to enable the sparsity rewrites instead of setting the CLI option
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: In Progress

Development

Successfully merging this pull request may close these issues.

1 participant