This is an archive of the discontinued LLVM Phabricator instance.

Differential D143514

[mlir][sparse] Port the remaining integration tests to use SVE
ClosedPublic

Authored by awarzynski on Feb 7 2023, 9:49 AM.

Details

Reviewers
aartbik
nicolasvasilache
bixia
PeimingLiu
Commits
rGbfe4ce3f8339: [mlir][sparse] Port the remaining integration tests to use SVE
Summary

This patch updates the remaining SparseCompiler integration tests to
target SVE when available.

TODO: Triage sparse_matmul.mlir and sparse_tanh.mlir

[1] https://github.com/llvm/llvm-project/issues/58531

Diff Detail

Event Timeline

awarzynski created this revision.Feb 7 2023, 9:49 AM
Herald added a reviewer: aartbik. · View Herald TranscriptFeb 7 2023, 9:49 AM
Herald added a reviewer: aartbik. · View Herald Transcript
Herald added a project: Restricted Project. · View Herald Transcript
Herald added subscribers: hanchung, jsetoain, Moerafaat and 27 others. · View Herald Transcript
awarzynski requested review of this revision.Feb 7 2023, 9:49 AM
Herald added a reviewer: nicolasvasilache. · View Herald TranscriptFeb 7 2023, 9:49 AM
Herald added a project: Restricted Project. · View Herald Transcript
Herald added subscribers: stephenneuendorffer, nicolasvasilache. · View Herald Transcript
awarzynski added reviewers: bixia, PeimingLiu.Feb 7 2023, 9:51 AM
Harbormaster completed remote builds in B212426: Diff 495580.Feb 7 2023, 11:21 AM
aartbik added inline comments.Feb 7 2023, 12:12 PM
mlir/test/Integration/Dialect/SparseTensor/CPU/concatenate.mlir
18

We actually always run this right? If so, we should really make this (here and everywhere)

// Do the same run, but now with direct IR generation and, if available, VLA

Matt added a subscriber: Matt.Feb 7 2023, 8:32 PM
awarzynski updated this revision to Diff 495828.Feb 8 2023, 6:33 AM
  • Updated comments (as per suggestion from @aartbik)
  • Fixed options that are passed to mlir-opt (with these changes most tests pass)

There are currently two tests that are XFAIL'ed - I will triage them shortly.

Tested with:

  • cmake -DMLIR_INCLUDE_INTEGRATION_TESTS=On -DMLIR_RUN_ARM_SVE_TESTS=On <other cmake flags>
  • cmake -DMLIR_INCLUDE_INTEGRATION_TESTS=On -DMLIR_RUN_ARM_SVE_TESTS=On -DARM_EMULATOR_EXECUTABLE="qemu-aarch64" -DARM_EMULATOR_LLI_EXECUTABLE=<build-dir>/bin/lli <other cmake flags>
Herald added a subscriber: wenlei. · View Herald TranscriptFeb 8 2023, 6:33 AM
Harbormaster completed remote builds in B212594: Diff 495828.Feb 8 2023, 6:50 AM
awarzynski updated this revision to Diff 495839.Feb 8 2023, 7:18 AM

Split "sparse_reduce_custom.mlir" into two tests

I've split sparse_reduce_custom.mlir into:

  • "sparse_reduce_custom.mlir", and
  • "sparse_reduce_custom_prod.mlir".

The latter contains product reducitons that are currently supported on AArch64. We did the same for
"sparse_reductions.mlir" in https://reviews.llvm.org/D121304.

awarzynski updated this revision to Diff 495841.Feb 8 2023, 7:20 AM

Add the missing test file

awarzynski edited the summary of this revision. (Show Details)Feb 8 2023, 7:21 AM
awarzynski updated this revision to Diff 495842.Feb 8 2023, 7:23 AM

Actually adds the file, sorry for the noise.

Harbormaster completed remote builds in B212607: Diff 495842.Feb 8 2023, 7:41 AM
aartbik accepted this revision.Feb 8 2023, 12:38 PM

Note that in the long run it would perhaps be desirable to really skip the run if there is no VLA available, since we now do another similar run in most cases, which wastes testing resources.
But it is okay to proceed for now. Perhaps add one TODO in the lit setup for this, so we remember.

This revision is now accepted and ready to land.Feb 8 2023, 12:38 PM
Closed by commit rGbfe4ce3f8339: [mlir][sparse] Port the remaining integration tests to use SVE (authored by awarzynski). · Explain WhyFeb 9 2023, 2:16 AM
This revision was automatically updated to reflect the committed changes.
awarzynski added a commit: rGbfe4ce3f8339: [mlir][sparse] Port the remaining integration tests to use SVE.
awarzynski added a comment.Feb 9 2023, 2:50 AM

Thanks for reviewing!

In D143514#4113722, @aartbik wrote:

Note that in the long run it would perhaps be desirable to really skip the run if there is no VLA available, since we now do another similar run in most cases, which wastes testing resources.
But it is okay to proceed for now.

I have also thought about it and created https://github.com/llvm/llvm-project/issues/60628 to track this.

Btw, I created https://github.com/llvm/llvm-project/issues/60626 for the outstanding issues with the generated output.

frgossen added a subscriber: frgossen.Feb 9 2023, 11:29 AM
frgossen added inline comments.
mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_out_mult_elt.mlir
20

The enable-runtime-library=false option causes the values to be slightly different in our tests.
Instead of (14, 20, 0, 0) the values are only close to 0 (14, 20, -1.21979e-12, -1.21979e-12).
Any idea why?

frgossen added inline comments.Feb 9 2023, 11:33 AM
mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_out_reduction.mlir
20

We run into a similar issue here. Here, it is ( 7, 69, -1414812757, -1414812757 ) when ( 7, 69, 0, 0 ) is expected

Peiming added a subscriber: Peiming.Feb 9 2023, 11:37 AM
Peiming added inline comments.
mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_out_mult_elt.mlir
20

Probably because we allocated more than needed (because it is impossible to know the nnz beforehand), and values after "20" are uninitialized random value, this should not cause problem as we would access it.

You can try out enable-buffer-initialization=true to force sparse compiler to zero out newly allocated memory and see.

20

Probably because we allocated more than needed (because it is impossible to know the nnz beforehand), and values after "20" are uninitialized random value, this should not cause problem as we would access it.

Sorry, *would not

awarzynski added a comment.Feb 9 2023, 11:44 AM

@frgossen , I'm sorry that you are hitting these issues :(

The enable-runtime-library=false option causes the values to be slightly different in our tests. Instead of (14, 20, 0, 0) the values are only close to 0 (14, 20, -1.21979e-12, -1.21979e-12). Any idea why?

No, sorry. But perhaps we should be using fpcmp for verifying FP output 🤔 .

clang-aarch64-sve-vla (which runs these tests) is green, so ideally I would avoid reverting this change. Perhaps you could blacklist the failing tests and create a GitHub ticket like https://github.com/llvm/llvm-project/issues/60626? We may need to approach this on a case-by-case basis.

aartbik added a comment.Feb 9 2023, 12:43 PM

Fix in https://reviews.llvm.org/D143674

(our new push_back uses size/capacity a bit different, so a vector_transfer+print may see unitialized memory, which is why the enable-buffer-initialization was introduced to make sure memory is consistent)

if there are issues beyond this problem, please let me know!

Revision Contents

PathSize
mlir/
test/
Integration/
Dialect/
SparseTensor/
CPU/
21 lines
22 lines
21 lines
21 lines
21 lines
2 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
21 lines
23 lines
23 lines
21 lines
21 lines
22 lines
25 lines
2 lines
2 lines
21 lines
2 lines
19 lines
19 lines
19 lines
25 lines
21 lines
2 lines
2 lines
21 lines
21 lines
2 lines
17 lines
2 lines
21 lines
24 lines
2 lines
21 lines
19 lines
24 lines
19 lines
2 lines
2 lines
2 lines
21 lines
19 lines
19 lines
23 lines
2 lines
21 lines
2 lines
22 lines
21 lines
24 lines
21 lines
21 lines
27 lines
21 lines
21 lines

Diff 495828

mlir/test/Integration/Dialect/SparseTensor/CPU/concatenate.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
aartbikUnsubmitted
Not Done
ReplyInline Actions

We actually always run this right? If so, we should really make this (here and everywhere)

// Do the same run, but now with direct IR generation and, if available, VLA

aartbik: We actually always run this right? If so, we should really make this (here and everywhere) //…
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#MAT_C_C = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}> #MAT_C_C = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}>
#MAT_D_C = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}> #MAT_D_C = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}>
#MAT_C_D = #sparse_tensor.encoding<{dimLevelType = ["compressed", "dense"]}> #MAT_C_D = #sparse_tensor.encoding<{dimLevelType = ["compressed", "dense"]}>
#MAT_D_D = #sparse_tensor.encoding<{ #MAT_D_D = #sparse_tensor.encoding<{
dimLevelType = ["dense", "dense"], dimLevelType = ["dense", "dense"],
dimOrdering = affine_map<(i,j) -> (j,i)> dimOrdering = affine_map<(i,j) -> (j,i)>
}> }>
▲ Show 20 Lines • Show All 531 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/dense_output.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: TENSOR0="%mlir_src_dir/test/Integration/data/test.mtx" \ // DEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.mtx" \
// DEFINE: mlir-cpu-runner \ // DEFINE: mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.mtx" \
// REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
!Filename = !llvm.ptr<i8> !Filename = !llvm.ptr<i8>
#DenseMatrix = #sparse_tensor.encoding<{ #DenseMatrix = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "dense" ], dimLevelType = [ "dense", "dense" ],
dimOrdering = affine_map<(i,j) -> (i,j)> dimOrdering = affine_map<(i,j) -> (i,j)>
}> }>
▲ Show 20 Lines • Show All 84 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/dense_output_f16.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#DenseVector = #sparse_tensor.encoding<{dimLevelType = ["dense"]}> #DenseVector = #sparse_tensor.encoding<{dimLevelType = ["dense"]}>
#trait_vec_op = { #trait_vec_op = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)>, // a (in) affine_map<(i) -> (i)>, // a (in)
affine_map<(i) -> (i)>, // b (in) affine_map<(i) -> (i)>, // b (in)
▲ Show 20 Lines • Show All 77 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_abs.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }> #SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }>
#trait_op = { #trait_op = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)>, // a affine_map<(i) -> (i)>, // a
affine_map<(i) -> (i)> // x (out) affine_map<(i) -> (i)> // x (out)
], ],
▲ Show 20 Lines • Show All 103 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_binary.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#DCSR = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}> #DCSR = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}>
// //
// Traits for tensor operations. // Traits for tensor operations.
// //
#trait_vec_scale = { #trait_vec_scale = {
▲ Show 20 Lines • Show All 546 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_cast.mlir

Show All 9 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \ // REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s // REDEFINE: FileCheck %s
▲ Show 20 Lines • Show All 255 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_codegen_dim.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#DCSR = #sparse_tensor.encoding<{ #DCSR = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed"] dimLevelType = [ "compressed", "compressed"]
}> }>
module { module {
// //
// Main driver. // Main driver.
Show All 31 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_codegen_foreach.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#Row = #sparse_tensor.encoding<{ #Row = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "dense" ] dimLevelType = [ "compressed", "dense" ]
}> }>
#CSR = #sparse_tensor.encoding<{ #CSR = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "compressed" ] dimLevelType = [ "dense", "compressed" ]
}> }>
▲ Show 20 Lines • Show All 238 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_complex32.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#trait_op = { #trait_op = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)>, // a (in) affine_map<(i) -> (i)>, // a (in)
affine_map<(i) -> (i)>, // b (in) affine_map<(i) -> (i)>, // b (in)
affine_map<(i) -> (i)> // x (out) affine_map<(i) -> (i)> // x (out)
▲ Show 20 Lines • Show All 103 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_complex64.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#trait_op = { #trait_op = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)>, // a (in) affine_map<(i) -> (i)>, // a (in)
affine_map<(i) -> (i)>, // b (in) affine_map<(i) -> (i)>, // b (in)
affine_map<(i) -> (i)> // x (out) affine_map<(i) -> (i)> // x (out)
▲ Show 20 Lines • Show All 103 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_complex_ops.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#trait_op1 = { #trait_op1 = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)>, // a (in) affine_map<(i) -> (i)>, // a (in)
affine_map<(i) -> (i)> // x (out) affine_map<(i) -> (i)> // x (out)
], ],
▲ Show 20 Lines • Show All 242 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_constant_to_sparse_tensor.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#Tensor1 = #sparse_tensor.encoding<{ #Tensor1 = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed"] dimLevelType = [ "compressed", "compressed"]
}> }>
// //
// Integration tests for conversions from sparse constants to sparse tensors. // Integration tests for conversions from sparse constants to sparse tensors.
// //
Show All 36 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conv_1d_nwc_wcf.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#CCC = #sparse_tensor.encoding<{ #CCC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed" ] }> dimLevelType = [ "compressed", "compressed", "compressed" ] }>
#CDC = #sparse_tensor.encoding<{ #CDC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "dense", "compressed" ] dimLevelType = [ "compressed", "dense", "compressed" ]
// FIXME: Still inadmissible might need investigation // FIXME: Still inadmissible might need investigation
// dimOrdering = affine_map<(i,j,k) -> (j,k,i)> // dimOrdering = affine_map<(i,j,k) -> (j,k,i)>
▲ Show 20 Lines • Show All 110 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conv_2d.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#DCSR = #sparse_tensor.encoding<{ dimLevelType = [ "compressed", "compressed" ] }> #DCSR = #sparse_tensor.encoding<{ dimLevelType = [ "compressed", "compressed" ] }>
#CSR = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}> #CSR = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}>
#CSC = #sparse_tensor.encoding<{ #CSC = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "compressed" ], dimLevelType = [ "dense", "compressed" ],
dimOrdering = affine_map<(i,j) -> (j,i)> dimOrdering = affine_map<(i,j) -> (j,i)>
}> }>
▲ Show 20 Lines • Show All 191 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conv_2d_nhwc_hwcf.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#CCCC = #sparse_tensor.encoding<{ #CCCC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed", "compressed", "compressed" ]
}> }>
#CDCD = #sparse_tensor.encoding<{ #CDCD = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "dense", "compressed", "dense" ] dimLevelType = [ "compressed", "dense", "compressed", "dense" ]
}> }>
▲ Show 20 Lines • Show All 154 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conv_3d.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#CCC = #sparse_tensor.encoding<{ #CCC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed", "compressed" ]
}> }>
#CDC = #sparse_tensor.encoding<{ #CDC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "dense", "compressed" ] dimLevelType = [ "compressed", "dense", "compressed" ]
}> }>
▲ Show 20 Lines • Show All 201 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conv_3d_ndhwc_dhwcf.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#CCCCC = #sparse_tensor.encoding<{ #CCCCC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed", "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed", "compressed", "compressed", "compressed" ]
}> }>
#CDCDC = #sparse_tensor.encoding<{ #CDCDC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "dense", "compressed", "dense", "compressed"] dimLevelType = [ "compressed", "dense", "compressed", "dense", "compressed"]
}> }>
▲ Show 20 Lines • Show All 221 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conversion.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#Tensor1 = #sparse_tensor.encoding<{ #Tensor1 = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed", "compressed" ],
dimOrdering = affine_map<(i,j,k) -> (i,j,k)> dimOrdering = affine_map<(i,j,k) -> (i,j,k)>
}> }>
#Tensor2 = #sparse_tensor.encoding<{ #Tensor2 = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed", "compressed" ],
▲ Show 20 Lines • Show All 280 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conversion_dyn.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 reassociate-fp-reductions=true enable-index-optimizations=true enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#DCSR = #sparse_tensor.encoding<{ #DCSR = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed" ]
}> }>
#DCSC = #sparse_tensor.encoding<{ #DCSC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed" ],
dimOrdering = affine_map<(i,j) -> (j,i)> dimOrdering = affine_map<(i,j) -> (j,i)>
▲ Show 20 Lines • Show All 87 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conversion_ptr.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 reassociate-fp-reductions=true enable-index-optimizations=true enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#DCSR = #sparse_tensor.encoding<{ #DCSR = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed" ],
pointerBitWidth = 8, pointerBitWidth = 8,
indexBitWidth = 8 indexBitWidth = 8
}> }>
#DCSC = #sparse_tensor.encoding<{ #DCSC = #sparse_tensor.encoding<{
▲ Show 20 Lines • Show All 127 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conversion_sparse2dense.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#Tensor1 = #sparse_tensor.encoding<{ #Tensor1 = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed", "compressed" ],
dimOrdering = affine_map<(i,j,k) -> (i,j,k)> dimOrdering = affine_map<(i,j,k) -> (i,j,k)>
}> }>
#Tensor2 = #sparse_tensor.encoding<{ #Tensor2 = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed", "compressed" ],
▲ Show 20 Lines • Show All 203 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_conversion_sparse2sparse.mlir

// Force this file to use the kDirect method for sparse2sparse. // Force this file to use the kDirect method for sparse2sparse.
// DEFINE: %{option} = "enable-runtime-library=true s2s-strategy=2" // DEFINE: %{option} = "enable-runtime-library=true s2s-strategy=2"
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false s2s-strategy=2" // REDEFINE: %{option} = "enable-runtime-library=false s2s-strategy=2"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false s2s-strategy=2 vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false s2s-strategy=2 vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#Tensor1 = #sparse_tensor.encoding<{ #Tensor1 = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "dense", "compressed" ] dimLevelType = [ "dense", "dense", "compressed" ]
}> }>
// NOTE: dense after compressed is not currently supported for the target // NOTE: dense after compressed is not currently supported for the target
// of direct-sparse2sparse conversion. (It's fine for the source though.) // of direct-sparse2sparse conversion. (It's fine for the source though.)
#Tensor2 = #sparse_tensor.encoding<{ #Tensor2 = #sparse_tensor.encoding<{
▲ Show 20 Lines • Show All 177 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_dot.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }> #SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }>
module { module {
// //
// Sparse kernel. // Sparse kernel.
// //
▲ Show 20 Lines • Show All 53 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_expand.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // RUN: %{compile} | %{run}
// RUN: %{command}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#CSC = #sparse_tensor.encoding<{ #CSC = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "compressed" ], dimLevelType = [ "dense", "compressed" ],
dimOrdering = affine_map<(i,j) -> (j,i)> dimOrdering = affine_map<(i,j) -> (j,i)>
}> }>
module { module {
func.func private @printMemrefF64(%ptr : tensor<*xf64>) func.func private @printMemrefF64(%ptr : tensor<*xf64>)
▲ Show 20 Lines • Show All 68 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_file_io.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \ // DEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" TENSOR1="" \
// DEFINE: TENSOR1="" \
// DEFINE: mlir-cpu-runner \ // DEFINE: mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" TENSOR1="" \
// REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
!Filename = !llvm.ptr<i8> !Filename = !llvm.ptr<i8>
!TensorReader = !llvm.ptr<i8> !TensorReader = !llvm.ptr<i8>
!TensorWriter = !llvm.ptr<i8> !TensorWriter = !llvm.ptr<i8>
module { module {
func.func private @getTensorFilename(index) -> (!Filename) func.func private @getTensorFilename(index) -> (!Filename)
▲ Show 20 Lines • Show All 181 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_filter_conv2d.mlir

Show All 9 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \ // REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s // REDEFINE: FileCheck %s
▲ Show 20 Lines • Show All 92 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_flatten.mlir

Show All 10 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.tns" \ // REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.tns" \
// REDEFINE: %lli \ // REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
▲ Show 20 Lines • Show All 89 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_index.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{ #SparseVector = #sparse_tensor.encoding<{
dimLevelType = ["compressed"] dimLevelType = ["compressed"]
}> }>
#SparseMatrix = #sparse_tensor.encoding<{ #SparseMatrix = #sparse_tensor.encoding<{
dimLevelType = ["compressed", "compressed"] dimLevelType = ["compressed", "compressed"]
}> }>
▲ Show 20 Lines • Show All 258 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_index_dense.mlir

Show All 9 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \ // REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s // REDEFINE: FileCheck %s
▲ Show 20 Lines • Show All 184 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_insert_1d.mlir

// DEFINE: %{option} = enable-runtime-library=false // DEFINE: %{option} = enable-runtime-library=false
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with vectorization. // Do the same run, but now with vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
// Insertion example using pure codegen (no sparse runtime support lib). // Insertion example using pure codegen (no sparse runtime support lib).
#SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }> #SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }>
#trait_mul_s = { #trait_mul_s = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)> // x (out) affine_map<(i) -> (i)> // x (out)
▲ Show 20 Lines • Show All 78 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_insert_2d.mlir

// DEFINE: %{option} = enable-runtime-library=false // DEFINE: %{option} = enable-runtime-library=false
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with vectorization. // Do the same run, but now with vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#Dense = #sparse_tensor.encoding<{ #Dense = #sparse_tensor.encoding<{
dimLevelType = ["dense", "dense"] dimLevelType = ["dense", "dense"]
}> }>
#SortedCOO = #sparse_tensor.encoding<{ #SortedCOO = #sparse_tensor.encoding<{
dimLevelType = [ "compressed-nu", "singleton" ] dimLevelType = [ "compressed-nu", "singleton" ]
}> }>
▲ Show 20 Lines • Show All 216 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_insert_3d.mlir

// DEFINE: %{option} = enable-runtime-library=false // DEFINE: %{option} = enable-runtime-library=false
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with vectorization. // Do the same run, but now with vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#TensorCSR = #sparse_tensor.encoding<{ #TensorCSR = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "dense", "compressed" ] dimLevelType = [ "compressed", "dense", "compressed" ]
}> }>
#TensorRow = #sparse_tensor.encoding<{ #TensorRow = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "dense" ] dimLevelType = [ "compressed", "compressed", "dense" ]
}> }>
▲ Show 20 Lines • Show All 198 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_matmul.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with parallelization strategy. // Do the same run, but now with parallelization strategy.
// REDEFINE: %{option} = "enable-runtime-library=true parallelization-strategy=any-storage-any-loop" // REDEFINE: %{option} = "enable-runtime-library=true parallelization-strategy=any-storage-any-loop"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and parallelization strategy. // Do the same run, but now with direct IR generation and parallelization strategy.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true parallelization-strategy=any-storage-any-loop" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true parallelization-strategy=any-storage-any-loop"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#CSR = #sparse_tensor.encoding<{ #CSR = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "compressed" ], dimLevelType = [ "dense", "compressed" ],
dimOrdering = affine_map<(i,j) -> (i,j)> dimOrdering = affine_map<(i,j) -> (i,j)>
}> }>
#DCSR = #sparse_tensor.encoding<{ #DCSR = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed" ],
▲ Show 20 Lines • Show All 281 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_matrix_ops.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#DCSR = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}> #DCSR = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}>
// //
// Traits for 2-d tensor (aka matrix) operations. // Traits for 2-d tensor (aka matrix) operations.
// //
#trait_scale = { #trait_scale = {
indexing_maps = [ indexing_maps = [
▲ Show 20 Lines • Show All 174 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_matvec.mlir

Show All 17 Lines
// Do the same run, but now with direct IR generation and parallelization strategy. // Do the same run, but now with direct IR generation and parallelization strategy.
// REDEFINE: %{option} = "enable-runtime-library=false parallelization-strategy=any-storage-any-loop" // REDEFINE: %{option} = "enable-runtime-library=false parallelization-strategy=any-storage-any-loop"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \ // REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \
// REDEFINE: %lli \ // REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
▲ Show 20 Lines • Show All 92 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_mttkrp.mlir

Show All 10 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/mttkrp_b.tns" \ // REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/mttkrp_b.tns" \
// REDEFINE: %lli \ // REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext -dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext| \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext -dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext| \
▲ Show 20 Lines • Show All 117 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_out_mult_elt.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
frgossenUnsubmitted
Not Done
ReplyInline Actions

The enable-runtime-library=false option causes the values to be slightly different in our tests.
Instead of (14, 20, 0, 0) the values are only close to 0 (14, 20, -1.21979e-12, -1.21979e-12).
Any idea why?

frgossen: The `enable-runtime-library=false` option causes the values to be slightly different in our…
PeimingUnsubmitted
Not Done
ReplyInline Actions

Probably because we allocated more than needed (because it is impossible to know the nnz beforehand), and values after "20" are uninitialized random value, this should not cause problem as we would access it.

You can try out enable-buffer-initialization=true to force sparse compiler to zero out newly allocated memory and see.

Peiming: Probably because we allocated more than needed (because it is impossible to know the nnz…
PeimingUnsubmitted
Not Done
ReplyInline Actions

Probably because we allocated more than needed (because it is impossible to know the nnz beforehand), and values after "20" are uninitialized random value, this should not cause problem as we would access it.

Sorry, *would not

Peiming: > Probably because we allocated more than needed (because it is impossible to know the nnz…
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#DCSR = #sparse_tensor.encoding<{ #DCSR = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed" ]
}> }>
#trait_mult_elt = { #trait_mult_elt = {
indexing_maps = [ indexing_maps = [
affine_map<(i,j) -> (i,j)>, // A affine_map<(i,j) -> (i,j)>, // A
▲ Show 20 Lines • Show All 60 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_out_reduction.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
frgossenUnsubmitted
Not Done
ReplyInline Actions

We run into a similar issue here. Here, it is ( 7, 69, -1414812757, -1414812757 ) when ( 7, 69, 0, 0 ) is expected

frgossen: We run into a similar issue here. Here, it is ( 7, 69, -1414812757, -1414812757 ) when ( 7, 69…
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseMatrix = #sparse_tensor.encoding<{ #SparseMatrix = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed" ]
}> }>
#SparseTensor = #sparse_tensor.encoding<{ #SparseTensor = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed", "compressed" ]
}> }>
▲ Show 20 Lines • Show All 76 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_out_simple.mlir

Show All 10 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.mtx" \ // REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.mtx" \
// REDEFINE: %lli \ // REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
▲ Show 20 Lines • Show All 71 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_pack.mlir

// DEFINE: %{option} = enable-runtime-library=false // DEFINE: %{option} = enable-runtime-library=false
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
// TODO: Pack only support CodeGen Path // TODO: Pack only support CodeGen Path
#SortedCOO = #sparse_tensor.encoding<{ #SortedCOO = #sparse_tensor.encoding<{
dimLevelType = [ "compressed-nu", "singleton" ] dimLevelType = [ "compressed-nu", "singleton" ]
}> }>
#SortedCOOI32 = #sparse_tensor.encoding<{ #SortedCOOI32 = #sparse_tensor.encoding<{
dimLevelType = [ "compressed-nu", "singleton" ], dimLevelType = [ "compressed-nu", "singleton" ],
▲ Show 20 Lines • Show All 71 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_quantized_matmul.mlir

Show All 9 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \ // REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s // REDEFINE: FileCheck %s
▲ Show 20 Lines • Show All 67 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_re_im.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#trait_op = { #trait_op = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)>, // a (in) affine_map<(i) -> (i)>, // a (in)
affine_map<(i) -> (i)> // x (out) affine_map<(i) -> (i)> // x (out)
], ],
▲ Show 20 Lines • Show All 84 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_reduce_custom.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Current fails for SVE
// XFAIL: target=aarch64{{.*}}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 reassociate-fp-reductions=true enable-index-optimizations=true enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#CSR = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}> #CSR = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}>
#CSC = #sparse_tensor.encoding<{ #CSC = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "compressed" ], dimLevelType = [ "dense", "compressed" ],
dimOrdering = affine_map<(i,j) -> (j,i)> dimOrdering = affine_map<(i,j) -> (j,i)>
}> }>
▲ Show 20 Lines • Show All 221 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_reductions.mlir

Show All 9 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \ // REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s // REDEFINE: FileCheck %s
▲ Show 20 Lines • Show All 163 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_reshape.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{ #SparseVector = #sparse_tensor.encoding<{
dimLevelType = ["compressed"] dimLevelType = ["compressed"]
}> }>
#SparseMatrix = #sparse_tensor.encoding<{ #SparseMatrix = #sparse_tensor.encoding<{
dimLevelType = ["compressed", "compressed"] dimLevelType = ["compressed", "compressed"]
}> }>
▲ Show 20 Lines • Show All 330 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_rewrite_push_back.mlir

// DEFINE: %{option} = enable-runtime-library=false // DEFINE: %{option} = enable-runtime-library=false
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with vectorization. // Do the same run, but now with vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
module { module {
func.func @entry() { func.func @entry() {
%c0 = arith.constant 0 : index %c0 = arith.constant 0 : index
%c1 = arith.constant 1 : index %c1 = arith.constant 1 : index
%c10 = arith.constant 10 : index %c10 = arith.constant 10 : index
%d0 = arith.constant 0.0 : f32 %d0 = arith.constant 0.0 : f32
%d1 = arith.constant 1.0 : f32 %d1 = arith.constant 1.0 : f32
Show All 27 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_rewrite_sort.mlir

// RUN: mlir-opt %s --sparse-compiler=enable-runtime-library=false | \ // DEFINE: %{option} = enable-runtime-library=false
// RUN: mlir-cpu-runner \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// RUN: -e entry -entry-point-result=void \ // DEFINE: %{run} = mlir-cpu-runner \
// RUN: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \ // DEFINE: -e entry -entry-point-result=void \
// RUN: FileCheck %s // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext,%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// DEFINE: FileCheck %s
//
// RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext --dlopen=%mlir_lib_dir/libmlir_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
module { module {
func.func private @printMemref1dI32(%ptr : memref<?xi32>) attributes { llvm.emit_c_interface } func.func private @printMemref1dI32(%ptr : memref<?xi32>) attributes { llvm.emit_c_interface }
// Stores 5 values to the memref buffer. // Stores 5 values to the memref buffer.
func.func @storeValuesTo(%b: memref<?xi32>, %v0: i32, %v1: i32, %v2: i32, func.func @storeValuesTo(%b: memref<?xi32>, %v0: i32, %v1: i32, %v2: i32,
%v3: i32, %v4: i32) -> () { %v3: i32, %v4: i32) -> () {
%i0 = arith.constant 0 : index %i0 = arith.constant 0 : index
▲ Show 20 Lines • Show All 141 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_rewrite_sort_coo.mlir

// DEFINE: %{option} = enable-runtime-library=false // DEFINE: %{option} = enable-runtime-library=false
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with vectorization. // Do the same run, but now with vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
module { module {
// Stores 5 values to the memref buffer. // Stores 5 values to the memref buffer.
func.func @storeValuesTo(%b: memref<?xi32>, %v0: i32, %v1: i32, %v2: i32, func.func @storeValuesTo(%b: memref<?xi32>, %v0: i32, %v1: i32, %v2: i32,
%v3: i32, %v4: i32) -> () { %v3: i32, %v4: i32) -> () {
%i0 = arith.constant 0 : index %i0 = arith.constant 0 : index
%i1 = arith.constant 1 : index %i1 = arith.constant 1 : index
%i2 = arith.constant 2 : index %i2 = arith.constant 2 : index
▲ Show 20 Lines • Show All 149 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_sampled_matmul.mlir

Show All 10 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.mtx" \ // REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test.mtx" \
// REDEFINE: %lli \ // REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
▲ Show 20 Lines • Show All 109 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_sampled_mm_fusion.mlir

Show All 9 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \ // REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s // REDEFINE: FileCheck %s
▲ Show 20 Lines • Show All 205 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_scale.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option} // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: %{run} = mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \ // REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s // REDEFINE: FileCheck %s
▲ Show 20 Lines • Show All 72 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_scf_nested.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#map = affine_map<(d0, d1, d2) -> (d0, d1, d2)> #map = affine_map<(d0, d1, d2) -> (d0, d1, d2)>
#SparseMatrix = #sparse_tensor.encoding<{ dimLevelType = [ "compressed", "compressed", "compressed" ] }> #SparseMatrix = #sparse_tensor.encoding<{ dimLevelType = [ "compressed", "compressed", "compressed" ] }>
module @func_sparse.2 { module @func_sparse.2 {
// Do elementwise x+1 when true, x-1 when false // Do elementwise x+1 when true, x-1 when false
func.func public @condition(%cond: i1, %arg0: tensor<2x3x4xf64, #SparseMatrix>) -> tensor<2x3x4xf64, #SparseMatrix> { func.func public @condition(%cond: i1, %arg0: tensor<2x3x4xf64, #SparseMatrix>) -> tensor<2x3x4xf64, #SparseMatrix> {
%1 = scf.if %cond -> (tensor<2x3x4xf64, #SparseMatrix>) { %1 = scf.if %cond -> (tensor<2x3x4xf64, #SparseMatrix>) {
▲ Show 20 Lines • Show All 60 Lines • ▼ Show 20 Lines func.func public @entry() {
call @dump(%sm_t) : (tensor<2x3x4xf64, #SparseMatrix>) -> () call @dump(%sm_t) : (tensor<2x3x4xf64, #SparseMatrix>) -> ()
call @dump(%sm_f) : (tensor<2x3x4xf64, #SparseMatrix>) -> () call @dump(%sm_f) : (tensor<2x3x4xf64, #SparseMatrix>) -> ()
bufferization.dealloc_tensor %sm : tensor<2x3x4xf64, #SparseMatrix> bufferization.dealloc_tensor %sm : tensor<2x3x4xf64, #SparseMatrix>
bufferization.dealloc_tensor %sm_t : tensor<2x3x4xf64, #SparseMatrix> bufferization.dealloc_tensor %sm_t : tensor<2x3x4xf64, #SparseMatrix>
bufferization.dealloc_tensor %sm_f : tensor<2x3x4xf64, #SparseMatrix> bufferization.dealloc_tensor %sm_f : tensor<2x3x4xf64, #SparseMatrix>
return return
} }
} }
No newline at end of file

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_select.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#CSR = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}> #CSR = #sparse_tensor.encoding<{dimLevelType = ["dense", "compressed"]}>
#CSC = #sparse_tensor.encoding<{ #CSC = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "compressed" ], dimLevelType = [ "dense", "compressed" ],
dimOrdering = affine_map<(i,j) -> (j,i)> dimOrdering = affine_map<(i,j) -> (j,i)>
}> }>
▲ Show 20 Lines • Show All 135 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_sign.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }> #SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }>
#trait_op = { #trait_op = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)>, // a affine_map<(i) -> (i)>, // a
affine_map<(i) -> (i)> // x (out) affine_map<(i) -> (i)> // x (out)
], ],
▲ Show 20 Lines • Show All 87 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_sorted_coo.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \ // DEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \
// DEFINE: TENSOR1="%mlir_src_dir/test/Integration/data/mttkrp_b.tns" \ // DEFINE: TENSOR1="%mlir_src_dir/test/Integration/data/mttkrp_b.tns" \
// DEFINE: mlir-cpu-runner \ // DEFINE: mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \
// REDEFINE: TENSOR1="%mlir_src_dir/test/Integration/data/mttkrp_b.tns" \
// REDEFINE: lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
!Filename = !llvm.ptr<i8> !Filename = !llvm.ptr<i8>
#SortedCOO = #sparse_tensor.encoding<{ #SortedCOO = #sparse_tensor.encoding<{
dimLevelType = [ "compressed-nu", "singleton" ] dimLevelType = [ "compressed-nu", "singleton" ]
}> }>
#SortedCOOPermuted = #sparse_tensor.encoding<{ #SortedCOOPermuted = #sparse_tensor.encoding<{
▲ Show 20 Lines • Show All 222 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_spmm.mlir

Show All 10 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \ // REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/wide.mtx" \
// REDEFINE: lli \ // REDEFINE: lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
▲ Show 20 Lines • Show All 92 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_storage.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
// //
// Several common sparse storage schemes. // Several common sparse storage schemes.
// //
#Dense = #sparse_tensor.encoding<{ #Dense = #sparse_tensor.encoding<{
dimLevelType = [ "dense", "dense" ] dimLevelType = [ "dense", "dense" ]
}> }>
▲ Show 20 Lines • Show All 246 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_sum.mlir

Show All 10 Lines
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{compile} | %{run} // RUN: %{compile} | %{run}
// If SVE is available, do the same run, but now with direct IR generation and VLA // Do the same run, but now with direct IR generation and, if available, VLA
// vectorization. // vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA" // REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test_symmetric.mtx" \ // REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test_symmetric.mtx" \
// REDEFINE: %lli \ // REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \ // REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \ // REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \ // REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \ // REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
▲ Show 20 Lines • Show All 73 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_sum_c32.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: TENSOR0="%mlir_src_dir/test/Integration/data/test_symmetric_complex.mtx" \ // DEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test_symmetric_complex.mtx" \
// DEFINE: mlir-cpu-runner \ // DEFINE: mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = TENSOR0="%mlir_src_dir/test/Integration/data/test_symmetric_complex.mtx" \
// REDEFINE: %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
!Filename = !llvm.ptr<i8> !Filename = !llvm.ptr<i8>
#SparseMatrix = #sparse_tensor.encoding<{ #SparseMatrix = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed" ]
}> }>
#trait_sum_reduce = { #trait_sum_reduce = {
▲ Show 20 Lines • Show All 70 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_sum_f16.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
!Filename = !llvm.ptr<i8> !Filename = !llvm.ptr<i8>
#SparseMatrix = #sparse_tensor.encoding<{ #SparseMatrix = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed" ]
}> }>
#trait_sum_reduce = { #trait_sum_reduce = {
▲ Show 20 Lines • Show All 61 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_tanh.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Current fails for SVE
// XFAIL: target=aarch64{{.*}}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 reassociate-fp-reductions=true enable-index-optimizations=true enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }> #SparseVector = #sparse_tensor.encoding<{ dimLevelType = [ "compressed" ] }>
#trait_op = { #trait_op = {
indexing_maps = [ indexing_maps = [
affine_map<(i) -> (i)> // X (out) affine_map<(i) -> (i)> // X (out)
], ],
iterator_types = ["parallel"], iterator_types = ["parallel"],
▲ Show 20 Lines • Show All 63 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_tensor_mul.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#ST = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed", "compressed"]}> #ST = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed", "compressed"]}>
// //
// Trait for 3-d tensor element wise multiplication. // Trait for 3-d tensor element wise multiplication.
// //
#trait_mul = { #trait_mul = {
indexing_maps = [ indexing_maps = [
▲ Show 20 Lines • Show All 92 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_tensor_ops.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = enable-runtime-library=false // REDEFINE: %{option} = enable-runtime-library=false
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#ST1 = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed", "compressed"]}> #ST1 = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed", "compressed"]}>
#ST2 = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed", "dense"]}> #ST2 = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed", "dense"]}>
// //
// Trait for 3-d tensor operation. // Trait for 3-d tensor operation.
// //
#trait_scale = { #trait_scale = {
▲ Show 20 Lines • Show All 76 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_transpose.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DxEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DxEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DxEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DxEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#DCSR = #sparse_tensor.encoding<{ #DCSR = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ] dimLevelType = [ "compressed", "compressed" ]
}> }>
#DCSC = #sparse_tensor.encoding<{ #DCSC = #sparse_tensor.encoding<{
dimLevelType = [ "compressed", "compressed" ], dimLevelType = [ "compressed", "compressed" ],
dimOrdering = affine_map<(i,j) -> (j,i)> dimOrdering = affine_map<(i,j) -> (j,i)>
▲ Show 20 Lines • Show All 108 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_unary.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false vl=4 enable-buffer-initialization=true reassociate-fp-reductions=true enable-index-optimizations=true enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#DCSR = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}> #DCSR = #sparse_tensor.encoding<{dimLevelType = ["compressed", "compressed"]}>
// //
// Traits for tensor operations. // Traits for tensor operations.
// //
#trait_vec_scale = { #trait_vec_scale = {
▲ Show 20 Lines • Show All 254 Lines • Show Last 20 Lines

mlir/test/Integration/Dialect/SparseTensor/CPU/sparse_vector_ops.mlir

// DEFINE: %{option} = enable-runtime-library=true // DEFINE: %{option} = enable-runtime-library=true
// DEFINE: %{command} = mlir-opt %s --sparse-compiler=%{option} | \ // DEFINE: %{compile} = mlir-opt %s --sparse-compiler=%{option}
// DEFINE: mlir-cpu-runner \ // DEFINE: %{run} = mlir-cpu-runner \
// DEFINE: -e entry -entry-point-result=void \ // DEFINE: -e entry -entry-point-result=void \
// DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \ // DEFINE: -shared-libs=%mlir_lib_dir/libmlir_c_runner_utils%shlibext | \
// DEFINE: FileCheck %s // DEFINE: FileCheck %s
// //
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation. // Do the same run, but now with direct IR generation.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// //
// Do the same run, but now with direct IR generation and vectorization. // Do the same run, but now with direct IR generation and vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true" // REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=2 reassociate-fp-reductions=true enable-index-optimizations=true"
// RUN: %{command} // RUN: %{compile} | %{run}
// Do the same run, but now with direct IR generation and, if available, VLA
// vectorization.
// REDEFINE: %{option} = "enable-runtime-library=false enable-buffer-initialization=true vl=4 reassociate-fp-reductions=true enable-index-optimizations=true enable-arm-sve=%ENABLE_VLA"
// REDEFINE: %{run} = %lli \
// REDEFINE: --entry-function=entry_lli \
// REDEFINE: --extra-module=%S/Inputs/main_for_lli.ll \
// REDEFINE: %VLA_ARCH_ATTR_OPTIONS \
// REDEFINE: --dlopen=%mlir_native_utils_lib_dir/libmlir_c_runner_utils%shlibext | \
// REDEFINE: FileCheck %s
// RUN: %{compile} | mlir-translate -mlir-to-llvmir | %{run}
#SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}> #SparseVector = #sparse_tensor.encoding<{dimLevelType = ["compressed"]}>
#DenseVector = #sparse_tensor.encoding<{dimLevelType = ["dense"]}> #DenseVector = #sparse_tensor.encoding<{dimLevelType = ["dense"]}>
// //
// Traits for 1-d tensor (aka vector) operations. // Traits for 1-d tensor (aka vector) operations.
// //
#trait_scale = { #trait_scale = {
▲ Show 20 Lines • Show All 222 Lines • Show Last 20 Lines