This is an archive of the discontinued LLVM Phabricator instance.

Differential D95795

[AMDGPU] Add new CostPerUse values for VGPRs
Needs RevisionPublic

Authored by cdevadas on Feb 1 2021, 9:39 AM.

Details

Reviewers
arsenm
Summary

We introduced more scratch VGPRs with D76356.
To yield a better occupancy, the CSRs and
the scratch registers were interleaved at a
regular interval.

This patch is to have a balanced allocation of
both CSRs and scratch registers by setting high
cost value for higher indices. This should improve the
cases that ended up with a higher register usage when
one set of VGPRs (either CSR or scratch) is over
allocated than the other.

With D86836 targets can support multiple cost models.
The new cost values will be applied only in the presence
of a calling convention. Otherwise, the default
cost model will be used.

Diff Detail

Unit TestsFailed

TimeTest
250 msx64 debian > libarcher.races::task-dependency.c
290 msx64 debian > libarcher.races::task-taskgroup-unrelated.c
270 msx64 debian > libarcher.races::task-taskwait-nested.c
260 msx64 debian > libarcher.races::task-two.c
350 msx64 debian > libarcher.task::task-barrier.c
View Full Test Results (13 Failed)

Event Timeline

cdevadas created this revision.Feb 1 2021, 9:39 AM
Herald added subscribers: kerbowa, hiraditya, t-tye and 6 others. · View Herald TranscriptFeb 1 2021, 9:39 AM
cdevadas requested review of this revision.Feb 1 2021, 9:39 AM
Herald added a project: Restricted Project. · View Herald TranscriptFeb 1 2021, 9:39 AM
Herald added subscribers: llvm-commits, wdng. · View Herald Transcript
Harbormaster completed remote builds in B87384: Diff 320501.Feb 1 2021, 10:42 AM
arsenm requested changes to this revision.Mar 30 2021, 3:55 PM
arsenm added inline comments.
llvm/lib/Target/AMDGPU/SIRegisterInfo.cpp
159

Comment is wrong, kernel *is* a calling convention

llvm/lib/Target/AMDGPU/SIRegisterInfo.td
284

Needs a comment explaining the cost. Also space around =

This revision now requires changes to proceed.Mar 30 2021, 3:55 PM

Revision Contents

PathSize
llvm/
lib/
Target/
AMDGPU/
2 lines
14 lines
8 lines
test/
CodeGen/
AMDGPU/
GlobalISel/
1553 lines
16 lines
16 lines
213 lines
6 lines

Diff 320501

llvm/lib/Target/AMDGPU/SIRegisterInfo.h

Show First 20 Lines • Show All 62 Lines • ▼ Show 20 Linespublic:
BitVector getReservedRegs(const MachineFunction &MF) const override; BitVector getReservedRegs(const MachineFunction &MF) const override;
const MCPhysReg *getCalleeSavedRegs(const MachineFunction *MF) const override; const MCPhysReg *getCalleeSavedRegs(const MachineFunction *MF) const override;
const MCPhysReg *getCalleeSavedRegsViaCopy(const MachineFunction *MF) const; const MCPhysReg *getCalleeSavedRegsViaCopy(const MachineFunction *MF) const;
const uint32_t *getCallPreservedMask(const MachineFunction &MF, const uint32_t *getCallPreservedMask(const MachineFunction &MF,
CallingConv::ID) const override; CallingConv::ID) const override;
const uint32_t *getNoPreservedMask() const override; const uint32_t *getNoPreservedMask() const override;
unsigned getRegisterCostTableIndex(const MachineFunction &MF) const override;
// Stack access is very expensive. CSRs are also the high registers, and we // Stack access is very expensive. CSRs are also the high registers, and we
// want to minimize the number of used registers. // want to minimize the number of used registers.
unsigned getCSRFirstUseCost() const override { unsigned getCSRFirstUseCost() const override {
return 100; return 100;
} }
Register getFrameRegister(const MachineFunction &MF) const override; Register getFrameRegister(const MachineFunction &MF) const override;
▲ Show 20 Lines • Show All 257 Lines • Show Last 20 Lines

llvm/lib/Target/AMDGPU/SIRegisterInfo.cpp

Show First 20 Lines • Show All 143 Lines • ▼ Show 20 Linesconst uint32_t *SIRegisterInfo::getCallPreservedMask(const MachineFunction &MF,
case CallingConv::Cold: case CallingConv::Cold:
case CallingConv::AMDGPU_Gfx: case CallingConv::AMDGPU_Gfx:
return CSR_AMDGPU_HighRegs_RegMask; return CSR_AMDGPU_HighRegs_RegMask;
default: default:
return nullptr; return nullptr;
} }
} }
unsigned
SIRegisterInfo::getRegisterCostTableIndex(const MachineFunction &MF) const {
// Index 0: The default cost model. No specific cost value for registers.
// Index 1: Cost model with CostPerUse value equivalent to
// register_index/allocation_granularity. Applied on VGPRs.
const MCPhysReg *CSRegs = MF.getRegInfo().getCalleeSavedRegs();
// For kernels with no calling convention.
arsenmUnsubmitted
Not Done
ReplyInline Actions

Comment is wrong, kernel *is* a calling convention

arsenm: Comment is wrong, kernel *is* a calling convention
if (CSRegs && *CSRegs == AMDGPU::NoRegister)
return 0;
return 1;
}
const uint32_t *SIRegisterInfo::getNoPreservedMask() const { const uint32_t *SIRegisterInfo::getNoPreservedMask() const {
return CSR_AMDGPU_NoRegs_RegMask; return CSR_AMDGPU_NoRegs_RegMask;
} }
Register SIRegisterInfo::getFrameRegister(const MachineFunction &MF) const { Register SIRegisterInfo::getFrameRegister(const MachineFunction &MF) const {
const SIFrameLowering *TFI = const SIFrameLowering *TFI =
MF.getSubtarget<GCNSubtarget>().getFrameLowering(); MF.getSubtarget<GCNSubtarget>().getFrameLowering();
const SIMachineFunctionInfo *FuncInfo = MF.getInfo<SIMachineFunctionInfo>(); const SIMachineFunctionInfo *FuncInfo = MF.getInfo<SIMachineFunctionInfo>();
▲ Show 20 Lines • Show All 2,106 Lines • Show Last 20 Lines

llvm/lib/Target/AMDGPU/SIRegisterInfo.td

Show First 20 Lines • Show All 275 Lines • ▼ Show 20 Linesforeach Index = 0...105 in {
defm SGPR#Index : defm SGPR#Index :
SIRegLoHi16 <"s"#Index, Index>, SIRegLoHi16 <"s"#Index, Index>,
DwarfRegNum<[!if(!le(Index, 63), !add(Index, 32), !add(Index, 1024)), DwarfRegNum<[!if(!le(Index, 63), !add(Index, 32), !add(Index, 1024)),
!if(!le(Index, 63), !add(Index, 32), !add(Index, 1024))]>; !if(!le(Index, 63), !add(Index, 32), !add(Index, 1024))]>;
} }
// VGPR registers // VGPR registers
foreach Index = 0...255 in { foreach Index = 0...255 in {
let CostPerUse=[0, !if(!gt(Index, 31), !srl(Index, 2), 0)] in {
arsenmUnsubmitted
Not Done
ReplyInline Actions

Needs a comment explaining the cost. Also space around =

arsenm: Needs a comment explaining the cost. Also space around =
defm VGPR#Index : defm VGPR#Index :
SIRegLoHi16 <"v"#Index, Index, 0, 1>, SIRegLoHi16 <"v"#Index, Index, 0, 1>,
DwarfRegNum<[!add(Index, 2560), !add(Index, 1536)]>; DwarfRegNum<[!add(Index, 2560), !add(Index, 1536)]>;
} }
}
// AccVGPR registers // AccVGPR registers
foreach Index = 0...255 in { foreach Index = 0...255 in {
defm AGPR#Index : defm AGPR#Index :
SIRegLoHi16 <"a"#Index, Index, 1, 1>, SIRegLoHi16 <"a"#Index, Index, 1, 1>,
DwarfRegNum<[!add(Index, 3072), !add(Index, 2048)]>; DwarfRegNum<[!add(Index, 3072), !add(Index, 2048)]>;
} }
▲ Show 20 Lines • Show All 731 Lines • Show Last 20 Lines

llvm/test/CodeGen/AMDGPU/GlobalISel/extractelement-stack-lower.ll

; NOTE: Assertions have been autogenerated by utils/update_llc_test_checks.py ; NOTE: Assertions have been autogenerated by utils/update_llc_test_checks.py
; RUN: llc -global-isel -mtriple=amdgcn-mesa-mesa3d -mcpu=gfx900 -mattr=-xnack -verify-machineinstrs < %s | FileCheck -check-prefixes=GCN %s ; RUN: llc -global-isel -mtriple=amdgcn-mesa-mesa3d -mcpu=gfx900 -mattr=-xnack -verify-machineinstrs < %s | FileCheck -check-prefixes=GCN %s
; Check lowering of some large extractelement that use the stack ; Check lowering of some large extractelement that use the stack
; instead of register indexing. ; instead of register indexing.
define i32 @v_extract_v64i32_varidx(<64 x i32> addrspace(1)* %ptr, i32 %idx) { define i32 @v_extract_v64i32_varidx(<64 x i32> addrspace(1)* %ptr, i32 %idx) {
; GCN-LABEL: v_extract_v64i32_varidx: ; GCN-LABEL: v_extract_v64i32_varidx:
; GCN: ; %bb.0: ; GCN: ; %bb.0:
; GCN-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0)
; GCN-NEXT: s_add_u32 s4, s32, 0x3fc0 ; GCN-NEXT: s_add_u32 s4, s32, 0x3fc0
; GCN-NEXT: v_add_co_u32_e32 v12, vcc, 64, v0 ; GCN-NEXT: v_add_co_u32_e32 v3, vcc, 64, v0
; GCN-NEXT: s_mov_b32 s6, s33 ; GCN-NEXT: s_mov_b32 s6, s33
; GCN-NEXT: s_and_b32 s33, s4, 0xffffc000 ; GCN-NEXT: s_and_b32 s33, s4, 0xffffc000
; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:48 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:48 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:44 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:44 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:40 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:40 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:36 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:36 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:32 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:32 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:28 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:28 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v60, off, s[0:3], s33 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v60, off, s[0:3], s33 ; 4-byte Folded Spill
; GCN-NEXT: v_addc_co_u32_e32 v13, vcc, 0, v1, vcc ; GCN-NEXT: v_addc_co_u32_e32 v4, vcc, 0, v1, vcc
; GCN-NEXT: global_load_dwordx4 v[4:7], v[12:13], off offset:16
; GCN-NEXT: global_load_dwordx4 v[8:11], v[12:13], off offset:32
; GCN-NEXT: global_load_dwordx4 v[12:15], v[12:13], off offset:48
; GCN-NEXT: s_mov_b32 s5, 0
; GCN-NEXT: s_movk_i32 s4, 0x80 ; GCN-NEXT: s_movk_i32 s4, 0x80
; GCN-NEXT: v_mov_b32_e32 v17, s5 ; GCN-NEXT: global_load_dwordx4 v[7:10], v[3:4], off offset:16
; GCN-NEXT: v_mov_b32_e32 v16, s4 ; GCN-NEXT: global_load_dwordx4 v[11:14], v[3:4], off offset:32
; GCN-NEXT: global_load_dwordx4 v[15:18], v[3:4], off offset:48
; GCN-NEXT: s_mov_b32 s5, 0
; GCN-NEXT: v_mov_b32_e32 v3, s4
; GCN-NEXT: v_mov_b32_e32 v4, s5
; GCN-NEXT: v_add_co_u32_e32 v52, vcc, v0, v3
; GCN-NEXT: s_movk_i32 s4, 0xc0 ; GCN-NEXT: s_movk_i32 s4, 0xc0
; GCN-NEXT: s_add_u32 s32, s32, 0x10000 ; GCN-NEXT: v_addc_co_u32_e32 v53, vcc, v1, v4, vcc
; GCN-NEXT: s_sub_u32 s32, s32, 0x10000 ; GCN-NEXT: v_mov_b32_e32 v3, s4
; GCN-NEXT: v_mov_b32_e32 v4, s5
; GCN-NEXT: v_add_co_u32_e32 v56, vcc, v0, v3
; GCN-NEXT: v_addc_co_u32_e32 v57, vcc, v1, v4, vcc
; GCN-NEXT: global_load_dwordx4 v[3:6], v[0:1], off
; GCN-NEXT: v_lshrrev_b32_e64 v19, 6, s33
; GCN-NEXT: v_add_u32_e32 v19, 0x100, v19
; GCN-NEXT: v_add_u32_e32 v60, 16, v19
; GCN-NEXT: s_add_u32 s32, s32, 0x14000
; GCN-NEXT: s_sub_u32 s32, s32, 0x14000
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v0, off, s[0:3], s33 offset:576 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:704 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v1, off, s[0:3], s33 offset:580 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:708 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v2, off, s[0:3], s33 offset:584 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:712 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:588 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:716 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:592 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:720 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:596 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:724 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:600 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:728 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:604 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:732 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:608 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:736 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:612 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:740 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:616 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:744 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:620 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:748 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:624 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:752 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:628 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:756 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:632 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:760 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:636 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:764 ; 4-byte Folded Spill
; GCN-NEXT: v_lshrrev_b32_e64 v3, 6, s33
; GCN-NEXT: v_add_u32_e32 v3, 0x100, v3
; GCN-NEXT: v_add_u32_e32 v60, 16, v3
; GCN-NEXT: v_add_co_u32_e32 v52, vcc, v0, v16
; GCN-NEXT: v_addc_co_u32_e32 v53, vcc, v1, v17, vcc
; GCN-NEXT: v_mov_b32_e32 v17, s5
; GCN-NEXT: v_mov_b32_e32 v16, s4
; GCN-NEXT: v_add_co_u32_e32 v56, vcc, v0, v16
; GCN-NEXT: v_addc_co_u32_e32 v57, vcc, v1, v17, vcc
; GCN-NEXT: global_load_dwordx4 v[16:19], v[0:1], off
; GCN-NEXT: global_load_dwordx4 v[20:23], v[0:1], off offset:16 ; GCN-NEXT: global_load_dwordx4 v[20:23], v[0:1], off offset:16
; GCN-NEXT: global_load_dwordx4 v[24:27], v[0:1], off offset:32 ; GCN-NEXT: global_load_dwordx4 v[24:27], v[0:1], off offset:32
; GCN-NEXT: global_load_dwordx4 v[28:31], v[0:1], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[28:31], v[0:1], off offset:48
; GCN-NEXT: global_load_dwordx4 v[32:35], v[0:1], off offset:64 ; GCN-NEXT: global_load_dwordx4 v[3:6], v[0:1], off offset:64
; GCN-NEXT: global_load_dwordx4 v[36:39], v[0:1], off offset:128 ; GCN-NEXT: global_load_dwordx4 v[32:35], v[0:1], off offset:128
; GCN-NEXT: global_load_dwordx4 v[40:43], v[0:1], off offset:192 ; GCN-NEXT: global_load_dwordx4 v[36:39], v[0:1], off offset:192
; GCN-NEXT: global_load_dwordx4 v[44:47], v[52:53], off offset:16 ; GCN-NEXT: v_add_u32_e32 v0, 20, v19
; GCN-NEXT: global_load_dwordx4 v[48:51], v[52:53], off offset:32 ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:640 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:644 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:648 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:652 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:656 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:660 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:664 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:668 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:672 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:676 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:680 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:684 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:688 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:692 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:696 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:700 ; 4-byte Folded Spill
; GCN-NEXT: global_load_dwordx4 v[48:51], v[52:53], off offset:16
; GCN-NEXT: global_load_dwordx4 v[36:39], v[52:53], off offset:32
; GCN-NEXT: global_load_dwordx4 v[52:55], v[52:53], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[52:55], v[52:53], off offset:48
; GCN-NEXT: global_load_dwordx4 v[12:15], v[56:57], off offset:16 ; GCN-NEXT: global_load_dwordx4 v[40:43], v[56:57], off offset:16
; GCN-NEXT: v_add_u32_e32 v0, 20, v3
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:640 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:576 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:644 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:580 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:648 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:584 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:652 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:588 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:656 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:592 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:660 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:596 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:664 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:600 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:668 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:604 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:672 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:608 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:676 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:612 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:680 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:616 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v19, off, s[0:3], s33 offset:684 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:620 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v20, off, s[0:3], s33 offset:688 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:624 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v21, off, s[0:3], s33 offset:692 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:628 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v22, off, s[0:3], s33 offset:696 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:632 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v23, off, s[0:3], s33 offset:700 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:636 ; 4-byte Folded Spill
; GCN-NEXT: global_load_dwordx4 v[12:15], v[56:57], off offset:32 ; GCN-NEXT: global_load_dwordx4 v[44:47], v[56:57], off offset:32
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:512 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:512 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:516 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:516 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:520 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:520 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:524 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:524 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:528 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:528 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:532 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:532 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:536 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:536 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:540 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:540 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:544 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:544 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:548 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:548 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:552 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:552 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:556 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:556 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:560 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:560 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:564 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:564 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:568 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:568 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v19, off, s[0:3], s33 offset:572 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:572 ; 4-byte Folded Spill
; GCN-NEXT: global_load_dwordx4 v[56:59], v[56:57], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[56:59], v[56:57], off offset:48
; GCN-NEXT: buffer_store_dword v21, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v21, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 24, v3 ; GCN-NEXT: v_add_u32_e32 v0, 24, v19
; GCN-NEXT: buffer_store_dword v22, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v22, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 28, v3 ; GCN-NEXT: v_add_u32_e32 v0, 28, v19
; GCN-NEXT: buffer_store_dword v23, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v23, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 32, v3 ; GCN-NEXT: v_add_u32_e32 v0, 32, v19
; GCN-NEXT: buffer_store_dword v24, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v24, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 36, v3 ; GCN-NEXT: v_add_u32_e32 v0, 36, v19
; GCN-NEXT: buffer_store_dword v25, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v25, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 40, v3 ; GCN-NEXT: v_add_u32_e32 v0, 40, v19
; GCN-NEXT: buffer_store_dword v26, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v26, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 44, v3 ; GCN-NEXT: v_add_u32_e32 v0, 44, v19
; GCN-NEXT: buffer_store_dword v27, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v27, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 48, v3 ; GCN-NEXT: v_add_u32_e32 v0, 48, v19
; GCN-NEXT: buffer_store_dword v28, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v28, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 52, v3 ; GCN-NEXT: v_add_u32_e32 v0, 52, v19
; GCN-NEXT: buffer_store_dword v29, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v29, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 56, v3 ; GCN-NEXT: v_add_u32_e32 v0, 56, v19
; GCN-NEXT: buffer_store_dword v30, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v30, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 60, v3 ; GCN-NEXT: v_add_u32_e32 v0, 60, v19
; GCN-NEXT: buffer_store_dword v31, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v31, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 64, v3 ; GCN-NEXT: v_add_u32_e32 v0, 64, v19
; GCN-NEXT: buffer_store_dword v32, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v3, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x44, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x44, v19
; GCN-NEXT: buffer_store_dword v33, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x48, v3
; GCN-NEXT: buffer_store_dword v34, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x4c, v3
; GCN-NEXT: buffer_store_dword v35, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x50, v3
; GCN-NEXT: buffer_store_dword v20, v60, s[0:3], 0 offen
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x54, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x48, v19
; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x58, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x4c, v19
; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x5c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x50, v19
; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x60, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x54, v19
; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x64, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x58, v19
; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x68, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x5c, v19
; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x6c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x60, v19
; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v20, off, s[0:3], s33 offset:576 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0x64, v19
; GCN-NEXT: buffer_load_dword v21, off, s[0:3], s33 offset:580 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v22, off, s[0:3], s33 offset:584 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v23, off, s[0:3], s33 offset:588 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v24, off, s[0:3], s33 offset:592 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v25, off, s[0:3], s33 offset:596 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v26, off, s[0:3], s33 offset:600 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v27, off, s[0:3], s33 offset:604 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v28, off, s[0:3], s33 offset:608 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v29, off, s[0:3], s33 offset:612 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v30, off, s[0:3], s33 offset:616 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v31, off, s[0:3], s33 offset:620 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v32, off, s[0:3], s33 offset:624 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v33, off, s[0:3], s33 offset:628 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v34, off, s[0:3], s33 offset:632 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v35, off, s[0:3], s33 offset:636 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0x70, v3
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v12, v32
; GCN-NEXT: buffer_store_dword v12, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v12, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v13, v33 ; GCN-NEXT: v_add_u32_e32 v0, 0x68, v19
; GCN-NEXT: v_add_u32_e32 v0, 0x74, v3
; GCN-NEXT: buffer_store_dword v13, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v13, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v14, v34 ; GCN-NEXT: v_add_u32_e32 v0, 0x6c, v19
; GCN-NEXT: v_add_u32_e32 v0, 0x78, v3
; GCN-NEXT: buffer_store_dword v14, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v14, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v15, v35 ; GCN-NEXT: v_add_u32_e32 v0, 0x70, v19
; GCN-NEXT: v_add_u32_e32 v0, 0x7c, v3
; GCN-NEXT: buffer_store_dword v15, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v15, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x80, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x74, v19
; GCN-NEXT: buffer_store_dword v36, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v16, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x84, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x78, v19
; GCN-NEXT: buffer_store_dword v37, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v17, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x88, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x7c, v19
; GCN-NEXT: buffer_store_dword v38, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v18, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x8c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x80, v19
; GCN-NEXT: buffer_store_dword v39, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v32, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x90, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x84, v19
; GCN-NEXT: buffer_store_dword v44, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v33, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x94, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x88, v19
; GCN-NEXT: buffer_store_dword v45, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v34, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x98, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x8c, v19
; GCN-NEXT: buffer_store_dword v46, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v35, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x9c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x90, v19
; GCN-NEXT: buffer_store_dword v47, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v20, v60, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa0, v3
; GCN-NEXT: buffer_store_dword v48, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v48, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa4, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x94, v19
; GCN-NEXT: buffer_store_dword v49, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v49, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa8, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x98, v19
; GCN-NEXT: buffer_store_dword v50, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v50, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xac, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x9c, v19
; GCN-NEXT: buffer_store_dword v51, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v51, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb0, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xa0, v19
; GCN-NEXT: buffer_store_dword v36, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa4, v19
; GCN-NEXT: buffer_store_dword v37, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa8, v19
; GCN-NEXT: buffer_store_dword v38, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xac, v19
; GCN-NEXT: buffer_store_dword v39, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb0, v19
; GCN-NEXT: buffer_store_dword v52, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v52, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb4, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xb4, v19
; GCN-NEXT: buffer_store_dword v53, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v53, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb8, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xb8, v19
; GCN-NEXT: buffer_store_dword v54, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v54, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xbc, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xbc, v19
; GCN-NEXT: buffer_store_dword v55, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v55, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xc0, v3 ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:640 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v40, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:644 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xc4, v3 ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:648 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v41, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:652 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xc8, v3 ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:656 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v42, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:660 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xcc, v3 ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:664 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v43, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:668 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 4, v3 ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:672 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v17, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:676 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 8, v3 ; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:680 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v18, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:684 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 12, v3 ; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:688 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v19, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:692 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:256 ; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:696 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:640 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:700 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:644 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xc0, v19
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:648 ; 4-byte Folded Reload ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:652 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v3, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:656 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xc4, v19
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:660 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:664 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xc8, v19
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:668 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:672 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xcc, v19
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:676 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:680 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:704 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:684 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:708 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:688 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:712 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:692 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:716 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:696 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:720 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v19, off, s[0:3], s33 offset:700 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:724 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xd0, v3 ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:728 ; 4-byte Folded Reload
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:732 ; 4-byte Folded Reload
; GCN-NEXT: v_mov_b32_e32 v4, v8 ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:736 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:740 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:744 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:748 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:752 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:756 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:760 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:764 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 4, v19
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 8, v19
; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 12, v19
; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:256
; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:576 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:580 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:584 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:588 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:592 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:596 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:600 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:604 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:608 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:612 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:616 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:620 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:624 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:628 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:632 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:636 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xd0, v19
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v4, v7
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v5, v9 ; GCN-NEXT: v_mov_b32_e32 v5, v8
; GCN-NEXT: v_add_u32_e32 v0, 0xd4, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xd4, v19
; GCN-NEXT: v_mov_b32_e32 v6, v9
; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v6, v10 ; GCN-NEXT: v_add_u32_e32 v0, 0xd8, v19
; GCN-NEXT: v_add_u32_e32 v0, 0xd8, v3
; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v7, v11 ; GCN-NEXT: v_mov_b32_e32 v7, v10
; GCN-NEXT: v_add_u32_e32 v0, 0xdc, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xdc, v19
; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:512 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:512 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:516 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:516 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:520 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:520 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:524 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:524 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:528 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:528 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:532 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:532 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:536 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:536 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:540 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:540 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:544 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:544 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:548 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:548 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:552 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:552 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:556 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:556 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:560 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:560 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:564 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:564 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:568 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:568 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v19, off, s[0:3], s33 offset:572 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:572 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xe0, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xe0, v19
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v8, v12 ; GCN-NEXT: v_mov_b32_e32 v8, v11
; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v9, v13 ; GCN-NEXT: v_mov_b32_e32 v9, v12
; GCN-NEXT: v_add_u32_e32 v0, 0xe4, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xe4, v19
; GCN-NEXT: v_mov_b32_e32 v10, v13
; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v10, v14 ; GCN-NEXT: v_add_u32_e32 v0, 0xe8, v19
; GCN-NEXT: v_add_u32_e32 v0, 0xe8, v3
; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v11, v15 ; GCN-NEXT: v_mov_b32_e32 v11, v14
; GCN-NEXT: v_add_u32_e32 v0, 0xec, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xec, v19
; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xf0, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xf0, v19
; GCN-NEXT: buffer_store_dword v56, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v56, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xf4, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xf4, v19
; GCN-NEXT: buffer_store_dword v57, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v57, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xf8, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xf8, v19
; GCN-NEXT: buffer_store_dword v58, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v58, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xfc, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xfc, v19
; GCN-NEXT: buffer_store_dword v59, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v59, v0, s[0:3], 0 offen
; GCN-NEXT: v_and_b32_e32 v0, 63, v2 ; GCN-NEXT: v_and_b32_e32 v0, 63, v2
; GCN-NEXT: v_lshlrev_b32_e32 v0, 2, v0 ; GCN-NEXT: v_lshlrev_b32_e32 v0, 2, v0
; GCN-NEXT: v_add_u32_e32 v0, v3, v0 ; GCN-NEXT: v_add_u32_e32 v0, v19, v0
; GCN-NEXT: buffer_load_dword v0, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v0, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v60, off, s[0:3], s33 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v60, off, s[0:3], s33 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Reload
Show All 11 Lines; GCN-NEXT: s_setpc_b64 s[30:31]
ret i32 %elt ret i32 %elt
} }
define i16 @v_extract_v128i16_varidx(<128 x i16> addrspace(1)* %ptr, i32 %idx) { define i16 @v_extract_v128i16_varidx(<128 x i16> addrspace(1)* %ptr, i32 %idx) {
; GCN-LABEL: v_extract_v128i16_varidx: ; GCN-LABEL: v_extract_v128i16_varidx:
; GCN: ; %bb.0: ; GCN: ; %bb.0:
; GCN-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0)
; GCN-NEXT: s_add_u32 s4, s32, 0x3fc0 ; GCN-NEXT: s_add_u32 s4, s32, 0x3fc0
; GCN-NEXT: v_add_co_u32_e32 v12, vcc, 64, v0 ; GCN-NEXT: v_add_co_u32_e32 v3, vcc, 64, v0
; GCN-NEXT: s_mov_b32 s6, s33 ; GCN-NEXT: s_mov_b32 s6, s33
; GCN-NEXT: s_and_b32 s33, s4, 0xffffc000 ; GCN-NEXT: s_and_b32 s33, s4, 0xffffc000
; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:48 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:48 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:44 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:44 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:40 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:40 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:36 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:36 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:32 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:32 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:28 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:28 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v60, off, s[0:3], s33 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v60, off, s[0:3], s33 ; 4-byte Folded Spill
; GCN-NEXT: v_addc_co_u32_e32 v13, vcc, 0, v1, vcc ; GCN-NEXT: v_addc_co_u32_e32 v4, vcc, 0, v1, vcc
; GCN-NEXT: global_load_dwordx4 v[4:7], v[12:13], off offset:16
; GCN-NEXT: global_load_dwordx4 v[8:11], v[12:13], off offset:32
; GCN-NEXT: global_load_dwordx4 v[12:15], v[12:13], off offset:48
; GCN-NEXT: s_mov_b32 s5, 0
; GCN-NEXT: s_movk_i32 s4, 0x80 ; GCN-NEXT: s_movk_i32 s4, 0x80
; GCN-NEXT: v_mov_b32_e32 v17, s5 ; GCN-NEXT: global_load_dwordx4 v[7:10], v[3:4], off offset:16
; GCN-NEXT: v_mov_b32_e32 v16, s4 ; GCN-NEXT: global_load_dwordx4 v[11:14], v[3:4], off offset:32
; GCN-NEXT: global_load_dwordx4 v[15:18], v[3:4], off offset:48
; GCN-NEXT: s_mov_b32 s5, 0
; GCN-NEXT: v_mov_b32_e32 v3, s4
; GCN-NEXT: v_mov_b32_e32 v4, s5
; GCN-NEXT: v_add_co_u32_e32 v52, vcc, v0, v3
; GCN-NEXT: s_movk_i32 s4, 0xc0 ; GCN-NEXT: s_movk_i32 s4, 0xc0
; GCN-NEXT: s_add_u32 s32, s32, 0x10000 ; GCN-NEXT: v_addc_co_u32_e32 v53, vcc, v1, v4, vcc
; GCN-NEXT: s_sub_u32 s32, s32, 0x10000 ; GCN-NEXT: v_mov_b32_e32 v3, s4
; GCN-NEXT: v_mov_b32_e32 v4, s5
; GCN-NEXT: v_add_co_u32_e32 v56, vcc, v0, v3
; GCN-NEXT: v_addc_co_u32_e32 v57, vcc, v1, v4, vcc
; GCN-NEXT: global_load_dwordx4 v[3:6], v[0:1], off
; GCN-NEXT: v_lshrrev_b32_e64 v19, 6, s33
; GCN-NEXT: v_add_u32_e32 v19, 0x100, v19
; GCN-NEXT: v_add_u32_e32 v60, 16, v19
; GCN-NEXT: s_add_u32 s32, s32, 0x14000
; GCN-NEXT: s_sub_u32 s32, s32, 0x14000
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v0, off, s[0:3], s33 offset:576 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:704 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v1, off, s[0:3], s33 offset:580 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:708 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v2, off, s[0:3], s33 offset:584 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:712 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:588 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:716 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:592 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:720 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:596 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:724 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:600 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:728 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:604 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:732 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:608 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:736 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:612 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:740 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:616 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:744 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:620 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:748 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:624 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:752 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:628 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:756 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:632 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:760 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:636 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:764 ; 4-byte Folded Spill
; GCN-NEXT: v_lshrrev_b32_e64 v3, 6, s33
; GCN-NEXT: v_add_u32_e32 v3, 0x100, v3
; GCN-NEXT: v_add_u32_e32 v60, 16, v3
; GCN-NEXT: v_add_co_u32_e32 v52, vcc, v0, v16
; GCN-NEXT: v_addc_co_u32_e32 v53, vcc, v1, v17, vcc
; GCN-NEXT: v_mov_b32_e32 v17, s5
; GCN-NEXT: v_mov_b32_e32 v16, s4
; GCN-NEXT: v_add_co_u32_e32 v56, vcc, v0, v16
; GCN-NEXT: v_addc_co_u32_e32 v57, vcc, v1, v17, vcc
; GCN-NEXT: global_load_dwordx4 v[16:19], v[0:1], off
; GCN-NEXT: global_load_dwordx4 v[20:23], v[0:1], off offset:16 ; GCN-NEXT: global_load_dwordx4 v[20:23], v[0:1], off offset:16
; GCN-NEXT: global_load_dwordx4 v[24:27], v[0:1], off offset:32 ; GCN-NEXT: global_load_dwordx4 v[24:27], v[0:1], off offset:32
; GCN-NEXT: global_load_dwordx4 v[28:31], v[0:1], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[28:31], v[0:1], off offset:48
; GCN-NEXT: global_load_dwordx4 v[32:35], v[0:1], off offset:64 ; GCN-NEXT: global_load_dwordx4 v[3:6], v[0:1], off offset:64
; GCN-NEXT: global_load_dwordx4 v[36:39], v[0:1], off offset:128 ; GCN-NEXT: global_load_dwordx4 v[32:35], v[0:1], off offset:128
; GCN-NEXT: global_load_dwordx4 v[40:43], v[0:1], off offset:192 ; GCN-NEXT: global_load_dwordx4 v[36:39], v[0:1], off offset:192
; GCN-NEXT: global_load_dwordx4 v[44:47], v[52:53], off offset:16 ; GCN-NEXT: v_add_u32_e32 v0, 20, v19
; GCN-NEXT: global_load_dwordx4 v[48:51], v[52:53], off offset:32 ; GCN-NEXT: v_add_u32_e32 v1, 0xd0, v19
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:640 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:644 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:648 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:652 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:656 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:660 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:664 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:668 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:672 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:676 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:680 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:684 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:688 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:692 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:696 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:700 ; 4-byte Folded Spill
; GCN-NEXT: global_load_dwordx4 v[48:51], v[52:53], off offset:16
; GCN-NEXT: global_load_dwordx4 v[36:39], v[52:53], off offset:32
; GCN-NEXT: global_load_dwordx4 v[52:55], v[52:53], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[52:55], v[52:53], off offset:48
; GCN-NEXT: global_load_dwordx4 v[12:15], v[56:57], off offset:16 ; GCN-NEXT: global_load_dwordx4 v[40:43], v[56:57], off offset:16
; GCN-NEXT: v_add_u32_e32 v0, 20, v3 ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_add_u32_e32 v1, 0xd0, v3 ; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:576 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:640 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:580 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:584 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:644 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:588 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:648 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:592 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:652 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:596 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:656 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:600 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:660 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:604 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:664 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:608 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:668 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:612 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:672 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:616 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:676 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:620 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:680 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:624 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v19, off, s[0:3], s33 offset:684 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:628 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v20, off, s[0:3], s33 offset:688 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:632 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v21, off, s[0:3], s33 offset:692 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:636 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v22, off, s[0:3], s33 offset:696 ; 4-byte Folded Spill ; GCN-NEXT: global_load_dwordx4 v[44:47], v[56:57], off offset:32
; GCN-NEXT: buffer_store_dword v23, off, s[0:3], s33 offset:700 ; 4-byte Folded Spill ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: global_load_dwordx4 v[12:15], v[56:57], off offset:32 ; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:512 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:512 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:516 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:520 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:516 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:524 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:520 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:528 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:524 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:532 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:528 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:536 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:532 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:540 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:536 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:544 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:540 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:548 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:544 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:552 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:548 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:556 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:552 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:560 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:556 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:564 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:560 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:568 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:564 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:572 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:568 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v19, off, s[0:3], s33 offset:572 ; 4-byte Folded Spill
; GCN-NEXT: global_load_dwordx4 v[56:59], v[56:57], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[56:59], v[56:57], off offset:48
; GCN-NEXT: buffer_store_dword v21, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v21, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 24, v3 ; GCN-NEXT: v_add_u32_e32 v0, 24, v19
; GCN-NEXT: buffer_store_dword v22, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v22, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 28, v3 ; GCN-NEXT: v_add_u32_e32 v0, 28, v19
; GCN-NEXT: buffer_store_dword v23, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v23, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 32, v3 ; GCN-NEXT: v_add_u32_e32 v0, 32, v19
; GCN-NEXT: buffer_store_dword v24, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v24, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 36, v3 ; GCN-NEXT: v_add_u32_e32 v0, 36, v19
; GCN-NEXT: buffer_store_dword v25, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v25, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 40, v3 ; GCN-NEXT: v_add_u32_e32 v0, 40, v19
; GCN-NEXT: buffer_store_dword v26, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v26, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 44, v3 ; GCN-NEXT: v_add_u32_e32 v0, 44, v19
; GCN-NEXT: buffer_store_dword v27, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v27, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 48, v3 ; GCN-NEXT: v_add_u32_e32 v0, 48, v19
; GCN-NEXT: buffer_store_dword v28, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v28, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 52, v3 ; GCN-NEXT: v_add_u32_e32 v0, 52, v19
; GCN-NEXT: buffer_store_dword v29, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v29, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 56, v3 ; GCN-NEXT: v_add_u32_e32 v0, 56, v19
; GCN-NEXT: buffer_store_dword v30, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v30, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 60, v3 ; GCN-NEXT: v_add_u32_e32 v0, 60, v19
; GCN-NEXT: buffer_store_dword v31, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v31, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 64, v3 ; GCN-NEXT: v_add_u32_e32 v0, 64, v19
; GCN-NEXT: buffer_store_dword v32, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v3, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x44, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x44, v19
; GCN-NEXT: buffer_store_dword v33, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x48, v3
; GCN-NEXT: buffer_store_dword v34, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x4c, v3
; GCN-NEXT: buffer_store_dword v35, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x50, v3
; GCN-NEXT: buffer_store_dword v20, v60, s[0:3], 0 offen
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x54, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x48, v19
; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x58, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x4c, v19
; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x5c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x50, v19
; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x60, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x54, v19
; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x64, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x58, v19
; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x68, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x5c, v19
; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x6c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x60, v19
; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v20, off, s[0:3], s33 offset:576 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0x64, v19
; GCN-NEXT: buffer_load_dword v21, off, s[0:3], s33 offset:580 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v22, off, s[0:3], s33 offset:584 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v23, off, s[0:3], s33 offset:588 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v24, off, s[0:3], s33 offset:592 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v25, off, s[0:3], s33 offset:596 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v26, off, s[0:3], s33 offset:600 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v27, off, s[0:3], s33 offset:604 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v28, off, s[0:3], s33 offset:608 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v29, off, s[0:3], s33 offset:612 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v30, off, s[0:3], s33 offset:616 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v31, off, s[0:3], s33 offset:620 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v32, off, s[0:3], s33 offset:624 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v33, off, s[0:3], s33 offset:628 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v34, off, s[0:3], s33 offset:632 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v35, off, s[0:3], s33 offset:636 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0x70, v3
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v12, v32
; GCN-NEXT: buffer_store_dword v12, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v12, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v13, v33 ; GCN-NEXT: v_add_u32_e32 v0, 0x68, v19
; GCN-NEXT: v_add_u32_e32 v0, 0x74, v3
; GCN-NEXT: buffer_store_dword v13, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v13, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v14, v34 ; GCN-NEXT: v_add_u32_e32 v0, 0x6c, v19
; GCN-NEXT: v_add_u32_e32 v0, 0x78, v3
; GCN-NEXT: buffer_store_dword v14, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v14, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v15, v35 ; GCN-NEXT: v_add_u32_e32 v0, 0x70, v19
; GCN-NEXT: v_add_u32_e32 v0, 0x7c, v3
; GCN-NEXT: buffer_store_dword v15, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v15, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x80, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x74, v19
; GCN-NEXT: buffer_store_dword v36, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v16, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x84, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x78, v19
; GCN-NEXT: buffer_store_dword v37, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v17, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x88, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x7c, v19
; GCN-NEXT: buffer_store_dword v38, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v18, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x8c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x80, v19
; GCN-NEXT: buffer_store_dword v39, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v32, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x90, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x84, v19
; GCN-NEXT: buffer_store_dword v44, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v33, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x94, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x88, v19
; GCN-NEXT: buffer_store_dword v45, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v34, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x98, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x8c, v19
; GCN-NEXT: buffer_store_dword v46, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v35, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x9c, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x90, v19
; GCN-NEXT: buffer_store_dword v47, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v20, v60, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa0, v3
; GCN-NEXT: buffer_store_dword v48, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v48, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa4, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x94, v19
; GCN-NEXT: buffer_store_dword v49, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v49, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa8, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x98, v19
; GCN-NEXT: buffer_store_dword v50, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v50, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xac, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0x9c, v19
; GCN-NEXT: buffer_store_dword v51, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v51, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb0, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xa0, v19
; GCN-NEXT: buffer_store_dword v36, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa4, v19
; GCN-NEXT: buffer_store_dword v37, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa8, v19
; GCN-NEXT: buffer_store_dword v38, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xac, v19
; GCN-NEXT: buffer_store_dword v39, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb0, v19
; GCN-NEXT: buffer_store_dword v52, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v52, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb4, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xb4, v19
; GCN-NEXT: buffer_store_dword v53, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v53, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb8, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xb8, v19
; GCN-NEXT: buffer_store_dword v54, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v54, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xbc, v3 ; GCN-NEXT: v_add_u32_e32 v0, 0xbc, v19
; GCN-NEXT: buffer_store_dword v55, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v55, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xc0, v3 ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:640 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v40, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:644 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xc4, v3 ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:648 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v41, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:652 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xc8, v3 ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:656 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v42, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:660 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xcc, v3 ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:664 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v43, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:668 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 4, v3 ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:672 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v17, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:676 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 8, v3 ; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:680 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v18, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:684 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 12, v3 ; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:688 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v19, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:692 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:256 ; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:696 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:640 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:700 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:644 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xc0, v19
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:648 ; 4-byte Folded Reload ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:652 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v3, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:656 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xc4, v19
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:660 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:664 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xc8, v19
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:668 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:672 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xcc, v19
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:676 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:680 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:704 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:684 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:708 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:688 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:712 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:692 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:716 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:696 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:720 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v19, off, s[0:3], s33 offset:700 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:724 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:728 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:732 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:736 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:740 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:744 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:748 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:752 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:756 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:760 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:764 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 4, v19
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 8, v19
; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 12, v19
; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:256
; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:576 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:580 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:584 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:588 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:592 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:596 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:600 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:604 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:608 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:612 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:616 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:620 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:624 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:628 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:632 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:636 ; 4-byte Folded Reload
; GCN-NEXT: v_lshrrev_b32_e32 v0, 1, v2 ; GCN-NEXT: v_lshrrev_b32_e32 v0, 1, v2
; GCN-NEXT: v_and_b32_e32 v0, 63, v0 ; GCN-NEXT: v_and_b32_e32 v0, 63, v0
; GCN-NEXT: v_lshlrev_b32_e32 v0, 2, v0 ; GCN-NEXT: v_lshlrev_b32_e32 v0, 2, v0
; GCN-NEXT: v_add_u32_e32 v0, v3, v0 ; GCN-NEXT: v_add_u32_e32 v0, v19, v0
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v4, v8 ; GCN-NEXT: v_mov_b32_e32 v4, v7
; GCN-NEXT: buffer_store_dword v4, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v4, v1, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v5, v9 ; GCN-NEXT: v_mov_b32_e32 v5, v8
; GCN-NEXT: v_add_u32_e32 v1, 0xd4, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xd4, v19
; GCN-NEXT: v_mov_b32_e32 v6, v9
; GCN-NEXT: buffer_store_dword v5, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v5, v1, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v6, v10 ; GCN-NEXT: v_add_u32_e32 v1, 0xd8, v19
; GCN-NEXT: v_add_u32_e32 v1, 0xd8, v3
; GCN-NEXT: buffer_store_dword v6, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v6, v1, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v7, v11 ; GCN-NEXT: v_mov_b32_e32 v7, v10
; GCN-NEXT: v_add_u32_e32 v1, 0xdc, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xdc, v19
; GCN-NEXT: buffer_store_dword v7, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v7, v1, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:512 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:512 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:516 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:516 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:520 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:520 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:524 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:524 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:528 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:528 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:532 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:532 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:536 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:536 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:540 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:540 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:544 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:544 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:548 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:548 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:552 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:552 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:556 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:556 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:560 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:560 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:564 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:564 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:568 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:568 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v19, off, s[0:3], s33 offset:572 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:572 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v1, 0xe0, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xe0, v19
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v8, v12 ; GCN-NEXT: v_mov_b32_e32 v8, v11
; GCN-NEXT: buffer_store_dword v8, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v8, v1, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v9, v13 ; GCN-NEXT: v_mov_b32_e32 v9, v12
; GCN-NEXT: v_add_u32_e32 v1, 0xe4, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xe4, v19
; GCN-NEXT: v_mov_b32_e32 v10, v13
; GCN-NEXT: buffer_store_dword v9, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v9, v1, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v10, v14 ; GCN-NEXT: v_add_u32_e32 v1, 0xe8, v19
; GCN-NEXT: v_add_u32_e32 v1, 0xe8, v3
; GCN-NEXT: buffer_store_dword v10, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v10, v1, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v11, v15 ; GCN-NEXT: v_mov_b32_e32 v11, v14
; GCN-NEXT: v_add_u32_e32 v1, 0xec, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xec, v19
; GCN-NEXT: buffer_store_dword v11, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v11, v1, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v1, 0xf0, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xf0, v19
; GCN-NEXT: buffer_store_dword v56, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v56, v1, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v1, 0xf4, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xf4, v19
; GCN-NEXT: buffer_store_dword v57, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v57, v1, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v1, 0xf8, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xf8, v19
; GCN-NEXT: buffer_store_dword v58, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v58, v1, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v1, 0xfc, v3 ; GCN-NEXT: v_add_u32_e32 v1, 0xfc, v19
; GCN-NEXT: buffer_store_dword v59, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v59, v1, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v0, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v0, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v60, off, s[0:3], s33 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v60, off, s[0:3], s33 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Reload
Show All 19 Lines
define i64 @v_extract_v32i64_varidx(<32 x i64> addrspace(1)* %ptr, i32 %idx) { define i64 @v_extract_v32i64_varidx(<32 x i64> addrspace(1)* %ptr, i32 %idx) {
; GCN-LABEL: v_extract_v32i64_varidx: ; GCN-LABEL: v_extract_v32i64_varidx:
; GCN: ; %bb.0: ; GCN: ; %bb.0:
; GCN-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0)
; GCN-NEXT: s_add_u32 s4, s32, 0x3fc0 ; GCN-NEXT: s_add_u32 s4, s32, 0x3fc0
; GCN-NEXT: v_add_co_u32_e32 v3, vcc, 64, v0 ; GCN-NEXT: v_add_co_u32_e32 v3, vcc, 64, v0
; GCN-NEXT: s_mov_b32 s6, s33 ; GCN-NEXT: s_mov_b32 s6, s33
; GCN-NEXT: s_and_b32 s33, s4, 0xffffc000 ; GCN-NEXT: s_and_b32 s33, s4, 0xffffc000
; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:56 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:48 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:52 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:44 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:48 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:40 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:44 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:36 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:40 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:32 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:36 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:28 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:32 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:28 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v56, off, s[0:3], s33 offset:24 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v57, off, s[0:3], s33 offset:20 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v58, off, s[0:3], s33 offset:16 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v59, off, s[0:3], s33 offset:12 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v60, off, s[0:3], s33 offset:8 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v60, off, s[0:3], s33 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v61, off, s[0:3], s33 offset:4 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v62, off, s[0:3], s33 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v2, off, s[0:3], s33 offset:512 ; 4-byte Folded Spill
; GCN-NEXT: v_addc_co_u32_e32 v4, vcc, 0, v1, vcc ; GCN-NEXT: v_addc_co_u32_e32 v4, vcc, 0, v1, vcc
; GCN-NEXT: s_movk_i32 s4, 0x80
; GCN-NEXT: global_load_dwordx4 v[7:10], v[3:4], off offset:16 ; GCN-NEXT: global_load_dwordx4 v[7:10], v[3:4], off offset:16
; GCN-NEXT: global_load_dwordx4 v[11:14], v[3:4], off offset:32 ; GCN-NEXT: global_load_dwordx4 v[11:14], v[3:4], off offset:32
; GCN-NEXT: global_load_dwordx4 v[56:59], v[3:4], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[15:18], v[3:4], off offset:48
; GCN-NEXT: global_load_dwordx4 v[15:18], v[0:1], off
; GCN-NEXT: s_movk_i32 s4, 0x80
; GCN-NEXT: s_mov_b32 s5, 0 ; GCN-NEXT: s_mov_b32 s5, 0
; GCN-NEXT: v_mov_b32_e32 v3, s4 ; GCN-NEXT: v_mov_b32_e32 v3, s4
; GCN-NEXT: v_mov_b32_e32 v4, s5 ; GCN-NEXT: v_mov_b32_e32 v4, s5
; GCN-NEXT: v_add_co_u32_e32 v3, vcc, v0, v3 ; GCN-NEXT: v_add_co_u32_e32 v52, vcc, v0, v3
; GCN-NEXT: s_movk_i32 s4, 0xc0 ; GCN-NEXT: s_movk_i32 s4, 0xc0
; GCN-NEXT: v_mov_b32_e32 v6, s5 ; GCN-NEXT: v_addc_co_u32_e32 v53, vcc, v1, v4, vcc
; GCN-NEXT: v_addc_co_u32_e32 v4, vcc, v1, v4, vcc ; GCN-NEXT: v_mov_b32_e32 v3, s4
; GCN-NEXT: v_mov_b32_e32 v5, s4 ; GCN-NEXT: v_mov_b32_e32 v4, s5
; GCN-NEXT: v_add_co_u32_e32 v60, vcc, v0, v5 ; GCN-NEXT: v_add_co_u32_e32 v56, vcc, v0, v3
; GCN-NEXT: v_addc_co_u32_e32 v61, vcc, v1, v6, vcc ; GCN-NEXT: v_addc_co_u32_e32 v57, vcc, v1, v4, vcc
; GCN-NEXT: v_lshrrev_b32_e64 v62, 6, s33 ; GCN-NEXT: global_load_dwordx4 v[3:6], v[0:1], off
; GCN-NEXT: v_add_u32_e32 v62, 0x100, v62 ; GCN-NEXT: v_lshrrev_b32_e64 v19, 6, s33
; GCN-NEXT: v_add_u32_e32 v2, 16, v62 ; GCN-NEXT: v_add_u32_e32 v19, 0x100, v19
; GCN-NEXT: v_add_u32_e32 v60, 16, v19
; GCN-NEXT: s_add_u32 s32, s32, 0x14000 ; GCN-NEXT: s_add_u32 s32, s32, 0x14000
; GCN-NEXT: s_sub_u32 s32, s32, 0x14000 ; GCN-NEXT: s_sub_u32 s32, s32, 0x14000
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:644 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:704 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:648 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:708 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:652 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:712 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:656 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:716 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v19, off, s[0:3], s33 offset:660 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:720 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v20, off, s[0:3], s33 offset:664 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:724 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v21, off, s[0:3], s33 offset:668 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:728 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v22, off, s[0:3], s33 offset:672 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:732 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v23, off, s[0:3], s33 offset:676 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:736 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v24, off, s[0:3], s33 offset:680 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:740 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v25, off, s[0:3], s33 offset:684 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:744 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v26, off, s[0:3], s33 offset:688 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:748 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v27, off, s[0:3], s33 offset:692 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:752 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v28, off, s[0:3], s33 offset:696 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:756 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v29, off, s[0:3], s33 offset:700 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:760 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v30, off, s[0:3], s33 offset:704 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:764 ; 4-byte Folded Spill
; GCN-NEXT: global_load_dwordx4 v[20:23], v[0:1], off offset:16 ; GCN-NEXT: global_load_dwordx4 v[20:23], v[0:1], off offset:16
; GCN-NEXT: global_load_dwordx4 v[24:27], v[0:1], off offset:32 ; GCN-NEXT: global_load_dwordx4 v[24:27], v[0:1], off offset:32
; GCN-NEXT: global_load_dwordx4 v[28:31], v[0:1], off offset:48 ; GCN-NEXT: global_load_dwordx4 v[28:31], v[0:1], off offset:48
; GCN-NEXT: global_load_dwordx4 v[32:35], v[0:1], off offset:64 ; GCN-NEXT: global_load_dwordx4 v[3:6], v[0:1], off offset:64
; GCN-NEXT: global_load_dwordx4 v[36:39], v[0:1], off offset:128 ; GCN-NEXT: global_load_dwordx4 v[32:35], v[0:1], off offset:128
; GCN-NEXT: global_load_dwordx4 v[40:43], v[0:1], off offset:192 ; GCN-NEXT: global_load_dwordx4 v[36:39], v[0:1], off offset:192
; GCN-NEXT: global_load_dwordx4 v[44:47], v[3:4], off offset:16 ; GCN-NEXT: v_add_u32_e32 v0, 20, v19
; GCN-NEXT: global_load_dwordx4 v[48:51], v[3:4], off offset:32 ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: global_load_dwordx4 v[52:55], v[3:4], off offset:48 ; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:640 ; 4-byte Folded Spill
; GCN-NEXT: global_load_dwordx4 v[15:18], v[60:61], off offset:16 ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_add_u32_e32 v0, 20, v62 ; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:644 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:648 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:708 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:652 ; 4-byte Folded Spill
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:656 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:712 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:660 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:716 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:664 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:720 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:668 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:724 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:672 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:728 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:676 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:732 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:680 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:736 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:684 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v19, off, s[0:3], s33 offset:740 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:688 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v20, off, s[0:3], s33 offset:744 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:692 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v21, off, s[0:3], s33 offset:748 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:696 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v22, off, s[0:3], s33 offset:752 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:700 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v23, off, s[0:3], s33 offset:756 ; 4-byte Folded Spill ; GCN-NEXT: global_load_dwordx4 v[48:51], v[52:53], off offset:16
; GCN-NEXT: buffer_store_dword v24, off, s[0:3], s33 offset:760 ; 4-byte Folded Spill ; GCN-NEXT: global_load_dwordx4 v[36:39], v[52:53], off offset:32
; GCN-NEXT: buffer_store_dword v25, off, s[0:3], s33 offset:764 ; 4-byte Folded Spill ; GCN-NEXT: global_load_dwordx4 v[52:55], v[52:53], off offset:48
; GCN-NEXT: buffer_store_dword v26, off, s[0:3], s33 offset:768 ; 4-byte Folded Spill ; GCN-NEXT: global_load_dwordx4 v[40:43], v[56:57], off offset:16
; GCN-NEXT: global_load_dwordx4 v[15:18], v[60:61], off offset:32 ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:576 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:580 ; 4-byte Folded Spill ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:580 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:584 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:584 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:588 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:588 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:592 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:592 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:596 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:596 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:600 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:600 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:604 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:604 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:608 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:608 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:612 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:612 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:616 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:616 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:620 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:620 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:624 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:624 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v19, off, s[0:3], s33 offset:628 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:628 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v20, off, s[0:3], s33 offset:632 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:632 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v21, off, s[0:3], s33 offset:636 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:636 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v22, off, s[0:3], s33 offset:640 ; 4-byte Folded Spill ; GCN-NEXT: global_load_dwordx4 v[44:47], v[56:57], off offset:32
; GCN-NEXT: global_load_dwordx4 v[15:18], v[60:61], off offset:48 ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v36, off, s[0:3], s33 offset:512 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:516 ; 4-byte Folded Spill ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_store_dword v37, off, s[0:3], s33 offset:516 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v4, off, s[0:3], s33 offset:520 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v38, off, s[0:3], s33 offset:520 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v5, off, s[0:3], s33 offset:524 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v39, off, s[0:3], s33 offset:524 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v6, off, s[0:3], s33 offset:528 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v40, off, s[0:3], s33 offset:528 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v7, off, s[0:3], s33 offset:532 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v41, off, s[0:3], s33 offset:532 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v8, off, s[0:3], s33 offset:536 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v42, off, s[0:3], s33 offset:536 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v9, off, s[0:3], s33 offset:540 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v43, off, s[0:3], s33 offset:540 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v10, off, s[0:3], s33 offset:544 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v44, off, s[0:3], s33 offset:544 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v11, off, s[0:3], s33 offset:548 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v45, off, s[0:3], s33 offset:548 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v12, off, s[0:3], s33 offset:552 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v46, off, s[0:3], s33 offset:552 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v13, off, s[0:3], s33 offset:556 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v47, off, s[0:3], s33 offset:556 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v14, off, s[0:3], s33 offset:560 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v48, off, s[0:3], s33 offset:560 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v15, off, s[0:3], s33 offset:564 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v49, off, s[0:3], s33 offset:564 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v16, off, s[0:3], s33 offset:568 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v50, off, s[0:3], s33 offset:568 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v17, off, s[0:3], s33 offset:572 ; 4-byte Folded Spill ; GCN-NEXT: buffer_store_dword v51, off, s[0:3], s33 offset:572 ; 4-byte Folded Spill
; GCN-NEXT: buffer_store_dword v18, off, s[0:3], s33 offset:576 ; 4-byte Folded Spill ; GCN-NEXT: global_load_dwordx4 v[56:59], v[56:57], off offset:48
; GCN-NEXT: buffer_store_dword v20, v2, s[0:3], 0 offen
; GCN-NEXT: buffer_store_dword v21, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v21, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 24, v62 ; GCN-NEXT: v_add_u32_e32 v0, 24, v19
; GCN-NEXT: buffer_store_dword v22, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v22, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 28, v62 ; GCN-NEXT: v_add_u32_e32 v0, 28, v19
; GCN-NEXT: buffer_store_dword v23, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v23, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 32, v62 ; GCN-NEXT: v_add_u32_e32 v0, 32, v19
; GCN-NEXT: buffer_store_dword v24, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v24, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 36, v62 ; GCN-NEXT: v_add_u32_e32 v0, 36, v19
; GCN-NEXT: buffer_store_dword v25, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v25, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 40, v62 ; GCN-NEXT: v_add_u32_e32 v0, 40, v19
; GCN-NEXT: buffer_store_dword v26, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v26, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 44, v62 ; GCN-NEXT: v_add_u32_e32 v0, 44, v19
; GCN-NEXT: buffer_store_dword v27, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v27, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 48, v62 ; GCN-NEXT: v_add_u32_e32 v0, 48, v19
; GCN-NEXT: buffer_store_dword v28, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v28, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 52, v62 ; GCN-NEXT: v_add_u32_e32 v0, 52, v19
; GCN-NEXT: buffer_store_dword v29, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v29, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 56, v62 ; GCN-NEXT: v_add_u32_e32 v0, 56, v19
; GCN-NEXT: buffer_store_dword v30, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v30, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 60, v62 ; GCN-NEXT: v_add_u32_e32 v0, 60, v19
; GCN-NEXT: buffer_store_dword v31, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v31, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 64, v62 ; GCN-NEXT: v_add_u32_e32 v0, 64, v19
; GCN-NEXT: buffer_store_dword v32, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v3, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x44, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x44, v19
; GCN-NEXT: buffer_store_dword v33, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x48, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x48, v19
; GCN-NEXT: buffer_store_dword v34, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x4c, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x4c, v19
; GCN-NEXT: buffer_store_dword v35, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x50, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x50, v19
; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x54, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x54, v19
; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x58, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x58, v19
; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x5c, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x5c, v19
; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x60, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x60, v19
; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x64, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x64, v19
; GCN-NEXT: buffer_store_dword v12, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v12, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x68, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x68, v19
; GCN-NEXT: buffer_store_dword v13, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v13, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x6c, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x6c, v19
; GCN-NEXT: buffer_store_dword v14, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v14, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x70, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x70, v19
; GCN-NEXT: buffer_store_dword v56, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v15, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x74, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x74, v19
; GCN-NEXT: buffer_store_dword v57, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v16, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x78, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x78, v19
; GCN-NEXT: buffer_store_dword v58, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v17, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x7c, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x7c, v19
; GCN-NEXT: buffer_store_dword v59, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v18, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x80, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x80, v19
; GCN-NEXT: buffer_store_dword v36, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v32, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x84, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x84, v19
; GCN-NEXT: buffer_store_dword v37, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v33, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x88, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x88, v19
; GCN-NEXT: buffer_store_dword v38, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v34, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x8c, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x8c, v19
; GCN-NEXT: buffer_store_dword v39, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v35, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x90, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x90, v19
; GCN-NEXT: buffer_store_dword v44, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v20, v60, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x94, v62
; GCN-NEXT: buffer_store_dword v45, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x98, v62
; GCN-NEXT: buffer_store_dword v46, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0x9c, v62
; GCN-NEXT: buffer_store_dword v47, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa0, v62
; GCN-NEXT: buffer_store_dword v48, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v48, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa4, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x94, v19
; GCN-NEXT: buffer_store_dword v49, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v49, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa8, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x98, v19
; GCN-NEXT: buffer_store_dword v50, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v50, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xac, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0x9c, v19
; GCN-NEXT: buffer_store_dword v51, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v51, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb0, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xa0, v19
; GCN-NEXT: buffer_store_dword v36, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa4, v19
; GCN-NEXT: buffer_store_dword v37, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xa8, v19
; GCN-NEXT: buffer_store_dword v38, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xac, v19
; GCN-NEXT: buffer_store_dword v39, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb0, v19
; GCN-NEXT: buffer_store_dword v52, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v52, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb4, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xb4, v19
; GCN-NEXT: buffer_store_dword v53, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v53, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xb8, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xb8, v19
; GCN-NEXT: buffer_store_dword v54, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v54, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xbc, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xbc, v19
; GCN-NEXT: buffer_store_dword v55, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v55, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xc0, v62 ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:640 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v40, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:644 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xc4, v62 ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:648 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v41, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:652 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xc8, v62 ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:656 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v42, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:660 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xcc, v62 ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:664 ; 4-byte Folded Reload
; GCN-NEXT: buffer_store_dword v43, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:668 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v1, off, s[0:3], s33 offset:644 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:672 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v2, off, s[0:3], s33 offset:648 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:676 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:652 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:680 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:656 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:684 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:660 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:688 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:664 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:692 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:668 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:696 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:672 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:700 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:676 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xc0, v19
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:680 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:684 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:688 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:692 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:696 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:700 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:704 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 4, v62
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v2, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 8, v62
; GCN-NEXT: buffer_store_dword v3, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v3, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 12, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xc4, v19
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_store_dword v1, off, s[0:3], s33 offset:256 ; GCN-NEXT: v_add_u32_e32 v0, 0xc8, v19
; GCN-NEXT: buffer_load_dword v1, off, s[0:3], s33 offset:708 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v2, off, s[0:3], s33 offset:712 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xcc, v19
; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:716 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:720 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:704 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:724 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:708 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:728 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:712 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:732 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:716 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:736 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:720 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:740 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:724 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:744 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:728 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:748 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:732 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:752 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:736 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:756 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:740 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:760 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:744 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:764 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:748 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:768 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:752 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xd0, v62 ; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:756 ; 4-byte Folded Reload
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:760 ; 4-byte Folded Reload
; GCN-NEXT: v_mov_b32_e32 v4, v5 ; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:764 ; 4-byte Folded Reload
; GCN-NEXT: v_mov_b32_e32 v5, v6 ; GCN-NEXT: v_add_u32_e32 v0, 4, v19
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xd4, v62 ; GCN-NEXT: v_add_u32_e32 v0, 8, v19
; GCN-NEXT: v_mov_b32_e32 v6, v7
; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xd8, v62 ; GCN-NEXT: v_add_u32_e32 v0, 12, v19
; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v7, v8 ; GCN-NEXT: buffer_store_dword v3, off, s[0:3], s33 offset:256
; GCN-NEXT: v_add_u32_e32 v0, 0xdc, v62 ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:576 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:580 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:584 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:588 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:592 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:596 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:600 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:604 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:608 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:612 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:616 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:620 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:624 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:628 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:632 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:636 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xd0, v19
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v4, v7
; GCN-NEXT: buffer_store_dword v4, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v5, v8
; GCN-NEXT: v_add_u32_e32 v0, 0xd4, v19
; GCN-NEXT: v_mov_b32_e32 v6, v9
; GCN-NEXT: buffer_store_dword v5, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xd8, v19
; GCN-NEXT: buffer_store_dword v6, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v7, v10
; GCN-NEXT: v_add_u32_e32 v0, 0xdc, v19
; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v7, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v1, off, s[0:3], s33 offset:580 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:512 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v2, off, s[0:3], s33 offset:584 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:516 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:588 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:520 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:592 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:524 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:596 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:528 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:600 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:532 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:604 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:536 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:608 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:540 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:612 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:544 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:616 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:548 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:620 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:552 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:624 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:556 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:628 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:560 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:632 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:564 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:636 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v17, off, s[0:3], s33 offset:568 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:640 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v18, off, s[0:3], s33 offset:572 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xe0, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xe0, v19
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v8, v9 ; GCN-NEXT: v_mov_b32_e32 v8, v11
; GCN-NEXT: v_mov_b32_e32 v9, v10
; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v8, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xe4, v62 ; GCN-NEXT: v_mov_b32_e32 v9, v12
; GCN-NEXT: v_mov_b32_e32 v10, v11 ; GCN-NEXT: v_add_u32_e32 v0, 0xe4, v19
; GCN-NEXT: v_mov_b32_e32 v10, v13
; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v9, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xe8, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xe8, v19
; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v10, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v11, v12 ; GCN-NEXT: v_mov_b32_e32 v11, v14
; GCN-NEXT: v_add_u32_e32 v0, 0xec, v62 ; GCN-NEXT: v_add_u32_e32 v0, 0xec, v19
; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_store_dword v11, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v1, off, s[0:3], s33 offset:516 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xf0, v19
; GCN-NEXT: buffer_load_dword v2, off, s[0:3], s33 offset:520 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v56, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v3, off, s[0:3], s33 offset:524 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xf4, v19
; GCN-NEXT: buffer_load_dword v4, off, s[0:3], s33 offset:528 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v57, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v5, off, s[0:3], s33 offset:532 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xf8, v19
; GCN-NEXT: buffer_load_dword v6, off, s[0:3], s33 offset:536 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v58, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v7, off, s[0:3], s33 offset:540 ; 4-byte Folded Reload ; GCN-NEXT: v_add_u32_e32 v0, 0xfc, v19
; GCN-NEXT: buffer_load_dword v8, off, s[0:3], s33 offset:544 ; 4-byte Folded Reload ; GCN-NEXT: buffer_store_dword v59, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v9, off, s[0:3], s33 offset:548 ; 4-byte Folded Reload ; GCN-NEXT: v_and_b32_e32 v0, 31, v2
; GCN-NEXT: buffer_load_dword v10, off, s[0:3], s33 offset:552 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v11, off, s[0:3], s33 offset:556 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v12, off, s[0:3], s33 offset:560 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v13, off, s[0:3], s33 offset:564 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v14, off, s[0:3], s33 offset:568 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v15, off, s[0:3], s33 offset:572 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v16, off, s[0:3], s33 offset:576 ; 4-byte Folded Reload
; GCN-NEXT: v_add_u32_e32 v0, 0xf0, v62
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_mov_b32_e32 v12, v13
; GCN-NEXT: v_mov_b32_e32 v13, v14
; GCN-NEXT: buffer_store_dword v12, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xf4, v62
; GCN-NEXT: v_mov_b32_e32 v14, v15
; GCN-NEXT: buffer_store_dword v13, v0, s[0:3], 0 offen
; GCN-NEXT: v_add_u32_e32 v0, 0xf8, v62
; GCN-NEXT: buffer_store_dword v14, v0, s[0:3], 0 offen
; GCN-NEXT: v_mov_b32_e32 v15, v16
; GCN-NEXT: v_add_u32_e32 v0, 0xfc, v62
; GCN-NEXT: buffer_store_dword v15, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v0, off, s[0:3], s33 offset:512 ; 4-byte Folded Reload
; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: v_and_b32_e32 v0, 31, v0
; GCN-NEXT: v_lshlrev_b32_e32 v0, 3, v0 ; GCN-NEXT: v_lshlrev_b32_e32 v0, 3, v0
; GCN-NEXT: v_add_u32_e32 v0, v62, v0 ; GCN-NEXT: v_add_u32_e32 v0, v19, v0
; GCN-NEXT: v_add_u32_e32 v1, 4, v0 ; GCN-NEXT: v_add_u32_e32 v1, 4, v0
; GCN-NEXT: buffer_load_dword v0, v0, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v0, v0, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v1, v1, s[0:3], 0 offen ; GCN-NEXT: buffer_load_dword v1, v1, s[0:3], 0 offen
; GCN-NEXT: buffer_load_dword v62, off, s[0:3], s33 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v60, off, s[0:3], s33 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v61, off, s[0:3], s33 offset:4 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v59, off, s[0:3], s33 offset:4 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v60, off, s[0:3], s33 offset:8 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v58, off, s[0:3], s33 offset:8 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v59, off, s[0:3], s33 offset:12 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v57, off, s[0:3], s33 offset:12 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v58, off, s[0:3], s33 offset:16 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v56, off, s[0:3], s33 offset:16 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v57, off, s[0:3], s33 offset:20 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v47, off, s[0:3], s33 offset:20 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v56, off, s[0:3], s33 offset:24 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v46, off, s[0:3], s33 offset:24 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v47, off, s[0:3], s33 offset:28 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v45, off, s[0:3], s33 offset:28 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v46, off, s[0:3], s33 offset:32 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v44, off, s[0:3], s33 offset:32 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v45, off, s[0:3], s33 offset:36 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v43, off, s[0:3], s33 offset:36 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v44, off, s[0:3], s33 offset:40 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v42, off, s[0:3], s33 offset:40 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v43, off, s[0:3], s33 offset:44 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v41, off, s[0:3], s33 offset:44 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v42, off, s[0:3], s33 offset:48 ; 4-byte Folded Reload ; GCN-NEXT: buffer_load_dword v40, off, s[0:3], s33 offset:48 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v41, off, s[0:3], s33 offset:52 ; 4-byte Folded Reload
; GCN-NEXT: buffer_load_dword v40, off, s[0:3], s33 offset:56 ; 4-byte Folded Reload
; GCN-NEXT: s_mov_b32 s33, s6 ; GCN-NEXT: s_mov_b32 s33, s6
; GCN-NEXT: s_waitcnt vmcnt(0) ; GCN-NEXT: s_waitcnt vmcnt(0)
; GCN-NEXT: s_setpc_b64 s[30:31] ; GCN-NEXT: s_setpc_b64 s[30:31]
%vec = load <32 x i64>, <32 x i64> addrspace(1)* %ptr %vec = load <32 x i64>, <32 x i64> addrspace(1)* %ptr
%elt = extractelement <32 x i64> %vec, i32 %idx %elt = extractelement <32 x i64> %vec, i32 %idx
ret i64 %elt ret i64 %elt
} }

llvm/test/CodeGen/AMDGPU/GlobalISel/saddsat.ll

  • This file is larger than 256 KB, so syntax highlighting is disabled by default.
Show First 20 Lines • Show All 2,100 Lines • ▼ Show 20 Lines
define <16 x i32> @v_saddsat_v16i32(<16 x i32> %lhs, <16 x i32> %rhs) { define <16 x i32> @v_saddsat_v16i32(<16 x i32> %lhs, <16 x i32> %rhs) {
; GFX6-LABEL: v_saddsat_v16i32: ; GFX6-LABEL: v_saddsat_v16i32:
; GFX6: ; %bb.0: ; GFX6: ; %bb.0:
; GFX6-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0) ; GFX6-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0)
; GFX6-NEXT: s_brev_b32 s4, 1 ; GFX6-NEXT: s_brev_b32 s4, 1
; GFX6-NEXT: v_min_i32_e32 v32, 0, v0 ; GFX6-NEXT: v_min_i32_e32 v32, 0, v0
; GFX6-NEXT: v_sub_i32_e32 v32, vcc, s4, v32 ; GFX6-NEXT: v_sub_i32_e32 v32, vcc, s4, v32
; GFX6-NEXT: v_max_i32_e32 v16, v32, v16 ; GFX6-NEXT: v_max_i32_e32 v32, v32, v16
; GFX6-NEXT: s_brev_b32 s5, -2 ; GFX6-NEXT: s_brev_b32 s5, -2
; GFX6-NEXT: v_max_i32_e32 v32, 0, v0 ; GFX6-NEXT: v_max_i32_e32 v16, 0, v0
; GFX6-NEXT: v_sub_i32_e32 v32, vcc, s5, v32 ; GFX6-NEXT: v_sub_i32_e32 v16, vcc, s5, v16
; GFX6-NEXT: v_min_i32_e32 v16, v16, v32 ; GFX6-NEXT: v_min_i32_e32 v16, v32, v16
; GFX6-NEXT: v_add_i32_e32 v0, vcc, v0, v16 ; GFX6-NEXT: v_add_i32_e32 v0, vcc, v0, v16
; GFX6-NEXT: v_min_i32_e32 v16, 0, v1 ; GFX6-NEXT: v_min_i32_e32 v16, 0, v1
; GFX6-NEXT: v_sub_i32_e32 v16, vcc, s4, v16 ; GFX6-NEXT: v_sub_i32_e32 v16, vcc, s4, v16
; GFX6-NEXT: v_max_i32_e32 v16, v16, v17 ; GFX6-NEXT: v_max_i32_e32 v16, v16, v17
; GFX6-NEXT: v_max_i32_e32 v17, 0, v1 ; GFX6-NEXT: v_max_i32_e32 v17, 0, v1
; GFX6-NEXT: v_sub_i32_e32 v17, vcc, s5, v17 ; GFX6-NEXT: v_sub_i32_e32 v17, vcc, s5, v17
; GFX6-NEXT: v_min_i32_e32 v16, v16, v17 ; GFX6-NEXT: v_min_i32_e32 v16, v16, v17
; GFX6-NEXT: v_add_i32_e32 v1, vcc, v1, v16 ; GFX6-NEXT: v_add_i32_e32 v1, vcc, v1, v16
▲ Show 20 Lines • Show All 100 Lines • ▼ Show 20 Lines
; GFX6-NEXT: s_setpc_b64 s[30:31] ; GFX6-NEXT: s_setpc_b64 s[30:31]
; ;
; GFX8-LABEL: v_saddsat_v16i32: ; GFX8-LABEL: v_saddsat_v16i32:
; GFX8: ; %bb.0: ; GFX8: ; %bb.0:
; GFX8-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0) ; GFX8-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0)
; GFX8-NEXT: s_brev_b32 s4, 1 ; GFX8-NEXT: s_brev_b32 s4, 1
; GFX8-NEXT: v_min_i32_e32 v32, 0, v0 ; GFX8-NEXT: v_min_i32_e32 v32, 0, v0
; GFX8-NEXT: v_sub_u32_e32 v32, vcc, s4, v32 ; GFX8-NEXT: v_sub_u32_e32 v32, vcc, s4, v32
; GFX8-NEXT: v_max_i32_e32 v16, v32, v16 ; GFX8-NEXT: v_max_i32_e32 v32, v32, v16
; GFX8-NEXT: s_brev_b32 s5, -2 ; GFX8-NEXT: s_brev_b32 s5, -2
; GFX8-NEXT: v_max_i32_e32 v32, 0, v0 ; GFX8-NEXT: v_max_i32_e32 v16, 0, v0
; GFX8-NEXT: v_sub_u32_e32 v32, vcc, s5, v32 ; GFX8-NEXT: v_sub_u32_e32 v16, vcc, s5, v16
; GFX8-NEXT: v_min_i32_e32 v16, v16, v32 ; GFX8-NEXT: v_min_i32_e32 v16, v32, v16
; GFX8-NEXT: v_add_u32_e32 v0, vcc, v0, v16 ; GFX8-NEXT: v_add_u32_e32 v0, vcc, v0, v16
; GFX8-NEXT: v_min_i32_e32 v16, 0, v1 ; GFX8-NEXT: v_min_i32_e32 v16, 0, v1
; GFX8-NEXT: v_sub_u32_e32 v16, vcc, s4, v16 ; GFX8-NEXT: v_sub_u32_e32 v16, vcc, s4, v16
; GFX8-NEXT: v_max_i32_e32 v16, v16, v17 ; GFX8-NEXT: v_max_i32_e32 v16, v16, v17
; GFX8-NEXT: v_max_i32_e32 v17, 0, v1 ; GFX8-NEXT: v_max_i32_e32 v17, 0, v1
; GFX8-NEXT: v_sub_u32_e32 v17, vcc, s5, v17 ; GFX8-NEXT: v_sub_u32_e32 v17, vcc, s5, v17
; GFX8-NEXT: v_min_i32_e32 v16, v16, v17 ; GFX8-NEXT: v_min_i32_e32 v16, v16, v17
; GFX8-NEXT: v_add_u32_e32 v1, vcc, v1, v16 ; GFX8-NEXT: v_add_u32_e32 v1, vcc, v1, v16
▲ Show 20 Lines • Show All 5,055 Lines • Show Last 20 Lines

llvm/test/CodeGen/AMDGPU/GlobalISel/ssubsat.ll

  • This file is larger than 256 KB, so syntax highlighting is disabled by default.
Show First 20 Lines • Show All 2,086 Lines • ▼ Show 20 Lines
define <16 x i32> @v_ssubsat_v16i32(<16 x i32> %lhs, <16 x i32> %rhs) { define <16 x i32> @v_ssubsat_v16i32(<16 x i32> %lhs, <16 x i32> %rhs) {
; GFX6-LABEL: v_ssubsat_v16i32: ; GFX6-LABEL: v_ssubsat_v16i32:
; GFX6: ; %bb.0: ; GFX6: ; %bb.0:
; GFX6-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0) ; GFX6-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0)
; GFX6-NEXT: s_brev_b32 s4, -2 ; GFX6-NEXT: s_brev_b32 s4, -2
; GFX6-NEXT: v_max_i32_e32 v32, -1, v0 ; GFX6-NEXT: v_max_i32_e32 v32, -1, v0
; GFX6-NEXT: v_subrev_i32_e32 v32, vcc, s4, v32 ; GFX6-NEXT: v_subrev_i32_e32 v32, vcc, s4, v32
; GFX6-NEXT: v_max_i32_e32 v16, v32, v16 ; GFX6-NEXT: v_max_i32_e32 v32, v32, v16
; GFX6-NEXT: s_brev_b32 s5, 1 ; GFX6-NEXT: s_brev_b32 s5, 1
; GFX6-NEXT: v_min_i32_e32 v32, -1, v0 ; GFX6-NEXT: v_min_i32_e32 v16, -1, v0
; GFX6-NEXT: v_subrev_i32_e32 v32, vcc, s5, v32 ; GFX6-NEXT: v_subrev_i32_e32 v16, vcc, s5, v16
; GFX6-NEXT: v_min_i32_e32 v16, v16, v32 ; GFX6-NEXT: v_min_i32_e32 v16, v32, v16
; GFX6-NEXT: v_sub_i32_e32 v0, vcc, v0, v16 ; GFX6-NEXT: v_sub_i32_e32 v0, vcc, v0, v16
; GFX6-NEXT: v_max_i32_e32 v16, -1, v1 ; GFX6-NEXT: v_max_i32_e32 v16, -1, v1
; GFX6-NEXT: v_subrev_i32_e32 v16, vcc, s4, v16 ; GFX6-NEXT: v_subrev_i32_e32 v16, vcc, s4, v16
; GFX6-NEXT: v_max_i32_e32 v16, v16, v17 ; GFX6-NEXT: v_max_i32_e32 v16, v16, v17
; GFX6-NEXT: v_min_i32_e32 v17, -1, v1 ; GFX6-NEXT: v_min_i32_e32 v17, -1, v1
; GFX6-NEXT: v_subrev_i32_e32 v17, vcc, s5, v17 ; GFX6-NEXT: v_subrev_i32_e32 v17, vcc, s5, v17
; GFX6-NEXT: v_min_i32_e32 v16, v16, v17 ; GFX6-NEXT: v_min_i32_e32 v16, v16, v17
; GFX6-NEXT: v_sub_i32_e32 v1, vcc, v1, v16 ; GFX6-NEXT: v_sub_i32_e32 v1, vcc, v1, v16
▲ Show 20 Lines • Show All 100 Lines • ▼ Show 20 Lines
; GFX6-NEXT: s_setpc_b64 s[30:31] ; GFX6-NEXT: s_setpc_b64 s[30:31]
; ;
; GFX8-LABEL: v_ssubsat_v16i32: ; GFX8-LABEL: v_ssubsat_v16i32:
; GFX8: ; %bb.0: ; GFX8: ; %bb.0:
; GFX8-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0) ; GFX8-NEXT: s_waitcnt vmcnt(0) expcnt(0) lgkmcnt(0)
; GFX8-NEXT: s_brev_b32 s4, -2 ; GFX8-NEXT: s_brev_b32 s4, -2
; GFX8-NEXT: v_max_i32_e32 v32, -1, v0 ; GFX8-NEXT: v_max_i32_e32 v32, -1, v0
; GFX8-NEXT: v_subrev_u32_e32 v32, vcc, s4, v32 ; GFX8-NEXT: v_subrev_u32_e32 v32, vcc, s4, v32
; GFX8-NEXT: v_max_i32_e32 v16, v32, v16 ; GFX8-NEXT: v_max_i32_e32 v32, v32, v16
; GFX8-NEXT: s_brev_b32 s5, 1 ; GFX8-NEXT: s_brev_b32 s5, 1
; GFX8-NEXT: v_min_i32_e32 v32, -1, v0 ; GFX8-NEXT: v_min_i32_e32 v16, -1, v0
; GFX8-NEXT: v_subrev_u32_e32 v32, vcc, s5, v32 ; GFX8-NEXT: v_subrev_u32_e32 v16, vcc, s5, v16
; GFX8-NEXT: v_min_i32_e32 v16, v16, v32 ; GFX8-NEXT: v_min_i32_e32 v16, v32, v16
; GFX8-NEXT: v_sub_u32_e32 v0, vcc, v0, v16 ; GFX8-NEXT: v_sub_u32_e32 v0, vcc, v0, v16
; GFX8-NEXT: v_max_i32_e32 v16, -1, v1 ; GFX8-NEXT: v_max_i32_e32 v16, -1, v1
; GFX8-NEXT: v_subrev_u32_e32 v16, vcc, s4, v16 ; GFX8-NEXT: v_subrev_u32_e32 v16, vcc, s4, v16
; GFX8-NEXT: v_max_i32_e32 v16, v16, v17 ; GFX8-NEXT: v_max_i32_e32 v16, v16, v17
; GFX8-NEXT: v_min_i32_e32 v17, -1, v1 ; GFX8-NEXT: v_min_i32_e32 v17, -1, v1
; GFX8-NEXT: v_subrev_u32_e32 v17, vcc, s5, v17 ; GFX8-NEXT: v_subrev_u32_e32 v17, vcc, s5, v17
; GFX8-NEXT: v_min_i32_e32 v16, v16, v17 ; GFX8-NEXT: v_min_i32_e32 v16, v16, v17
; GFX8-NEXT: v_sub_u32_e32 v1, vcc, v1, v16 ; GFX8-NEXT: v_sub_u32_e32 v1, vcc, v1, v16
▲ Show 20 Lines • Show All 5,055 Lines • Show Last 20 Lines

llvm/test/CodeGen/AMDGPU/splitkit-copy-live-lanes.mir

Show First 20 Lines • Show All 52 Lines • ▼ Show 20 Lines bb.0:
; CHECK: SI_SPILL_V128_SAVE %100, %stack.9, $sgpr32, 0, implicit $exec :: (store 16 into %stack.9, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE %100, %stack.9, $sgpr32, 0, implicit $exec :: (store 16 into %stack.9, align 4, addrspace 5)
; CHECK: undef %105.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub1, implicit $exec ; CHECK: undef %105.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub1, implicit $exec
; CHECK: undef %109.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub0, implicit $exec ; CHECK: undef %109.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub0, implicit $exec
; CHECK: undef %113.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub3, implicit $exec ; CHECK: undef %113.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub3, implicit $exec
; CHECK: undef %117.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub2, implicit $exec ; CHECK: undef %117.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub2, implicit $exec
; CHECK: SI_SPILL_V128_SAVE %117, %stack.10, $sgpr32, 0, implicit $exec :: (store 16 into %stack.10, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE %117, %stack.10, $sgpr32, 0, implicit $exec :: (store 16 into %stack.10, align 4, addrspace 5)
; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET4:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 64, 0, 0, 0, 0, 0, implicit $exec :: (load 16, align 64, addrspace 1) ; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET4:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 64, 0, 0, 0, 0, 0, implicit $exec :: (load 16, align 64, addrspace 1)
; CHECK: undef %122.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub1, implicit $exec ; CHECK: undef %122.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub1, implicit $exec
; CHECK: undef %126.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub0, implicit $exec ; CHECK: SI_SPILL_V128_SAVE %122, %stack.11, $sgpr32, 0, implicit $exec :: (store 16 into %stack.11, align 4, addrspace 5)
; CHECK: undef %130.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub3, implicit $exec ; CHECK: undef %127.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub0, implicit $exec
; CHECK: SI_SPILL_V128_SAVE %130, %stack.11, $sgpr32, 0, implicit $exec :: (store 16 into %stack.11, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE %127, %stack.12, $sgpr32, 0, implicit $exec :: (store 16 into %stack.12, align 4, addrspace 5)
; CHECK: undef %135.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub2, implicit $exec ; CHECK: undef %132.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub3, implicit $exec
; CHECK: SI_SPILL_V128_SAVE %135, %stack.12, $sgpr32, 0, implicit $exec :: (store 16 into %stack.12, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE %132, %stack.13, $sgpr32, 0, implicit $exec :: (store 16 into %stack.13, align 4, addrspace 5)
; CHECK: undef %137.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub2, implicit $exec
; CHECK: SI_SPILL_V128_SAVE %137, %stack.14, $sgpr32, 0, implicit $exec :: (store 16 into %stack.14, align 4, addrspace 5)
; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET5:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 80, 0, 0, 0, 0, 0, implicit $exec :: (load 16, addrspace 1) ; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET5:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 80, 0, 0, 0, 0, 0, implicit $exec :: (load 16, addrspace 1)
; CHECK: undef %140.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub1, implicit $exec ; CHECK: undef %142.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub1, implicit $exec
; CHECK: undef %144.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub0, implicit $exec ; CHECK: undef %146.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub0, implicit $exec
; CHECK: SI_SPILL_V128_SAVE %144, %stack.13, $sgpr32, 0, implicit $exec :: (store 16 into %stack.13, align 4, addrspace 5) ; CHECK: undef %150.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub3, implicit $exec
; CHECK: undef %149.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub3, implicit $exec ; CHECK: SI_SPILL_V128_SAVE %150, %stack.15, $sgpr32, 0, implicit $exec :: (store 16 into %stack.15, align 4, addrspace 5)
; CHECK: SI_SPILL_V128_SAVE %149, %stack.14, $sgpr32, 0, implicit $exec :: (store 16 into %stack.14, align 4, addrspace 5) ; CHECK: undef %155.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub2, implicit $exec
; CHECK: undef %154.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub2, implicit $exec
; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET6:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 96, 0, 0, 0, 0, 0, implicit $exec :: (load 16, align 32, addrspace 1) ; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET6:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 96, 0, 0, 0, 0, 0, implicit $exec :: (load 16, align 32, addrspace 1)
; CHECK: undef %158.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub1, implicit $exec ; CHECK: undef %159.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub1, implicit $exec
; CHECK: undef %36.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub0, implicit $exec ; CHECK: undef %36.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub0, implicit $exec
; CHECK: undef %37.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub3, implicit $exec ; CHECK: undef %37.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub3, implicit $exec
; CHECK: undef %38.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub2, implicit $exec ; CHECK: undef %38.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub2, implicit $exec
; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET7:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 112, 0, 0, 0, 0, 0, implicit $exec :: (load 16, addrspace 1) ; CHECK: [[BUFFER_LOAD_DWORDX4_OFFSET7:%[0-9]+]]:vreg_128 = BUFFER_LOAD_DWORDX4_OFFSET %3, 0, 112, 0, 0, 0, 0, 0, implicit $exec :: (load 16, addrspace 1)
; CHECK: undef %40.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub1, implicit $exec ; CHECK: undef %40.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub1, implicit $exec
; CHECK: undef %41.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub0, implicit $exec ; CHECK: undef %41.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub0, implicit $exec
; CHECK: undef %42.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub3, implicit $exec ; CHECK: undef %42.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub3, implicit $exec
; CHECK: undef %43.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub2, implicit $exec ; CHECK: undef %43.sub2:vreg_128 = V_LSHRREV_B32_e32 16, [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub2, implicit $exec
Show All 36 Lines bb.0:
; CHECK: %106.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub1, implicit $exec ; CHECK: %106.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub1, implicit $exec
; CHECK: undef %110.sub2:vreg_128 = COPY %109.sub2 ; CHECK: undef %110.sub2:vreg_128 = COPY %109.sub2
; CHECK: %110.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub0, implicit $exec ; CHECK: %110.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub0, implicit $exec
; CHECK: undef %114.sub2:vreg_128 = COPY %113.sub2 ; CHECK: undef %114.sub2:vreg_128 = COPY %113.sub2
; CHECK: %114.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub3, implicit $exec ; CHECK: %114.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub3, implicit $exec
; CHECK: [[SI_SPILL_V128_RESTORE10:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.10, $sgpr32, 0, implicit $exec :: (load 16 from %stack.10, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE10:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.10, $sgpr32, 0, implicit $exec :: (load 16 from %stack.10, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE10]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub2, implicit $exec ; CHECK: [[SI_SPILL_V128_RESTORE10]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET3]].sub2, implicit $exec
; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE10]], %stack.10, $sgpr32, 0, implicit $exec :: (store 16 into %stack.10, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE10]], %stack.10, $sgpr32, 0, implicit $exec :: (store 16 into %stack.10, align 4, addrspace 5)
; CHECK: undef %123.sub2:vreg_128 = COPY %122.sub2
; CHECK: %123.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub1, implicit $exec
; CHECK: undef %127.sub2:vreg_128 = COPY %126.sub2
; CHECK: %127.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub0, implicit $exec
; CHECK: [[SI_SPILL_V128_RESTORE11:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.11, $sgpr32, 0, implicit $exec :: (load 16 from %stack.11, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE11:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.11, $sgpr32, 0, implicit $exec :: (load 16 from %stack.11, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE11]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub3, implicit $exec ; CHECK: [[SI_SPILL_V128_RESTORE11]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub1, implicit $exec
; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE11]], %stack.11, $sgpr32, 0, implicit $exec :: (store 16 into %stack.11, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE11]], %stack.11, $sgpr32, 0, implicit $exec :: (store 16 into %stack.11, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE12:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.12, $sgpr32, 0, implicit $exec :: (load 16 from %stack.12, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE12:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.12, $sgpr32, 0, implicit $exec :: (load 16 from %stack.12, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE12]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub2, implicit $exec ; CHECK: [[SI_SPILL_V128_RESTORE12]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub0, implicit $exec
; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE12]], %stack.12, $sgpr32, 0, implicit $exec :: (store 16 into %stack.12, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE12]], %stack.12, $sgpr32, 0, implicit $exec :: (store 16 into %stack.12, align 4, addrspace 5)
; CHECK: undef %141.sub2:vreg_128 = COPY %140.sub2
; CHECK: %141.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub1, implicit $exec
; CHECK: [[SI_SPILL_V128_RESTORE13:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.13, $sgpr32, 0, implicit $exec :: (load 16 from %stack.13, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE13:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.13, $sgpr32, 0, implicit $exec :: (load 16 from %stack.13, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE13]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub0, implicit $exec ; CHECK: [[SI_SPILL_V128_RESTORE13]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub3, implicit $exec
; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE13]], %stack.13, $sgpr32, 0, implicit $exec :: (store 16 into %stack.13, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE13]], %stack.13, $sgpr32, 0, implicit $exec :: (store 16 into %stack.13, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE14:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.14, $sgpr32, 0, implicit $exec :: (load 16 from %stack.14, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE14:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.14, $sgpr32, 0, implicit $exec :: (load 16 from %stack.14, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE14]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub3, implicit $exec ; CHECK: [[SI_SPILL_V128_RESTORE14]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET4]].sub2, implicit $exec
; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE14]], %stack.14, $sgpr32, 0, implicit $exec :: (store 16 into %stack.14, align 4, addrspace 5) ; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE14]], %stack.14, $sgpr32, 0, implicit $exec :: (store 16 into %stack.14, align 4, addrspace 5)
; CHECK: undef %155.sub2:vreg_128 = COPY %154.sub2 ; CHECK: undef %143.sub2:vreg_128 = COPY %142.sub2
; CHECK: %155.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub2, implicit $exec ; CHECK: %143.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub1, implicit $exec
; CHECK: undef %159.sub2:vreg_128 = COPY %158.sub2 ; CHECK: undef %147.sub2:vreg_128 = COPY %146.sub2
; CHECK: %159.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub1, implicit $exec ; CHECK: %147.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub0, implicit $exec
; CHECK: [[SI_SPILL_V128_RESTORE15:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.15, $sgpr32, 0, implicit $exec :: (load 16 from %stack.15, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE15]].sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub3, implicit $exec
; CHECK: SI_SPILL_V128_SAVE [[SI_SPILL_V128_RESTORE15]], %stack.15, $sgpr32, 0, implicit $exec :: (store 16 into %stack.15, align 4, addrspace 5)
; CHECK: undef %156.sub2:vreg_128 = COPY %155.sub2
; CHECK: %156.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET5]].sub2, implicit $exec
; CHECK: undef %160.sub2:vreg_128 = COPY %159.sub2
; CHECK: %160.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub1, implicit $exec
; CHECK: %36.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub0, implicit $exec ; CHECK: %36.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub0, implicit $exec
; CHECK: %37.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub3, implicit $exec ; CHECK: %37.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub3, implicit $exec
; CHECK: %38.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub2, implicit $exec ; CHECK: %38.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET6]].sub2, implicit $exec
; CHECK: %40.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub1, implicit $exec ; CHECK: %40.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub1, implicit $exec
; CHECK: %41.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub0, implicit $exec ; CHECK: %41.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub0, implicit $exec
; CHECK: %42.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub3, implicit $exec ; CHECK: %42.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub3, implicit $exec
; CHECK: %43.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub2, implicit $exec ; CHECK: %43.sub0:vreg_128 = V_AND_B32_e32 [[S_MOV_B32_]], [[BUFFER_LOAD_DWORDX4_OFFSET7]].sub2, implicit $exec
; CHECK: %43.sub1:vreg_128 = V_MOV_B32_e32 0, implicit $exec ; CHECK: %43.sub1:vreg_128 = V_MOV_B32_e32 0, implicit $exec
Show All 12 Lines bb.0:
; CHECK: %38.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %38.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %38, %2, 0, 416, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %38, %2, 0, 416, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1)
; CHECK: %37.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %37.sub1:vreg_128 = COPY %43.sub1
; CHECK: %37.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %37.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %37, %2, 0, 432, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %37, %2, 0, 432, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: %36.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %36.sub1:vreg_128 = COPY %43.sub1
; CHECK: %36.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %36.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %36, %2, 0, 384, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 128, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %36, %2, 0, 384, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 128, addrspace 1)
; CHECK: undef %157.sub0:vreg_128 = COPY %159.sub0 { ; CHECK: undef %158.sub0:vreg_128 = COPY %160.sub0 {
; CHECK: internal %157.sub2:vreg_128 = COPY %159.sub2 ; CHECK: internal %158.sub2:vreg_128 = COPY %160.sub2
; CHECK: } ; CHECK: }
; CHECK: %157.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %158.sub1:vreg_128 = COPY %43.sub1
; CHECK: %157.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %158.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %157, %2, 0, 400, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %158, %2, 0, 400, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: undef %153.sub0:vreg_128 = COPY %155.sub0 { ; CHECK: undef %154.sub0:vreg_128 = COPY %156.sub0 {
; CHECK: internal %153.sub2:vreg_128 = COPY %155.sub2 ; CHECK: internal %154.sub2:vreg_128 = COPY %156.sub2
; CHECK: } ; CHECK: }
; CHECK: %153.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %154.sub1:vreg_128 = COPY %43.sub1
; CHECK: %153.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %154.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %153, %2, 0, 352, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %154, %2, 0, 352, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE15:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.14, $sgpr32, 0, implicit $exec :: (load 16 from %stack.14, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE16:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.15, $sgpr32, 0, implicit $exec :: (load 16 from %stack.15, align 4, addrspace 5)
; CHECK: undef %148.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE15]].sub0 { ; CHECK: undef %149.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE16]].sub0 {
; CHECK: internal %148.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE15]].sub2 ; CHECK: internal %149.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE16]].sub2
; CHECK: } ; CHECK: }
; CHECK: %148.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %149.sub1:vreg_128 = COPY %43.sub1
; CHECK: %148.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %149.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %148, %2, 0, 368, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %149, %2, 0, 368, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE16:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.13, $sgpr32, 0, implicit $exec :: (load 16 from %stack.13, align 4, addrspace 5) ; CHECK: undef %145.sub0:vreg_128 = COPY %147.sub0 {
; CHECK: undef %143.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE16]].sub0 { ; CHECK: internal %145.sub2:vreg_128 = COPY %147.sub2
; CHECK: internal %143.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE16]].sub2 ; CHECK: }
; CHECK: } ; CHECK: %145.sub1:vreg_128 = COPY %43.sub1
; CHECK: %143.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %145.sub3:vreg_128 = COPY %43.sub1
; CHECK: %143.sub3:vreg_128 = COPY %43.sub1 ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %145, %2, 0, 320, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 64, addrspace 1)
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %143, %2, 0, 320, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 64, addrspace 1) ; CHECK: undef %141.sub0:vreg_128 = COPY %143.sub0 {
; CHECK: undef %139.sub0:vreg_128 = COPY %141.sub0 { ; CHECK: internal %141.sub2:vreg_128 = COPY %143.sub2
; CHECK: internal %139.sub2:vreg_128 = COPY %141.sub2 ; CHECK: }
; CHECK: } ; CHECK: %141.sub1:vreg_128 = COPY %43.sub1
; CHECK: %139.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %141.sub3:vreg_128 = COPY %43.sub1
; CHECK: %139.sub3:vreg_128 = COPY %43.sub1 ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %141, %2, 0, 336, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %139, %2, 0, 336, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: [[SI_SPILL_V128_RESTORE17:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.14, $sgpr32, 0, implicit $exec :: (load 16 from %stack.14, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE17:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.12, $sgpr32, 0, implicit $exec :: (load 16 from %stack.12, align 4, addrspace 5) ; CHECK: undef %136.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE17]].sub0 {
; CHECK: undef %134.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE17]].sub0 { ; CHECK: internal %136.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE17]].sub2
; CHECK: internal %134.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE17]].sub2 ; CHECK: }
; CHECK: } ; CHECK: %136.sub1:vreg_128 = COPY %43.sub1
; CHECK: %134.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %136.sub3:vreg_128 = COPY %43.sub1
; CHECK: %134.sub3:vreg_128 = COPY %43.sub1 ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %136, %2, 0, 288, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1)
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %134, %2, 0, 288, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1) ; CHECK: [[SI_SPILL_V128_RESTORE18:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.13, $sgpr32, 0, implicit $exec :: (load 16 from %stack.13, align 4, addrspace 5)
; CHECK: [[SI_SPILL_V128_RESTORE18:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.11, $sgpr32, 0, implicit $exec :: (load 16 from %stack.11, align 4, addrspace 5) ; CHECK: undef %131.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE18]].sub0 {
; CHECK: undef %129.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE18]].sub0 { ; CHECK: internal %131.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE18]].sub2
; CHECK: internal %129.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE18]].sub2 ; CHECK: }
; CHECK: } ; CHECK: %131.sub1:vreg_128 = COPY %43.sub1
; CHECK: %129.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %131.sub3:vreg_128 = COPY %43.sub1
; CHECK: %129.sub3:vreg_128 = COPY %43.sub1 ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %131, %2, 0, 304, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %129, %2, 0, 304, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: [[SI_SPILL_V128_RESTORE19:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.12, $sgpr32, 0, implicit $exec :: (load 16 from %stack.12, align 4, addrspace 5)
; CHECK: undef %125.sub0:vreg_128 = COPY %127.sub0 { ; CHECK: undef %126.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE19]].sub0 {
; CHECK: internal %125.sub2:vreg_128 = COPY %127.sub2 ; CHECK: internal %126.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE19]].sub2
; CHECK: } ; CHECK: }
; CHECK: %125.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %126.sub1:vreg_128 = COPY %43.sub1
; CHECK: %125.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %126.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %125, %2, 0, 256, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 256, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %126, %2, 0, 256, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 256, addrspace 1)
; CHECK: undef %121.sub0:vreg_128 = COPY %123.sub0 { ; CHECK: [[SI_SPILL_V128_RESTORE20:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.11, $sgpr32, 0, implicit $exec :: (load 16 from %stack.11, align 4, addrspace 5)
; CHECK: internal %121.sub2:vreg_128 = COPY %123.sub2 ; CHECK: undef %121.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE20]].sub0 {
; CHECK: internal %121.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE20]].sub2
; CHECK: } ; CHECK: }
; CHECK: %121.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %121.sub1:vreg_128 = COPY %43.sub1
; CHECK: %121.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %121.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %121, %2, 0, 272, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %121, %2, 0, 272, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE19:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.10, $sgpr32, 0, implicit $exec :: (load 16 from %stack.10, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE21:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.10, $sgpr32, 0, implicit $exec :: (load 16 from %stack.10, align 4, addrspace 5)
; CHECK: undef %116.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE19]].sub0 { ; CHECK: undef %116.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE21]].sub0 {
; CHECK: internal %116.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE19]].sub2 ; CHECK: internal %116.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE21]].sub2
; CHECK: } ; CHECK: }
; CHECK: %116.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %116.sub1:vreg_128 = COPY %43.sub1
; CHECK: %116.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %116.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %116, %2, 0, 224, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %116, %2, 0, 224, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1)
; CHECK: undef %112.sub0:vreg_128 = COPY %114.sub0 { ; CHECK: undef %112.sub0:vreg_128 = COPY %114.sub0 {
; CHECK: internal %112.sub2:vreg_128 = COPY %114.sub2 ; CHECK: internal %112.sub2:vreg_128 = COPY %114.sub2
; CHECK: } ; CHECK: }
; CHECK: %112.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %112.sub1:vreg_128 = COPY %43.sub1
; CHECK: %112.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %112.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %112, %2, 0, 240, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %112, %2, 0, 240, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: undef %108.sub0:vreg_128 = COPY %110.sub0 { ; CHECK: undef %108.sub0:vreg_128 = COPY %110.sub0 {
; CHECK: internal %108.sub2:vreg_128 = COPY %110.sub2 ; CHECK: internal %108.sub2:vreg_128 = COPY %110.sub2
; CHECK: } ; CHECK: }
; CHECK: %108.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %108.sub1:vreg_128 = COPY %43.sub1
; CHECK: %108.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %108.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %108, %2, 0, 192, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 64, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %108, %2, 0, 192, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 64, addrspace 1)
; CHECK: undef %104.sub0:vreg_128 = COPY %106.sub0 { ; CHECK: undef %104.sub0:vreg_128 = COPY %106.sub0 {
; CHECK: internal %104.sub2:vreg_128 = COPY %106.sub2 ; CHECK: internal %104.sub2:vreg_128 = COPY %106.sub2
; CHECK: } ; CHECK: }
; CHECK: %104.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %104.sub1:vreg_128 = COPY %43.sub1
; CHECK: %104.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %104.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %104, %2, 0, 208, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %104, %2, 0, 208, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE20:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.9, $sgpr32, 0, implicit $exec :: (load 16 from %stack.9, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE22:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.9, $sgpr32, 0, implicit $exec :: (load 16 from %stack.9, align 4, addrspace 5)
; CHECK: undef %99.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE20]].sub0 { ; CHECK: undef %99.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE22]].sub0 {
; CHECK: internal %99.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE20]].sub2 ; CHECK: internal %99.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE22]].sub2
; CHECK: } ; CHECK: }
; CHECK: %99.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %99.sub1:vreg_128 = COPY %43.sub1
; CHECK: %99.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %99.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %99, %2, 0, 160, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %99, %2, 0, 160, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE21:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.8, $sgpr32, 0, implicit $exec :: (load 16 from %stack.8, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE23:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.8, $sgpr32, 0, implicit $exec :: (load 16 from %stack.8, align 4, addrspace 5)
; CHECK: undef %94.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE21]].sub0 { ; CHECK: undef %94.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE23]].sub0 {
; CHECK: internal %94.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE21]].sub2 ; CHECK: internal %94.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE23]].sub2
; CHECK: } ; CHECK: }
; CHECK: %94.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %94.sub1:vreg_128 = COPY %43.sub1
; CHECK: %94.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %94.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %94, %2, 0, 176, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %94, %2, 0, 176, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE22:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.7, $sgpr32, 0, implicit $exec :: (load 16 from %stack.7, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE24:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.7, $sgpr32, 0, implicit $exec :: (load 16 from %stack.7, align 4, addrspace 5)
; CHECK: undef %89.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE22]].sub0 { ; CHECK: undef %89.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE24]].sub0 {
; CHECK: internal %89.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE22]].sub2 ; CHECK: internal %89.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE24]].sub2
; CHECK: } ; CHECK: }
; CHECK: %89.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %89.sub1:vreg_128 = COPY %43.sub1
; CHECK: %89.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %89.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %89, %2, 0, 128, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 128, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %89, %2, 0, 128, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 128, addrspace 1)
; CHECK: undef %85.sub0:vreg_128 = COPY %87.sub0 { ; CHECK: undef %85.sub0:vreg_128 = COPY %87.sub0 {
; CHECK: internal %85.sub2:vreg_128 = COPY %87.sub2 ; CHECK: internal %85.sub2:vreg_128 = COPY %87.sub2
; CHECK: } ; CHECK: }
; CHECK: %85.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %85.sub1:vreg_128 = COPY %43.sub1
; CHECK: %85.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %85.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %85, %2, 0, 144, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %85, %2, 0, 144, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE23:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.6, $sgpr32, 0, implicit $exec :: (load 16 from %stack.6, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE25:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.6, $sgpr32, 0, implicit $exec :: (load 16 from %stack.6, align 4, addrspace 5)
; CHECK: undef %80.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE23]].sub0 { ; CHECK: undef %80.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE25]].sub0 {
; CHECK: internal %80.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE23]].sub2 ; CHECK: internal %80.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE25]].sub2
; CHECK: } ; CHECK: }
; CHECK: %80.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %80.sub1:vreg_128 = COPY %43.sub1
; CHECK: %80.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %80.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %80, %2, 0, 96, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %80, %2, 0, 96, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE24:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.5, $sgpr32, 0, implicit $exec :: (load 16 from %stack.5, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE26:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.5, $sgpr32, 0, implicit $exec :: (load 16 from %stack.5, align 4, addrspace 5)
; CHECK: undef %75.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE24]].sub0 { ; CHECK: undef %75.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE26]].sub0 {
; CHECK: internal %75.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE24]].sub2 ; CHECK: internal %75.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE26]].sub2
; CHECK: } ; CHECK: }
; CHECK: %75.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %75.sub1:vreg_128 = COPY %43.sub1
; CHECK: %75.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %75.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %75, %2, 0, 112, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %75, %2, 0, 112, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE25:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.4, $sgpr32, 0, implicit $exec :: (load 16 from %stack.4, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE27:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.4, $sgpr32, 0, implicit $exec :: (load 16 from %stack.4, align 4, addrspace 5)
; CHECK: undef %70.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE25]].sub0 { ; CHECK: undef %70.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE27]].sub0 {
; CHECK: internal %70.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE25]].sub2 ; CHECK: internal %70.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE27]].sub2
; CHECK: } ; CHECK: }
; CHECK: %70.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %70.sub1:vreg_128 = COPY %43.sub1
; CHECK: %70.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %70.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %70, %2, 0, 64, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 64, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %70, %2, 0, 64, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 64, addrspace 1)
; CHECK: undef %66.sub0:vreg_128 = COPY %68.sub0 { ; CHECK: undef %66.sub0:vreg_128 = COPY %68.sub0 {
; CHECK: internal %66.sub2:vreg_128 = COPY %68.sub2 ; CHECK: internal %66.sub2:vreg_128 = COPY %68.sub2
; CHECK: } ; CHECK: }
; CHECK: %66.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %66.sub1:vreg_128 = COPY %43.sub1
; CHECK: %66.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %66.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %66, %2, 0, 80, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %66, %2, 0, 80, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE26:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.3, $sgpr32, 0, implicit $exec :: (load 16 from %stack.3, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE28:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.3, $sgpr32, 0, implicit $exec :: (load 16 from %stack.3, align 4, addrspace 5)
; CHECK: undef %61.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE26]].sub0 { ; CHECK: undef %61.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE28]].sub0 {
; CHECK: internal %61.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE26]].sub2 ; CHECK: internal %61.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE28]].sub2
; CHECK: } ; CHECK: }
; CHECK: %61.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %61.sub1:vreg_128 = COPY %43.sub1
; CHECK: %61.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %61.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %61, %2, 0, 32, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %61, %2, 0, 32, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 32, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE27:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.2, $sgpr32, 0, implicit $exec :: (load 16 from %stack.2, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE29:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.2, $sgpr32, 0, implicit $exec :: (load 16 from %stack.2, align 4, addrspace 5)
; CHECK: undef %56.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE27]].sub0 { ; CHECK: undef %56.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE29]].sub0 {
; CHECK: internal %56.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE27]].sub2 ; CHECK: internal %56.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE29]].sub2
; CHECK: } ; CHECK: }
; CHECK: %56.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %56.sub1:vreg_128 = COPY %43.sub1
; CHECK: %56.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %56.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %56, %2, 0, 48, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %56, %2, 0, 48, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE28:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.1, $sgpr32, 0, implicit $exec :: (load 16 from %stack.1, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE30:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.1, $sgpr32, 0, implicit $exec :: (load 16 from %stack.1, align 4, addrspace 5)
; CHECK: undef %51.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE28]].sub0 { ; CHECK: undef %51.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE30]].sub0 {
; CHECK: internal %51.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE28]].sub2 ; CHECK: internal %51.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE30]].sub2
; CHECK: } ; CHECK: }
; CHECK: %51.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %51.sub1:vreg_128 = COPY %43.sub1
; CHECK: %51.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %51.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %51, %2, 0, 0, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 512, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %51, %2, 0, 0, 0, 0, 0, 0, 0, implicit $exec :: (store 16, align 512, addrspace 1)
; CHECK: [[SI_SPILL_V128_RESTORE29:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.0, $sgpr32, 0, implicit $exec :: (load 16 from %stack.0, align 4, addrspace 5) ; CHECK: [[SI_SPILL_V128_RESTORE31:%[0-9]+]]:vreg_128 = SI_SPILL_V128_RESTORE %stack.0, $sgpr32, 0, implicit $exec :: (load 16 from %stack.0, align 4, addrspace 5)
; CHECK: undef %46.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE29]].sub0 { ; CHECK: undef %46.sub0:vreg_128 = COPY [[SI_SPILL_V128_RESTORE31]].sub0 {
; CHECK: internal %46.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE29]].sub2 ; CHECK: internal %46.sub2:vreg_128 = COPY [[SI_SPILL_V128_RESTORE31]].sub2
; CHECK: } ; CHECK: }
; CHECK: %46.sub1:vreg_128 = COPY %43.sub1 ; CHECK: %46.sub1:vreg_128 = COPY %43.sub1
; CHECK: %46.sub3:vreg_128 = COPY %43.sub1 ; CHECK: %46.sub3:vreg_128 = COPY %43.sub1
; CHECK: BUFFER_STORE_DWORDX4_OFFSET %46, %2, 0, 16, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1) ; CHECK: BUFFER_STORE_DWORDX4_OFFSET %46, %2, 0, 16, 0, 0, 0, 0, 0, implicit $exec :: (store 16, addrspace 1)
; CHECK: S_ENDPGM 0 ; CHECK: S_ENDPGM 0
%0:sgpr_64(p4) = COPY $sgpr0_sgpr1 %0:sgpr_64(p4) = COPY $sgpr0_sgpr1
%1:sgpr_128 = S_LOAD_DWORDX4_IMM %0(p4), 9, 0, 0 :: (dereferenceable invariant load 16, align 4, addrspace 4) %1:sgpr_128 = S_LOAD_DWORDX4_IMM %0(p4), 9, 0, 0 :: (dereferenceable invariant load 16, align 4, addrspace 4)
undef %2.sub3:sgpr_128 = S_MOV_B32 61440 undef %2.sub3:sgpr_128 = S_MOV_B32 61440
▲ Show 20 Lines • Show All 180 Lines • Show Last 20 Lines

llvm/test/CodeGen/AMDGPU/vgpr-tuple-allocation.ll

Show First 20 Lines • Show All 127 Lines • ▼ Show 20 Lines
; GFX10-NEXT: buffer_store_dword v44, off, s[0:3], s33 ; 4-byte Folded Spill ; GFX10-NEXT: buffer_store_dword v44, off, s[0:3], s33 ; 4-byte Folded Spill
; GFX10: image_gather4_c_b_cl v[0:3], v[12:19], s[36:43], s[4:7] dmask:0x1 dim:SQ_RSRC_IMG_2D ; GFX10: image_gather4_c_b_cl v[0:3], v[12:19], s[36:43], s[4:7] dmask:0x1 dim:SQ_RSRC_IMG_2D
; GFX10-NEXT: s_waitcnt_depctr 0xffe3 ; GFX10-NEXT: s_waitcnt_depctr 0xffe3
; GFX10-NEXT: s_getpc_b64 s[4:5] ; GFX10-NEXT: s_getpc_b64 s[4:5]
; GFX10-NEXT: s_add_u32 s4, s4, extern_func@gotpcrel32@lo+4 ; GFX10-NEXT: s_add_u32 s4, s4, extern_func@gotpcrel32@lo+4
; GFX10-NEXT: s_addc_u32 s5, s5, extern_func@gotpcrel32@hi+12 ; GFX10-NEXT: s_addc_u32 s5, s5, extern_func@gotpcrel32@hi+12
; GFX10-NEXT: v_mov_b32_e32 v40, v16 ; GFX10-NEXT: v_mov_b32_e32 v44, v16
; GFX10-NEXT: s_load_dwordx2 s[4:5], s[4:5], 0x0 ; GFX10-NEXT: s_load_dwordx2 s[4:5], s[4:5], 0x0
; GFX10-NEXT: v_mov_b32_e32 v41, v15 ; GFX10-NEXT: v_mov_b32_e32 v41, v15
; GFX10-NEXT: v_mov_b32_e32 v42, v14 ; GFX10-NEXT: v_mov_b32_e32 v42, v14
; GFX10-NEXT: v_mov_b32_e32 v43, v13 ; GFX10-NEXT: v_mov_b32_e32 v43, v13
; GFX10-NEXT: v_mov_b32_e32 v44, v12 ; GFX10-NEXT: v_mov_b32_e32 v40, v12
; GFX10-NEXT: s_waitcnt vmcnt(0) ; GFX10-NEXT: s_waitcnt vmcnt(0)
; GFX10-NEXT: global_store_dwordx4 v[0:1], v[0:3], off ; GFX10-NEXT: global_store_dwordx4 v[0:1], v[0:3], off
; GFX10-NEXT: s_waitcnt lgkmcnt(0) ; GFX10-NEXT: s_waitcnt lgkmcnt(0)
; GFX10-NEXT: s_swappc_b64 s[30:31], s[4:5] ; GFX10-NEXT: s_swappc_b64 s[30:31], s[4:5]
; GFX10-NEXT: image_gather4_c_b_cl v[0:3], [v44, v43, v42, v41, v40], s[36:43], s[4:7] dmask:0x1 dim:SQ_RSRC_IMG_2D ; GFX10-NEXT: image_gather4_c_b_cl v[0:3], [v40, v43, v42, v41, v44], s[36:43], s[4:7] dmask:0x1 dim:SQ_RSRC_IMG_2D
; GFX10: buffer_load_dword v44, off, s[0:3], s33 ; GFX10: buffer_load_dword v44, off, s[0:3], s33
; GFX10-NEXT: buffer_load_dword v43, off, s[0:3], s33 offset:4 ; GFX10-NEXT: buffer_load_dword v43, off, s[0:3], s33 offset:4
; GFX10-NEXT: buffer_load_dword v42, off, s[0:3], s33 offset:8 ; GFX10-NEXT: buffer_load_dword v42, off, s[0:3], s33 offset:8
; GFX10-NEXT: buffer_load_dword v41, off, s[0:3], s33 offset:12 ; GFX10-NEXT: buffer_load_dword v41, off, s[0:3], s33 offset:12
; GFX10-NEXT: buffer_load_dword v40, off, s[0:3], s33 offset:16 ; GFX10-NEXT: buffer_load_dword v40, off, s[0:3], s33 offset:16
; GFX10: buffer_load_dword v45, off, s[0:3], s32 offset:20 ; GFX10: buffer_load_dword v45, off, s[0:3], s32 offset:20
; GFX10: s_setpc_b64 s[4:5] ; GFX10: s_setpc_b64 s[4:5]
Show All 12 Lines