[elfabi] Write program headers, .dynamic, .dynstr, and .shstrtab

[jakehehrlich]

Summary

This patch adds the majority of the work needed for writing binary ELF stub files. While only the dynamic entries are written as contents, most of this patch involves the surrounding framework of an ELF file that allows the .dynamic and .dynstr sections to exist happily.

Added:

• Writes section headers.
• Writes two program headers (PT_DYNAMIC and a PT_LOAD).
• Writes .dynstr (only containing strings from .dynamic).
• Writes .dynamic.
• Writes .shstrtab.

This patch is very large, and may later be broken down if possible.

[amontanez]

Rebase, split out bigger functions to use helper functions, add a simple test.

[amontanez]

Cleaned up significantly, added tests, moved from WIP status to ready for review. This patch is very large. I'm open to splitting it up after a brief discussion on how people would prefer I do that.

[amontanez]

Removing from review queues until I look into write commands requested in D55839

[jakehehrlich]

Gonna take this one too.

[jakehehrlich]

Ok so this is the rough idea that I have for doing this. I need to add program headers which turns out to require refactoring this a bit. The general idea takes some explanation. There are multiple ways to think about it however. The goal is for everything to "work itself out" automagically. I'll need to add program headers as many bits of functionality are not easily testable here unless we add them. You'll note that I put the NOBITS sections before the other sections. This doesn't jive well with using a single program header to cover them all and since space is a thing we'd like to constrain here we should support it. Unfortunately I did that as optimization as a means of avoiding the dynamic symbol table needing know the addresses of the NOBITS sections before starting. This is overcomeable using an additional loop however. I think an additional loop would be needed even if you hand rolled however and by adding this loop we can probably avoid maintaining an intermediate vector for the dynamic symbol table. Instead we can compute the overall size first, allocate the FileOutputBuffer, and then write directly into it. I'm not sure the complexity or redundancy is justified by the memory savings and I think the time savings will be pretty minimal.

First Way of thinking about it (As a Build System)

You can think of each Lazy value as being a build step. That build step then references other build steps as dependencies. Before completing this build step it goes on to evaluate the other build steps first. As long as no cyclic dependencies show up it all works out. To ensure that there are no cyclic dependencies we have to methods. Method 1) is the Blackhole boolean which if set to true while a Lazy value is being evaluated so that if it ever gets back to itself it can raise an error. The name Blackhole comes from some literature regarding a different way of thinking about it. Method 2) is to assume the minimum possible at each build step. By assuming the minimum possible at each build step you ensure (generally) that you logically can't have any cycles without the idea as a whole being invalid. This is not completely true for lots of little reasons but the main issue is that assumptions produce faster code. Right now I have the number of loops over the symbols down to just 2 which is the minimum I think is possible if you were to hand roll this as is.

Second Way of thinking about it (As futures)

You can think of each Lazy value as a promise to compute that at some point. Each future is then resolve as soon as it can be but it might have to wait on another future. Deadlock occurs when there's a cycle. In fact if we used std::future with delayed evaluation instead of Lazy this would work and we could process the graph in parallel. The graph is quite small at the moment since individual symbols are not members of the graph however so I don't think that would be useful.

Third Way of thinking about (As an instance of the Lob combinator)

My background before working in systems was in programming language theory. There's something called the Lob combinator which can take a self referential spegetti like data structure and actually produce it with links and all. It has many forms and this is one of them. The Lob combinator would evaluate all of the nodes (a node in such a structure is equivalent to a node in a the build graph from Way 1) but we only really need a few. The Lob combinator, in its truely magical form, only works with lazy values however. So I'm just replicating that here. Lazy values are represented by "thunks" in practice. The idea of making a thunk a "blackhole" while its being evaluated to catch cycles comes from some readings I did on GHC's implementation of Haskell which lets it dynamically catch some forms of infinite loops that don't make progress (but not all less it solve the halting problem).

Fourth Way of thinking about it (As as an instance of a build system a la "Build Systems a la carte")

This is like a kind of crappy (or more restricted if you'd rather) version of what they outline in that paper for a dynamic build system. The Lob combinator and build systems are thus then related.

[jakehehrlich]

Oh and this is the big picture. I'll be splitting this up somehow.

[MaskRay]

You may have put the rationale somewhere but they are not easily searchable. Please allow me to ask why there is a desire to write yet another ELF emitter. Can't we invest more in existing tools like yaml2obj? Is there any inherent limitation that prevents it from being more dynamic?

llvm/llvm/test/tools/llvm-elfabi/binary-write-pheaders.test

18

{{.*$}} can just be omitted. Many other tests do this.

If you want to use FileCheck --match-full-lines to omit the regex in 4096{{$}}, they have to be kept.

llvm/llvm/test/tools/llvm-elfabi/binary-write-sheaders.test

60

It'd be great to get rid of .shstrtab and just use .strtab.

Newer llvm (since 2015) no longer produces .shstrtab as a size optimization.

llvm/test/tools/llvm-elfabi/write-elf32be-ehdr.test

6

Change x86_64 to powerpc, armv7a, etc to make big-endian more realistic.

llvm/tools/llvm-elfabi/ELFObjHandler.cpp

54

Other than having a mutable Blackhole, you can make Func = []() { llvm_unreachable(...); }; while evaluating the thunk.

87

Early return?

89

Value.emplace().

523

T* -> T *

583

What is this section used for?

599

Which architecture uses the section name .tls?

Did you mean .tbss?

[jakehehrlich]

I can't upload a new patch right now but I plan on making all recommended changes, even the ones I didn't reply to.

In D55864#1485695, @MaskRay wrote:

You may have put the rationale somewhere but they are not easily searchable. Please allow me to ask why there is a desire to write yet another ELF emitter. Can't we invest more in existing tools like yaml2obj? Is there any inherent limitation that prevents it from being more dynamic?

Good question. yaml2obj doesn't do the same thing and doesn't exist as a library. The point of this binary is to be as small as possible while maintaining linkability and compatibility with tools like llvm-readobj and other such tools. There is some talk of taking the code in llvm-objcopy, getting it up to where it could be used as a library, making a number of other tweaks, and then using that as a more general purpose emission library. That would also not do the same thing however. The trouble is that every ELF emitter has been designed with a specific purpose in mind and most were not designed as libraries. Furthermore when you consider what each use case has to compute and then specify independent of a general emission library it's not clear you really save much. You have the MC code, you have lld's code, you have llvm-objcopy, you have yaml2obj, etc... but they all have their quirks and specific use cases. the MC emiter has an interface that would be unweildy and imprecise here. llvm-objcopy doesn't help with setting these addresses, can't construct dynamic symbol tables in this way, and assumes that it has access to an input file from which its making modifications, doesn't support adding dynamic symbols yet, and generally makes it hard (on purpose) to tweak the memory image of a file. yaml2obj is really only designed to produce test files and is IMO not in a position to replace this tool. Recent work has given it program header support, dynamic symbol table support, and made it get in the way of specifying specific offsets and addresses when you know what you're doing but it still doesn't rise to the level of something we could use here. Even if it did rise to the level of something we could use here we would just wind up constructing its internal format using the same amount of code only to have it go and do the same basic thing.

Here's a claim. The ELFTypes library *is* the universal emitter already. Each of those tools are performing a particular computation that the others are not except perhaps yaml2obj which is really just working its way towards a low fidelity textual representation of ELF files. There are some commonly repeated things here between all of these libraries that could stand to abstracted out but its actually not the majority of the code in any of these tools or libraries. Until a serious proposal for a universal emitter comes up we keep rewriting those common parts. Still 90% of what's common is already solved by the ELFTypes library

llvm/llvm/test/tools/llvm-elfabi/binary-write-pheaders.test

18

Yep. Don't worry about the tests for now. I'll need to update them and they're going to change drastically.

llvm/llvm/test/tools/llvm-elfabi/binary-write-sheaders.test

60

That's actually what this patch does. These tests are inherited from the previous version of this patch and have not been modified to work yet. After I remove the changes planned part the tests will work. We'll actually need even more tests than what I have here to properly test this since the tests at hand only check a few sections and .dynamic contents.

llvm/tools/llvm-elfabi/ELFObjHandler.cpp

54

Good idea! I think that's actually what GHC does. I'll do that.

523

Yeah there are a bunch of formatting issues. I'll run clang-format on these when I upload next.

583

It's the section in which all defined non-TLS sections are defined. It's synthesized as a NOBITS section to avoid using any space.

599

.tbss would imply that this is writable when it isn't. In practice read-only data is already thread safe so there is no need for a read only TLS section. There is also in general no reason to have a read-only NOBITS section since the content is just zeros. This means there aren't good names to use for what I'm doing here. These section names don't matter functionally however. I'm open to many other names. I just went for short names where a name used in the wild didn't exist.

[jakehehrlich]

Ok we're getting closer

1. Formatted everything
2. Added suggestions
3. Program headers are now added
4. All tests now pass
5. In theory (but almost certainly not in reality) this should represent a minimal viable product with the exception of support for Alignment

What remains:

1. Add support for Alignment
2. Add tests for dynamic symbol table, def size, and tls size
3. Split up into more manageable chunks so that humans can review this. Any review now is still appreciated of course.

[MaskRay]

llvm/tools/llvm-elfabi/ELFObjHandler.cpp

599

In practice read-only data is already thread safe so there is no need for a read only TLS section.

So why do you need the non-writable .tss?

[jakehehrlich]

llvm/tools/llvm-elfabi/ELFObjHandler.cpp

599

I don't I don't really need it, but I want to minimize size and complexity. The requirements that I found (which might be minimal)

1. You must have a .dynamic section if you have a soname, or dt_needed. Right now this is added even if no soname or needed libraries exist.
2. To test with, inspect, and work with a file with a .dynamic section you need a PT_DYNAMIC segment
3. To have a PT_DYNAMIC segment you need a PT_LOAD which covers it. Permissions on either of these seem not to matter
4. If you have TLS symbols defined in your module you need a TLS section.
5. Using a TLS nobits saves space

I have not observed that a TLS segment is needed but I haven't really gotten to testing that out (I will remove it if it isn't needed). I'd like to have only one PT_LOAD that covers everything, not just the PT_DYNAMIC segment (though that is an option). That means .dynstr and .dynsym as well as .dynamic, the TLS section, and the other definition section. For aesthetic reasons I think the permissions on the PT_LOAD should match the permissions on the sections that it covers. Consequently all sections should have the same permissions if we want only one PT_LOAD. The TLS section is arguably not even covered by the PT_LOAD so it might be fair to give it different permissions and call it .tbss but this doesn't give us a proper name for the read only NOBITS section that critically *does* need to be covered by the PT_LOAD segment.

So its an issue of aesthetic tradeoffs (*cough* bikeshed *cough*) in the face of some other motivated issues (having one PT_LOAD and using SHT_NOBITS where possible). There are a few worlds I think exist that try their best to meet the aesthetics work out nicely.

1. Make the PT_LOAD writable and thus .dynsym and .dynstr as well (note that .dynamic is sometimes read only and sometimes writeable)
2. Make the PT_LOAD read only and have read-only NOBITS sections in both TLS and non-TLS varities (the current choice) but not have good names and the idea of these existing is otherwise senseless and thus no previous examples of these exist
3. Make the PT_LOAD read only, keep the non-TLS read-only NOBITS, but make the TLS section writeable so that we can call it ".tbss" in an aesthetically pleasing way.
4. Make the PT_LOAD read only, keep the sections read-only, and call them ".rodata" and ".tbss" anyhow even if those things each imply (by convention) a false fact about our sections. As an adendum we could choose slightly different names as well.

By choosing new names the aesthetic I violate is that I'm just making up section names (which happens a lot). I think anything else violates something I personally consider more fundamental like consistency, permissions consistency, using standard permissions for the standard sections we do have, etc... I think there's also an argument to be made that using differing section names makes these sorts of binaries easily recognizable.

[MaskRay]

Is llvm-elfabi used to create interface shared objects? Do you use it to create real(runnable) modules?

If not and if section/segment specification is not required, it can be very simple.
You just need the symbol table and very little other information.
There is one place in lld that checks if the symbol is in a readonly segment (addCopyRelSymbol).
1 PT_LOAD(RWX) + 1 PT_GNU_RELRO works just fine. You don't even need PT_TLS - STT_TLS symbols can be placed in an arbitrary section. Linkers and various binutils don't validate PT_TLS.

Using a TLS nobits saves space

The best layout I can think of is:
PT_LOAD(PT_GNU_RELRO(.data.rel.ro PT_TLS(.tdata | .tbss) .bss.rel.ro) | .data .bss)

Currently lld has (.tbss cannot really be SHT_NOBITS due to .data.rel.ro):
PT_LOAD(PT_GNU_RELRO(PT_TLS(.tdata .tbss) | .data.rel.ro .bss.rel.ro) | .data .bss)

There is much to say on this topic.

(note that .dynamic is sometimes read only and sometimes writeable)

Do you mean ld.lld -z rodynamic (D33251 http://lists.llvm.org/pipermail/llvm-dev/2017-May/113258.html)? (.dynamic is in the PT_GNU_RELRO region)

[jakehehrlich]

In D55864#1490016, @MaskRay wrote:

Is llvm-elfabi used to create interface shared objects? Do you use it to create real(runnable) modules?

If not and if section/segment specification is not required, it can be very simple.
You just need the symbol table and very little other information.
There is one place in lld that checks if the symbol is in a readonly segment (addCopyRelSymbol).
1 PT_LOAD(RWX) + 1 PT_GNU_RELRO works just fine. You don't even need PT_TLS - STT_TLS symbols can be placed in an arbitrary section. Linkers and various binutils don't validate PT_TLS.

Yes this is a stub reader/writer (also textual stubs which can't be linked against are a second format that has already been reviewed largely) but there are other concerns than just what works for lld, namely what works for llvm-readobj. I don't think its worth adding the PT_GNU_RELRO segment. What's the advantage? Also I'll get rid of the PT_TLS segment. The layout I have in the latest patch is

1 PT_LOAD (R)

.dynstr
.dynsym
1 PT_DYNAMIC (R)
  .dynamic 
.def
.tls

What the flags are don't really matter too much to me. I wasn't aware of the linker checking for a readonly segment but I think that favors just making everything read only. I'll think about removing the .tls section as well.

Using a TLS nobits saves space

The best layout I can think of is:
PT_LOAD(PT_GNU_RELRO(.data.rel.ro PT_TLS(.tdata | .tbss) .bss.rel.ro) | .data .bss)

What do you need the PT_GNU_RELRO for? What is .tdata or .tbss for? What is .data.rel.ro for?

Currently lld has (.tbss cannot really be SHT_NOBITS due to .data.rel.ro):
PT_LOAD(PT_GNU_RELRO(PT_TLS(.tdata .tbss) | .data.rel.ro .bss.rel.ro) | .data .bss)

I don't follow.

(note that .dynamic is sometimes read only and sometimes writeable)

Do you mean ld.lld -z rodynamic (D33251 http://lists.llvm.org/pipermail/llvm-dev/2017-May/113258.html)? (.dynamic is in the PT_GNU_RELRO region)

Yep that's what I mean. The .dynamic section is generally relro but can be read only if that flag is used. We shouldn't add a PT_GNU_RELRO just to be consistent with one particular way of doing things. .dynamic is relro because of DT_DEBUG which is not always used. If it isn't used it is possible to make it read only. What add an extra 50 or so bytes when we don't really need to?

[jakehehrlich]

Ok so I went digging on the PT_TLS and tls section issues. Seems like removing both the segment and the section is the right way to go.

llvm-readobj currently checks that SHT_TLS sections are in a PT_TLS so we should either have both or none. lld checks that TLS symbols are TLS consistently across the shared object and the output object so we have to use STT_TLS symbols for them (this is kind of obvious). I think lld (as you already stated) imposes no other requirements on this tool. Nothing seems to check that STT_TLS symbols are defined inside of of SHF_TLS sections so we should be good to go there.

[jakehehrlich]

@MuskRay Have you checked other linkers or tools?

[jakehehrlich]

1. No more TLS stuff but STT_TLS symbol types are preserved which appears to be sufficient for all known use cases
2. Fixed all the tests, accidental extra tests, minor issues, and made all tests pass.

I think this is ready for review but I'm not going to split it up until Monday.

[jakehehrlich]

The following is the first split. Subsequent splits will be much smaller (adding support for program headers, adding support for soname and needed, adding support for symbols, etc...): https://reviews.llvm.org/D61767#change-LCioCf1j7osU

llvm/include/llvm/TextAPI/ELF/ELFStub.h

enum class ELFSymbolType {
   // Type information is 4 bits, so 16 is safely out of range.
   Unknown = 16,
 };
 
 struct ELFSymbol {
   ELFSymbol(std::string SymbolName) : Name(SymbolName) {}
   std::string Name;
   uint64_t Size;
+  uint64_t Alignment;
   ELFSymbolType Type;
   bool Undefined;
   bool Weak;
   Optional<std::string> Warning;
   bool operator<(const ELFSymbol &RHS) const {
     return Name < RHS.Name;
   }
 };

llvm/llvm/test/tools/llvm-elfabi/binary-write-neededlibs.test

+# This test ensures .dynamic strings are added to .dynstr with suffix matching.
+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj --dynamic %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+SoName: libsomething.so
+Arch: x86_64
+NeededLibs:
+  - libc.so
+  - libclang.so
+  - thing.so
+Symbols: {}
+...
+
+# CHECK: STRSZ 37 (bytes)
+# CHECK: SONAME Library soname: [libsomething.so]
+# CHECK: NEEDED Shared library: [libc.so]
+# CHECK: NEEDED Shared library: [libclang.so]
+# CHECK: NEEDED Shared library: [thing.so]

llvm/llvm/test/tools/llvm-elfabi/binary-write-pheaders.test

+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj -h %t | FileCheck %s --check-prefix=ELFHEADER
+# RUN: llvm-readobj -l %t | FileCheck %s --check-prefix=PHDRS
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# ELFHEADER: ProgramHeaderCount: 2{{$}}
+
+# PHDRS:      ProgramHeader {
+# PHDRS-NEXT:   Type: PT_LOAD (0x1)
+# PHDRS-NEXT:   Offset: 0x0{{$}}
+# PHDRS-NEXT:   VirtualAddress: 0x0{{$}}
+# PHDRS-NEXT:   PhysicalAddress: 0x0{{$}}
+# PHDRS-NEXT:   FileSize: {{.*$}}
+# PHDRS-NEXT:   MemSize: {{.*$}}
+# PHDRS-NEXT:   Flags [ (0x5)
+# PHDRS-NEXT:     PF_R (0x4)
+# PHDRS-NEXT:     PF_X (0x1)
+# PHDRS-NEXT:   ]
+# PHDRS-NEXT:   Alignment: 4096{{$}}
+# PHDRS-NEXT: }
+# PHDRS-NEXT: ProgramHeader {
+# PHDRS-NEXT:   Type: PT_DYNAMIC (0x2)
+# PHDRS-NEXT:   Offset: {{.*$}}
+# PHDRS-NEXT:   VirtualAddress: {{.*$}}
+# PHDRS-NEXT:   PhysicalAddress: {{.*$}}
+# PHDRS-NEXT:   FileSize: 48{{$}}
+# PHDRS-NEXT:   MemSize: 48{{$}}
+# PHDRS-NEXT:   Flags [ (0x6)
+# PHDRS-NEXT:     PF_R (0x4)
+# PHDRS-NEXT:     PF_W (0x2)
+# PHDRS-NEXT:   ]
+# PHDRS-NEXT:   Alignment: 8{{$}}
+# PHDRS-NEXT: }

llvm/llvm/test/tools/llvm-elfabi/binary-write-sheaders.test

+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj -h %t | FileCheck %s --check-prefix=ELFHEADER
+# RUN: llvm-readobj -S %t | FileCheck %s --check-prefix=SECTIONS
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# ELFHEADER: SectionHeaderCount: 4{{$}}
+# ELFHEADER: StringTableSectionIndex: 3{{$}}
+
+# SECTIONS:      Section {
+# SECTIONS-NEXT:   Index: 0{{$}}
+# SECTIONS-NEXT:   Name:  (0)
+# SECTIONS-NEXT:   Type: SHT_NULL (0x0)
+# SECTIONS-NEXT:   Flags [ (0x0)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: 0x0{{$}}
+# SECTIONS-NEXT:   Offset: 0x0{{$}}
+# SECTIONS-NEXT:   Size: 4{{$}}
+# SECTIONS-NEXT:   Link: 3{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 0{{$}}
+# SECTIONS-NEXT:   EntrySize: 0{{$}}
+# SECTIONS-NEXT: }
+# SECTIONS-NEXT: Section {
+# SECTIONS-NEXT:   Index: 1{{$}}
+# SECTIONS-NEXT:   Name: .dynstr (1)
+# SECTIONS-NEXT:   Type: SHT_STRTAB (0x3)
+# SECTIONS-NEXT:   Flags [ (0x2)
+# SECTIONS-NEXT:     SHF_ALLOC (0x2)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: {{.*$}}
+# SECTIONS-NEXT:   Offset: {{.*$}}
+# SECTIONS-NEXT:   Size: 1{{$}}
+# SECTIONS-NEXT:   Link: 0{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 1{{$}}
+# SECTIONS-NEXT:   EntrySize: 0{{$}}
+# SECTIONS-NEXT: }
+# SECTIONS-NEXT: Section {
+# SECTIONS-NEXT:   Index: 2{{$}}
+# SECTIONS-NEXT:   Name: .dynamic (9)
+# SECTIONS-NEXT:   Type: SHT_DYNAMIC (0x6)
+# SECTIONS-NEXT:   Flags [ (0x2)
+# SECTIONS-NEXT:     SHF_ALLOC (0x2)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: {{.*$}}
+# SECTIONS-NEXT:   Offset: {{.*$}}
+# SECTIONS-NEXT:   Size: 48{{$}}
+# SECTIONS-NEXT:   Link: 1{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 8{{$}}
+# SECTIONS-NEXT:   EntrySize: 16{{$}}
+# SECTIONS-NEXT: }
+# SECTIONS-NEXT: Section {
+# SECTIONS-NEXT:   Index: 3{{$}}
+# SECTIONS-NEXT:   Name: .shstrtab (18)
+# SECTIONS-NEXT:   Type: SHT_STRTAB (0x3)
+# SECTIONS-NEXT:   Flags [ (0x0)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: 0x0{{$}}
+# SECTIONS-NEXT:   Offset: {{.*$}}
+# SECTIONS-NEXT:   Size: 28{{$}}
+# SECTIONS-NEXT:   Link: 0{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 1{{$}}
+# SECTIONS-NEXT:   EntrySize: 0{{$}}
+# SECTIONS-NEXT: }

llvm/llvm/test/tools/llvm-elfabi/binary-write-soname.test

+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj --dynamic %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+SoName: somelib.so
+Arch: x86_64
+Symbols: {}
+...
+
+# CHECK: STRSZ 12 (bytes)
+# CHECK: SONAME Library soname: [somelib.so]

llvm/test/tools/llvm-elfabi/binary-write-neededlibs.test

+# This test ensures .dynamic strings are added to .dynstr with suffix matching.
+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj --dynamic %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+SoName: libsomething.so
+Arch: x86_64
+NeededLibs:
+  - libc.so
+  - libclang.so
+  - thing.so
+Symbols: {}
+...
+
+# CHECK: STRSZ 37 (bytes)
+# CHECK: SONAME Library soname: [libsomething.so]
+# CHECK: NEEDED Shared library: [libc.so]
+# CHECK: NEEDED Shared library: [libclang.so]
+# CHECK: NEEDED Shared library: [thing.so]

llvm/test/tools/llvm-elfabi/binary-write-pheaders.test

+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj -h %t | FileCheck %s --check-prefix=ELFHEADER
+# RUN: llvm-readobj -l %t | FileCheck %s --check-prefix=PHDRS
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# ELFHEADER: ProgramHeaderCount: 2{{$}}
+
+# PHDRS:      ProgramHeader {
+# PHDRS-NEXT:   Type: PT_LOAD (0x1)
+# PHDRS-NEXT:   Offset: 0x0{{$}}
+# PHDRS-NEXT:   VirtualAddress: 0x0{{$}}
+# PHDRS-NEXT:   PhysicalAddress: 0x0{{$}}
+# PHDRS-NEXT:   FileSize: {{.*$}}
+# PHDRS-NEXT:   MemSize: {{.*$}}
+# PHDRS-NEXT:   Flags [ (0x5)
+# PHDRS-NEXT:     PF_R (0x4)
+# PHDRS-NEXT:     PF_X (0x1)
+# PHDRS-NEXT:   ]
+# PHDRS-NEXT:   Alignment: 4096{{$}}
+# PHDRS-NEXT: }
+# PHDRS-NEXT: ProgramHeader {
+# PHDRS-NEXT:   Type: PT_DYNAMIC (0x2)
+# PHDRS-NEXT:   Offset: {{.*$}}
+# PHDRS-NEXT:   VirtualAddress: {{.*$}}
+# PHDRS-NEXT:   PhysicalAddress: {{.*$}}
+# PHDRS-NEXT:   FileSize: 48{{$}}
+# PHDRS-NEXT:   MemSize: 48{{$}}
+# PHDRS-NEXT:   Flags [ (0x6)
+# PHDRS-NEXT:     PF_R (0x4)
+# PHDRS-NEXT:     PF_W (0x2)
+# PHDRS-NEXT:   ]
+# PHDRS-NEXT:   Alignment: 8{{$}}
+# PHDRS-NEXT: }

llvm/test/tools/llvm-elfabi/binary-write-sheaders.test

+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj -h %t | FileCheck %s --check-prefix=ELFHEADER
+# RUN: llvm-readobj -S %t | FileCheck %s --check-prefix=SECTIONS
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# ELFHEADER: SectionHeaderCount: 4{{$}}
+# ELFHEADER: StringTableSectionIndex: 3{{$}}
+
+# SECTIONS:      Section {
+# SECTIONS-NEXT:   Index: 0{{$}}
+# SECTIONS-NEXT:   Name:  (0)
+# SECTIONS-NEXT:   Type: SHT_NULL (0x0)
+# SECTIONS-NEXT:   Flags [ (0x0)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: 0x0{{$}}
+# SECTIONS-NEXT:   Offset: 0x0{{$}}
+# SECTIONS-NEXT:   Size: 4{{$}}
+# SECTIONS-NEXT:   Link: 3{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 0{{$}}
+# SECTIONS-NEXT:   EntrySize: 0{{$}}
+# SECTIONS-NEXT: }
+# SECTIONS-NEXT: Section {
+# SECTIONS-NEXT:   Index: 1{{$}}
+# SECTIONS-NEXT:   Name: .dynstr (1)
+# SECTIONS-NEXT:   Type: SHT_STRTAB (0x3)
+# SECTIONS-NEXT:   Flags [ (0x2)
+# SECTIONS-NEXT:     SHF_ALLOC (0x2)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: {{.*$}}
+# SECTIONS-NEXT:   Offset: {{.*$}}
+# SECTIONS-NEXT:   Size: 1{{$}}
+# SECTIONS-NEXT:   Link: 0{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 1{{$}}
+# SECTIONS-NEXT:   EntrySize: 0{{$}}
+# SECTIONS-NEXT: }
+# SECTIONS-NEXT: Section {
+# SECTIONS-NEXT:   Index: 2{{$}}
+# SECTIONS-NEXT:   Name: .dynamic (9)
+# SECTIONS-NEXT:   Type: SHT_DYNAMIC (0x6)
+# SECTIONS-NEXT:   Flags [ (0x2)
+# SECTIONS-NEXT:     SHF_ALLOC (0x2)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: {{.*$}}
+# SECTIONS-NEXT:   Offset: {{.*$}}
+# SECTIONS-NEXT:   Size: 48{{$}}
+# SECTIONS-NEXT:   Link: 1{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 8{{$}}
+# SECTIONS-NEXT:   EntrySize: 16{{$}}
+# SECTIONS-NEXT: }
+# SECTIONS-NEXT: Section {
+# SECTIONS-NEXT:   Index: 3{{$}}
+# SECTIONS-NEXT:   Name: .shstrtab (18)
+# SECTIONS-NEXT:   Type: SHT_STRTAB (0x3)
+# SECTIONS-NEXT:   Flags [ (0x0)
+# SECTIONS-NEXT:   ]
+# SECTIONS-NEXT:   Address: 0x0{{$}}
+# SECTIONS-NEXT:   Offset: {{.*$}}
+# SECTIONS-NEXT:   Size: 28{{$}}
+# SECTIONS-NEXT:   Link: 0{{$}}
+# SECTIONS-NEXT:   Info: 0{{$}}
+# SECTIONS-NEXT:   AddressAlignment: 1{{$}}
+# SECTIONS-NEXT:   EntrySize: 0{{$}}
+# SECTIONS-NEXT: }

llvm/test/tools/llvm-elfabi/binary-write-soname.test

+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj --dynamic %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+SoName: somelib.so
+Arch: x86_64
+Symbols: {}
+...
+
+# CHECK: STRSZ 12 (bytes)
+# CHECK: SONAME Library soname: [somelib.so]

llvm/test/tools/llvm-elfabi/invalid-bin-target.test

+# RUN: not llvm-elfabi %s --output-target=nope %t 2>&1 | FileCheck %s
+
+--- !tapi-tbe
+SoName: somelib.so
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# CHECK: llvm-elfabi: for the -output-target option: Cannot find option named 'nope'!

llvm/test/tools/llvm-elfabi/missing-bin-target.test

+# RUN: not llvm-elfabi %s %t 2>&1 | FileCheck %s
+
+--- !tapi-tbe
+SoName: somelib.so
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# CHECK: No binary output target specified.

llvm/test/tools/llvm-elfabi/write-elf32be-ehdr.test

+# RUN: llvm-elfabi %s --output-target=elf32-big %t
+# RUN: llvm-readobj --file-headers %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# CHECK:      ElfHeader {
+# CHECK-NEXT:   Ident {
+# CHECK-NEXT:     Magic: (7F 45 4C 46)
+# CHECK-NEXT:     Class: 32-bit (0x1)
+# CHECK-NEXT:     DataEncoding: BigEndian (0x2)
+# CHECK-NEXT:     FileVersion: 1{{$}}
+# CHECK-NEXT:     OS/ABI: SystemV (0x0)
+# CHECK-NEXT:     ABIVersion: 0{{$}}
+# CHECK-NEXT:     Unused: (00 00 00 00 00 00 00)
+# CHECK-NEXT:   }
+# CHECK-NEXT:   Type: SharedObject (0x3)
+# CHECK-NEXT:   Machine: EM_X86_64 (0x3E)
+# CHECK-NEXT:   Version: 1{{$}}
+# CHECK-NEXT:   Entry: 0x0{{$}}
+# CHECK:        Flags [ (0x0)
+# CHECK-NEXT:   ]
+# CHECK-NEXT:   HeaderSize: 52{{$}}
+# CHECK-NEXT:   ProgramHeaderEntrySize: 32{{$}}
+# CHECK:        SectionHeaderEntrySize: 40{{$}}

llvm/test/tools/llvm-elfabi/write-elf32le-ehdr.test

+# RUN: llvm-elfabi %s --output-target=elf32-little %t
+# RUN: llvm-readobj --file-headers %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# CHECK:      ElfHeader {
+# CHECK-NEXT:   Ident {
+# CHECK-NEXT:     Magic: (7F 45 4C 46)
+# CHECK-NEXT:     Class: 32-bit (0x1)
+# CHECK-NEXT:     DataEncoding: LittleEndian (0x1)
+# CHECK-NEXT:     FileVersion: 1{{$}}
+# CHECK-NEXT:     OS/ABI: SystemV (0x0)
+# CHECK-NEXT:     ABIVersion: 0{{$}}
+# CHECK-NEXT:     Unused: (00 00 00 00 00 00 00)
+# CHECK-NEXT:   }
+# CHECK-NEXT:   Type: SharedObject (0x3)
+# CHECK-NEXT:   Machine: EM_X86_64 (0x3E)
+# CHECK-NEXT:   Version: 1{{$}}
+# CHECK-NEXT:   Entry: 0x0{{$}}
+# CHECK:        Flags [ (0x0)
+# CHECK-NEXT:   ]
+# CHECK-NEXT:   HeaderSize: 52{{$}}
+# CHECK-NEXT:   ProgramHeaderEntrySize: 32{{$}}
+# CHECK:        SectionHeaderEntrySize: 40{{$}}

llvm/test/tools/llvm-elfabi/write-elf64be-ehdr.test

+# RUN: llvm-elfabi %s --output-target=elf64-big %t
+# RUN: llvm-readobj --file-headers %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: x86_64
+Symbols: {}
+...
+
+# CHECK:      ElfHeader {
+# CHECK-NEXT:   Ident {
+# CHECK-NEXT:     Magic: (7F 45 4C 46)
+# CHECK-NEXT:     Class: 64-bit (0x2)
+# CHECK-NEXT:     DataEncoding: BigEndian (0x2)
+# CHECK-NEXT:     FileVersion: 1{{$}}
+# CHECK-NEXT:     OS/ABI: SystemV (0x0)
+# CHECK-NEXT:     ABIVersion: 0{{$}}
+# CHECK-NEXT:     Unused: (00 00 00 00 00 00 00)
+# CHECK-NEXT:   }
+# CHECK-NEXT:   Type: SharedObject (0x3)
+# CHECK-NEXT:   Machine: EM_X86_64 (0x3E)
+# CHECK-NEXT:   Version: 1{{$}}
+# CHECK-NEXT:   Entry: 0x0{{$}}
+# CHECK:        Flags [ (0x0)
+# CHECK-NEXT:   ]
+# CHECK-NEXT:   HeaderSize: 64{{$}}
+# CHECK-NEXT:   ProgramHeaderEntrySize: 56{{$}}
+# CHECK:        SectionHeaderEntrySize: 64{{$}}

llvm/test/tools/llvm-elfabi/write-elf64le-ehdr.test

+# RUN: llvm-elfabi %s --output-target=elf64-little %t
+# RUN: llvm-readobj --file-headers %t | FileCheck %s
+
+--- !tapi-tbe
+TbeVersion: 1.0
+Arch: AArch64
+Symbols: {}
+...
+
+# CHECK:      ElfHeader {
+# CHECK-NEXT:   Ident {
+# CHECK-NEXT:     Magic: (7F 45 4C 46)
+# CHECK-NEXT:     Class: 64-bit (0x2)
+# CHECK-NEXT:     DataEncoding: LittleEndian (0x1)
+# CHECK-NEXT:     FileVersion: 1{{$}}
+# CHECK-NEXT:     OS/ABI: SystemV (0x0)
+# CHECK-NEXT:     ABIVersion: 0{{$}}
+# CHECK-NEXT:     Unused: (00 00 00 00 00 00 00)
+# CHECK-NEXT:   }
+# CHECK-NEXT:   Type: SharedObject (0x3)
+# CHECK-NEXT:   Machine: EM_AARCH64 (0xB7)
+# CHECK-NEXT:   Version: 1{{$}}
+# CHECK-NEXT:   Entry: 0x0{{$}}
+# CHECK:        Flags [ (0x0)
+# CHECK-NEXT:   ]
+# CHECK-NEXT:   HeaderSize: 64{{$}}
+# CHECK-NEXT:   ProgramHeaderEntrySize: 56{{$}}
+# CHECK:        SectionHeaderEntrySize: 64{{$}}

llvm/tools/llvm-elfabi/ELFObjHandler.h

 #include "llvm/TextAPI/ELF/ELFStub.h"
 
 namespace llvm {
 
 class MemoryBuffer;
 
 namespace elfabi {
 
+enum class ELFTarget {
+  ELF32LE,
+  ELF32BE,
+  ELF64LE,
+  ELF64BE
+};
+
 /// Attempt to read a binary ELF file from a MemoryBuffer.
 Expected<std::unique_ptr<ELFStub>> readELFFile(MemoryBufferRef Buf);
 
+/// Attempt to write a binary ELF stub.
+/// This function determines appropriate ELFType using the passed ELFTarget and
+/// then writes a binary ELF stub to a specified file path.
+///
+/// @param FilePath File path for writing the ELF binary.
+/// @param Stub Source ELFStub to generate a binary ELF stub from.
+/// @param OutputFormat Target ELFType to write binary as.
+Error writeBinaryStub(StringRef FilePath, const ELFStub &Stub,
+                      ELFTarget OutputFormat);
+
 } // end namespace elfabi
 } // end namespace llvm
 
 #endif // LLVM_TOOLS_ELFABI_ELFOBJHANDLER_H

llvm/tools/llvm-elfabi/ELFObjHandler.cpp

 //===- ELFObjHandler.cpp --------------------------------------------------===//
 //
 // Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
 // See https://llvm.org/LICENSE.txt for license information.
 // SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
 //
 //===-----------------------------------------------------------------------===/
 
 #include "ELFObjHandler.h"
+#include "llvm/Support/MathExtras.h"
+#include "llvm/MC/StringTableBuilder.h"
 #include "llvm/Object/Binary.h"
 #include "llvm/Object/ELFObjectFile.h"
 #include "llvm/Object/ELFTypes.h"
 #include "llvm/Support/Errc.h"
 #include "llvm/Support/Error.h"
+#include "llvm/Support/FileOutputBuffer.h"
 #include "llvm/Support/MemoryBuffer.h"
 #include "llvm/TextAPI/ELF/ELFStub.h"
 
+#include <functional>
+
 using llvm::MemoryBufferRef;
 using llvm::object::ELFObjectFile;
 
 using namespace llvm;
 using namespace llvm::object;
 using namespace llvm::ELF;
 
-namespace llvm {
-namespace elfabi {
+namespace {
+
+using namespace llvm::elfabi;
 
 // Simple struct to hold relevant .dynamic entries.
 struct DynamicEntries {
   uint64_t StrTabAddr = 0;
   uint64_t StrSize = 0;
   Optional<uint64_t> SONameOffset;
   std::vector<uint64_t> NeededLibNames;
   // Symbol table:
   uint64_t DynSymAddr = 0;
   // Hash tables:
   Optional<uint64_t> ElfHash;
   Optional<uint64_t> GnuHash;
 };
 
+// Lazy assumes that T is default constructable.
+// Lazy also acts like a read-only, move-only type.
+template <class T>
+class Lazy {
+private:
+  std::function<void(T&)> Func;
+  mutable Optional<T> Value;
+  mutable bool Blackhole = false;
+
+public:
+  Lazy(const Lazy&) = delete;
+  Lazy(Lazy&&) = default;
+  // Allow Lazy values to be default constructed to an empty state.
+  Lazy() = default;
+  explicit Lazy(std::function<void(T&)>&& F) : Func(std::move(F)) {}
+  
+  Lazy& operator=(std::function<void(T&)>&& F) {
+    // Once a thunk has been assigned don't allow it to change.
+    assert(!Value && !Func);
+    Func = F;
+    return *this;
+  }
+  Lazy& operator=(T&& Val) {
+    assert(!Value && !Func);
+    Value = std::move(Val);
+    return *this;
+  }
+  Lazy& operator=(const T& Val) {
+    assert(!Value && !Func);
+    Value = Val;
+    return *this;
+  }
+
+  const T &operator*() const {
+    // Assert that a value has been assigned, lazy or otherwise.
+    assert(Value || Func);
+    if (Blackhole)
+      llvm_unreachable("cycle detected");
+    if (Value)
+      return *Value;
+    else {
+      Blackhole = true;
+      Value = T();
+      Func(*Value);
+      Blackhole = false;
+      return *Value;
+    }
+  }
+  const T *operator->() const {
+    return &**this;
+  }
+};
+
+template <class T>
+Lazy<T> makeLazy(std::function<void(T&)>&& F) {
+  return Lazy<T>{std::move(F)};
+}
+
 /// This function behaves similarly to StringRef::substr(), but attempts to
 /// terminate the returned StringRef at the first null terminator. If no null
 /// terminator is found, an error is returned.
 ///
 /// @param Str Source string to create a substring from.
 /// @param Offset The start index of the desired substring.
-static Expected<StringRef> terminatedSubstr(StringRef Str, size_t Offset) {
+Expected<StringRef> terminatedSubstr(StringRef Str, size_t Offset) {
   size_t StrEnd = Str.find('\0', Offset);
   if (StrEnd == StringLiteral::npos) {
     return createError(
         "String overran bounds of string table (no null terminator)");
   }
 
   size_t StrLen = StrEnd - Offset;
   return Str.substr(Offset, StrLen);

 
 /// This function populates a DynamicEntries struct using an ELFT::DynRange.
 /// After populating the struct, the members are validated with
 /// some basic sanity checks.
 ///
 /// @param Dyn Target DynamicEntries struct to populate.
 /// @param DynTable Source dynamic table.
 template <class ELFT>
-static Error populateDynamic(DynamicEntries &Dyn,
+Error populateDynamic(DynamicEntries &Dyn,
                              typename ELFT::DynRange DynTable) {
   if (DynTable.empty())
     return createError("No .dynamic section found");
 
   // Search .dynamic for relevant entries.
   bool FoundDynStr = false;
   bool FoundDynStrSz = false;
   bool FoundDynSym = false;
Error populateDynamic(DynamicEntries &Dyn,
 
   return Error::success();
 }
 
 /// This function finds the number of dynamic symbols using a GNU hash table.
 ///
 /// @param Table The GNU hash table for .dynsym.
 template <class ELFT>
-static uint64_t getDynSymtabSize(const typename ELFT::GnuHash &Table) {
+uint64_t getDynSymtabSize(const typename ELFT::GnuHash &Table) {
   using Elf_Word = typename ELFT::Word;
   if (Table.nbuckets == 0)
     return Table.symndx + 1;
   uint64_t LastSymIdx = 0;
   uint64_t BucketVal = 0;
   // Find the index of the first symbol in the last chain.
   for (Elf_Word Val : Table.buckets()) {
     BucketVal = std::max(BucketVal, (uint64_t)Val);

 
 /// This function determines the number of dynamic symbols.
 /// Without access to section headers, the number of symbols must be determined
 /// by parsing dynamic hash tables.
 ///
 /// @param Dyn Entries with the locations of hash tables.
 /// @param ElfFile The ElfFile that the section contents reside in.
 template <class ELFT>
-static Expected<uint64_t> getNumSyms(DynamicEntries &Dyn,
+Expected<uint64_t> getNumSyms(DynamicEntries &Dyn,
                                      const ELFFile<ELFT> &ElfFile) {
   using Elf_Hash = typename ELFT::Hash;
   using Elf_GnuHash = typename ELFT::GnuHash;
   // Search GNU hash table to try to find the upper bound of dynsym.
   if (Dyn.GnuHash.hasValue()) {
     Expected<const uint8_t *> TablePtr = ElfFile.toMappedAddr(*Dyn.GnuHash);
     if (!TablePtr)
       return TablePtr.takeError();

 }
 
 /// This function extracts symbol type from a symbol's st_info member and
 /// maps it to an ELFSymbolType enum.
 /// Currently, STT_NOTYPE, STT_OBJECT, STT_FUNC, and STT_TLS are supported.
 /// Other symbol types are mapped to ELFSymbolType::Unknown.
 ///
 /// @param Info Binary symbol st_info to extract symbol type from.
-static ELFSymbolType convertInfoToType(uint8_t Info) {
+ELFSymbolType convertInfoToType(uint8_t Info) {
   Info = Info & 0xf;
   switch (Info) {
     case ELF::STT_NOTYPE:
       return ELFSymbolType::NoType;
     case ELF::STT_OBJECT:
       return ELFSymbolType::Object;
     case ELF::STT_FUNC:
       return ELFSymbolType::Func;
     case ELF::STT_TLS:
       return ELFSymbolType::TLS;
     default:
       return ELFSymbolType::Unknown;
   }
 }
 
 /// This function creates an ELFSymbol and populates all members using
 /// information from a binary ELFT::Sym.
 ///
 /// @param SymName The desired name of the ELFSymbol.
 /// @param RawSym ELFT::Sym to extract symbol information from.
 template <class ELFT>
-static ELFSymbol createELFSym(StringRef SymName,
+ELFSymbol createELFSym(StringRef SymName,
                               const typename ELFT::Sym &RawSym) {
   ELFSymbol TargetSym(SymName);
   uint8_t Binding = RawSym.getBinding();
   if (Binding == STB_WEAK)
     TargetSym.Weak = true;
   else
     TargetSym.Weak = false;
 

 
 /// This function populates an ELFStub with symbols using information read
 /// from an ELF binary.
 ///
 /// @param TargetStub ELFStub to add symbols to.
 /// @param DynSym Range of dynamic symbols to add to TargetStub.
 /// @param DynStr StringRef to the dynamic string table.
 template <class ELFT>
-static Error populateSymbols(ELFStub &TargetStub,
+Error populateSymbols(ELFStub &TargetStub,
                             const typename ELFT::SymRange DynSym,
                             StringRef DynStr) {
   // Skips the first symbol since it's the NULL symbol.
   for (auto RawSym : DynSym.drop_front(1)) {
     // If a symbol does not have global or weak binding, ignore it.
     uint8_t Binding = RawSym.getBinding();
     if (!(Binding == STB_GLOBAL || Binding == STB_WEAK))
       continue;
for (auto RawSym : DynSym.drop_front(1)) {
     // TODO: Populate symbol warning.
   }
   return Error::success();
 }
 
 /// Returns a new ELFStub with all members populated from an ELFObjectFile.
 /// @param ElfObj Source ELFObjectFile.
 template <class ELFT>
-static Expected<std::unique_ptr<ELFStub>>
+Expected<std::unique_ptr<ELFStub>>
 buildStub(const ELFObjectFile<ELFT> &ElfObj) {
   using Elf_Dyn_Range = typename ELFT::DynRange;
   using Elf_Phdr_Range = typename ELFT::PhdrRange;
   using Elf_Sym_Range = typename ELFT::SymRange;
   using Elf_Sym = typename ELFT::Sym;
   std::unique_ptr<ELFStub> DestStub = make_unique<ELFStub>();
   const ELFFile<ELFT> *ElfFile = ElfObj.getELFFile();
   // Fetch .dynamic table.
if (*SymCount > 0) {
     if (SymReadError)
       return appendToError(std::move(SymReadError),
                            "when reading dynamic symbols");
   }
 
   return std::move(DestStub);
 }
 
+/// This initializes an ELF file header with information specific to a binary
+/// dynamic shared object.
+/// Offsets, indexes, links, etc. for section and program headers are just
+/// zero-initialized as they will be updated elsewhere.
+///
+/// @param ElfHeader Target ELFT::Ehdr to populate.
+/// @param Machine Target architecture (e_machine from ELF specifications).
+template <class ELFT>
+void initELFHeader(typename ELFT::Ehdr &ElfHeader, uint16_t Machine) {
+  using Elf_Ehdr = typename ELFT::Ehdr;
+  using Elf_Shdr = typename ELFT::Shdr;
+
+  memset(&ElfHeader, 0, sizeof(Elf_Ehdr));
+  // ELF identification.
+  ElfHeader.e_ident[EI_MAG0] = 0x7f; // ELFMAG0
+  ElfHeader.e_ident[EI_MAG1] = 'E';  // ELFMAG1
+  ElfHeader.e_ident[EI_MAG2] = 'L';  // ELFMAG2
+  ElfHeader.e_ident[EI_MAG3] = 'F';  // ELFMAG3
+  ElfHeader.e_ident[EI_CLASS] = ELFT::Is64Bits ? ELFCLASS64 : ELFCLASS32;
+  bool IsLittleEndian = ELFT::TargetEndianness == support::little;
+  ElfHeader.e_ident[EI_DATA] = IsLittleEndian ? ELFDATA2LSB : ELFDATA2MSB;
+  ElfHeader.e_ident[EI_VERSION] = EV_CURRENT;
+  ElfHeader.e_ident[EI_OSABI] = ELFOSABI_NONE;
+  ElfHeader.e_ident[EI_ABIVERSION] = 0;
+
+  // Remainder of ELF header.
+  ElfHeader.e_type = ET_DYN;
+  ElfHeader.e_machine = Machine;
+  ElfHeader.e_version = EV_CURRENT;
+  ElfHeader.e_entry = 0;
+  ElfHeader.e_flags = 0;
+  ElfHeader.e_ehsize = sizeof(Elf_Ehdr);
+  ElfHeader.e_phentsize = 0;
+  ElfHeader.e_shentsize = sizeof(Elf_Shdr);
+}
+
+template <class ELFT>
+struct OutputSection {
+  using Elf_Shdr = typename ELFT::Shdr;
+  std::string Name;
+  Lazy<Elf_Shdr> Shdr;
+  Lazy<uint64_t> Addr;
+  Lazy<uint64_t> Offset;
+  Lazy<uint64_t> Size;
+  Lazy<uint64_t> Align;
+  uint32_t Index;
+};
+
+template <class T, class ELFT>
+struct ContentSection : public OutputSection<ELFT> {
+  Lazy<T> Content;
+};
+
+class ELFStringTableBuilder : public StringTableBuilder {
+public:
+  ELFStringTableBuilder() : StringTableBuilder(StringTableBuilder::ELF) {}
+};
+
+template <class ELFT>
+struct SymbolInformation {
+  using Elf_Sym = typename ELFT::Sym;
+  std::vector<Elf_Sym> Symbols;
+  uint64_t MaxAlign = 0;
+  uint64_t MaxAddr = 0;
+  uint64_t MaxTLSAlign = 0;
+  uint64_t MaxTLSAddr = 0;
+};
+
+template <class ELFT>
+class ELFBuilder {
+public:
+  using Elf_Ehdr = typename ELFT::Ehdr;
+  using Elf_Shdr = typename ELFT::Shdr;
+  using Elf_Phdr = typename ELFT::Phdr;
+  using Elf_Sym = typename ELFT::Sym;
+  using Elf_Addr = typename ELFT::Addr;
+  using Elf_Dyn = typename ELFT::Dyn;
+
+private:
+  Lazy<Elf_Ehdr> ElfHeader;
+  ContentSection<ELFStringTableBuilder, ELFT> StrTab;
+  ContentSection<SymbolInformation<ELFT>, ELFT> DynSym;
+  OutputSection<ELFT> DefSec;
+  OutputSection<ELFT> TlsSec; 
+  ContentSection<std::vector<Elf_Dyn>, ELFT> Dynamic;
+  Lazy<std::vector<Elf_Phdr>> ProgramHeaders;
+
+  template <class T>
+  static void Write(uint8_t *Data, const T& Value) {
+    *reinterpret_cast<T*>(Data) = Value;
+  }
+  template <class T>
+  static void WriteVector(uint8_t *Data, const std::vector<T>& Vec) {
+    std::copy(Vec.begin(), Vec.end(), reinterpret_cast<T*>(Data));
+  }
+  uint64_t ShdrOffset(const OutputSection<ELFT>& Sec) const {
+    return ElfHeader->e_shoff + Sec.Index * sizeof(Elf_Shdr);
+  }
+  void WriteShdr(uint8_t *Data, const OutputSection<ELFT>& Sec) const {
+    Write(Data + ShdrOffset(Sec), *Sec.Shdr);
+  }
+public:
+  ELFBuilder(const ELFBuilder&) = delete;
+  ELFBuilder(ELFBuilder&&) = default;
+  explicit ELFBuilder(const ELFStub& Stub) {
+    // New sections can be added here
+    std::vector<OutputSection<ELFT>*> Sections;
+    Sections.push_back(&StrTab);
+    Sections.push_back(&DynSym);
+    Sections.push_back(&Dynamic);
+
+    // Manually set the indexes of these.
+    uint64_t Index = 1;
+    const OutputSection<ELFT> *Prev = nullptr;
+    DefSec.Index = Index++;
+    TlsSec.Index = Index++;
+    // Now set the Index, Offset, and Addr of everything.
+    for (auto Sec : Sections) {
+      Sec->Index = Index++;
+      Sec->Offset = [Sec, Prev](uint64_t &Offset) {
+        uint64_t Align = *Sec->Align ? *Sec->Align : 1;
+        if (!Prev)
+          Offset = alignTo(sizeof(Elf_Ehdr), Align);
+        else
+          Offset = alignTo(*Prev->Offset + *Prev->Size, Align);
+      };
+      if (Prev == nullptr)
+        Prev = &DefSec;
+      Sec->Addr = [Sec, Prev](uint64_t &Addr) {
+        uint64_t Align = *Sec->Align ? *Sec->Align : 1;
+        Addr = alignTo(*Prev->Addr + *Prev->Size, Align);
+      };
+      Prev = Sec;
+    }
+    // We manually set the addresses and offsets of these.
+    DefSec.Addr = 0x0;
+    TlsSec.Addr = 0x0;
+    DefSec.Offset = 0x0;
+    TlsSec.Offset = 0x0;
+
+    // Prev is now the last section so we can define the ELF header.
+    ElfHeader = [this, &Stub, Prev](Elf_Ehdr& Ehdr) {
+      initELFHeader<ELFT>(Ehdr, Stub.Arch);
+      Ehdr.e_shstrndx = StrTab.Index;
+      Ehdr.e_shoff = alignTo(*Prev->Offset + *Prev->Size, sizeof(Elf_Addr));
+      Ehdr.e_shnum = 6;
+    };
+
+    // Define the non-TLS section.
+    DefSec.Name = ".def";
+    DefSec.Shdr = [this](Elf_Shdr& Shdr) {
+      Shdr.sh_name = StrTab.Content->getOffset(DefSec.Name);
+      Shdr.sh_type = SHT_NOBITS;
+      Shdr.sh_flags = SHF_ALLOC;
+      Shdr.sh_size = *DefSec.Size;
+      Shdr.sh_addralign = *DefSec.Align;
+    };
+    DefSec.Size = [this](uint64_t &Size) {
+      Size = DynSym.Content->MaxAddr;
+    };
+    DefSec.Align = [this](uint64_t &Align) {
+      Align = DynSym.Content->MaxAlign;
+    };
+
+    // Define the TLS section.
+    TlsSec.Name = ".tls";
+    TlsSec.Shdr = [this](Elf_Shdr& Shdr) {
+      Shdr.sh_name = StrTab.Content->getOffset(TlsSec.Name);
+      Shdr.sh_type = SHT_NOBITS;
+      Shdr.sh_flags = SHF_ALLOC; 
+      Shdr.sh_size = *TlsSec.Size;
+      Shdr.sh_addralign = *TlsSec.Align;
+    };
+    TlsSec.Size = [this](uint64_t &Size) {
+      Size = DynSym.Content->MaxTLSAddr;
+    };
+    TlsSec.Align = [this](uint64_t &Align) {
+      Align = DynSym.Content->MaxTLSAlign;
+    };
+
+    // Define the string table.
+    StrTab.Name = ".dynstr";
+    StrTab.Shdr = [this](Elf_Shdr& Shdr) {
+      Shdr.sh_name = StrTab.Content->getOffset(StrTab.Name);
+      Shdr.sh_type = SHT_STRTAB;
+      Shdr.sh_flags = SHF_ALLOC;
+      Shdr.sh_size = *StrTab.Size;
+      Shdr.sh_addr = *StrTab.Addr;
+      Shdr.sh_offset = *StrTab.Offset;
+    };
+    StrTab.Size = [this](uint64_t &Size) {
+      Size = StrTab.Content->getSize();
+    };
+    StrTab.Align = 0;
+    StrTab.Content = [this, &Stub](ELFStringTableBuilder& Builder) {
+      Builder.add(StrTab.Name);
+      Builder.add(DynSym.Name);
+      Builder.add(DefSec.Name);
+      Builder.add(TlsSec.Name);
+      Builder.add(Dynamic.Name);
+      for (const auto& Sym : Stub.Symbols)
+        Builder.add(Sym.Name);
+      if (Stub.SoName)
+        Builder.add(*Stub.SoName);
+      for (const auto& Needed : Stub.NeededLibs)
+        Builder.add(Needed);
+      Builder.finalize();
+    };
+
+    // Define the symbol table.
+    DynSym.Name = ".dynsym";
+    DynSym.Shdr = [this](Elf_Shdr& Shdr) {
+      Shdr.sh_name = StrTab.Content->getOffset(DynSym.Name);
+      Shdr.sh_type = SHT_DYNSYM;
+      Shdr.sh_flags = SHF_ALLOC;
+      Shdr.sh_size = *DynSym.Size;
+      Shdr.sh_addralign = sizeof(Elf_Addr);
+      Shdr.sh_addr = *DynSym.Addr; 
+      Shdr.sh_offset = *DynSym.Offset;
+      Shdr.sh_link = StrTab.Index;
+      Shdr.sh_entsize = sizeof(Elf_Sym); 
+    };
+    DynSym.Align = sizeof(Elf_Addr);
+    DynSym.Size = Stub.Symbols.size() * sizeof(Elf_Sym);
+    DynSym.Content = [this, &Stub](SymbolInformation<ELFT>& SymbolInfo) {
+      // Process each symbol. We'll set the name index in a second loop.
+      // We treat TLS symbols like they're in a different address space.
+      // We will adjust the addresses later by adding a bias in the second loop.
+      uint64_t Addr = 0x0;
+      uint64_t MaxAlign = 0x0;
+      uint64_t TLSAddr = 0x0;
+      uint64_t MaxTLSAlign = 0x0;
+      // TODO: Explore not allocating Symbols and instead writing directly
+      // into the output buffer. The challenge here is computing MaxAddr
+      // and friends. It seems like we'd still need this loop.
+      for (const auto &Symbol : Stub.Symbols) {
+        SymbolInfo.Symbols.emplace_back();
+        Elf_Sym& ElfSym = SymbolInfo.Symbols.back();
+        ElfSym.st_name = StrTab.Content->getOffset(Symbol.Name);
+        if (!Symbol.Undefined) {
+          switch (Symbol.Type) {
+          case ELFSymbolType::Func:
+            ElfSym.st_shndx = DefSec.Index;
+            ElfSym.st_value = Addr++;
+            break;
+          case ELFSymbolType::Object:
+            ElfSym.st_shndx = DefSec.Index;
+            // TODO: When bumping to alignment ensure that we hit exactly the
+            // minimum alignment. This ensures that copy relocations will have
+            // exactly the alignment they need rather than anything larger.
+            Addr = alignTo(Addr, Symbol.Alignment ? Symbol.Alignment : 1); 
+            ElfSym.st_value = Addr;
+            Addr += Symbol.Size;
+            ElfSym.st_size = Symbol.Size;
+            MaxAlign = std::max(Symbol.Alignment, MaxAlign);
+            break;
+          case ELFSymbolType::TLS:
+            ElfSym.st_shndx = TlsSec.Index;
+            // This doesn't really matter but it feels nice and doesn't cost us
+            // anything. Alignment defaults to zero when absent and it will
+            // have no effect.
+            TLSAddr = alignTo(TLSAddr, Symbol.Alignment ? Symbol.Alignment : 1); 
+            ElfSym.st_value = TLSAddr;
+            TLSAddr += Symbol.Size;
+            ElfSym.st_size = Symbol.Size;
+            MaxTLSAlign = std::max(Symbol.Alignment, MaxTLSAlign);
+            break;
+          default:
+            break;
+          }
+        }
+        ElfSym.setType(static_cast<unsigned char>(Symbol.Type));
+        if (Symbol.Weak)
+          ElfSym.setBinding(STB_WEAK);
+        else
+          ElfSym.setBinding(STB_GLOBAL);
+      }
+      SymbolInfo.MaxAddr = Addr;
+      SymbolInfo.MaxAlign = MaxAlign;
+      SymbolInfo.MaxTLSAddr = TLSAddr;
+      SymbolInfo.MaxTLSAlign = MaxTLSAlign;
+    };
+
+    // Construct the .dynamic table.
+    Dynamic.Name = ".dynamic";
+    Dynamic.Shdr = [this](Elf_Shdr& Shdr) {
+      Shdr.sh_name = StrTab.Content->getOffset(Dynamic.Name);
+      Shdr.sh_type = SHT_DYNAMIC;
+      Shdr.sh_flags = SHF_ALLOC;
+      Shdr.sh_addr = *Dynamic.Addr; 
+      Shdr.sh_offset = *Dynamic.Offset; 
+      Shdr.sh_size = *Dynamic.Size;
+      Shdr.sh_link = StrTab.Index;
+      Shdr.sh_addralign = sizeof(Elf_Addr);
+      Shdr.sh_entsize = sizeof(Elf_Dyn);
+    };
+    Dynamic.Align = sizeof(Elf_Addr);
+    Dynamic.Size = [this](uint64_t &Size) {
+      // TODO: This can be calculated without knowing the Content.
+      Size = Dynamic.Content->size() * sizeof(Elf_Dyn);
+    };
+    Dynamic.Content = [this, &Stub](std::vector<Elf_Dyn>& Entries) {
+      auto Add = [&Entries](uint16_t Tag) -> Elf_Dyn& {
+        Entries.emplace_back();
+        Elf_Dyn& Dyn = Entries.back();
+        Dyn.d_tag = Tag;
+        return Dyn;
+      };
+      if (Stub.SoName)
+        Add(DT_SONAME).d_un.d_val = StrTab.Content->getOffset(*Stub.SoName);
+      for (const auto& Needed : Stub.NeededLibs)
+        Add(DT_NEEDED).d_un.d_val = StrTab.Content->getOffset(Needed);
+      Add(DT_STRTAB).d_un.d_ptr = *StrTab.Addr;
+      Add(DT_STRSZ).d_un.d_ptr = *StrTab.Size;
+      Add(DT_SYMTAB).d_un.d_ptr = *DynSym.Addr;
+      Add(DT_SYMENT).d_un.d_ptr = sizeof(Elf_Sym);
+      Add(DT_NULL);
+    };
+  }
+
+  // GetSize will effectivelly compute the whole layout.
+  size_t GetSize() const {
+    return ElfHeader->e_shoff + ElfHeader->e_shnum * sizeof(Elf_Shdr);
+  }
+
+  void Write(uint8_t *Data) const {
+    Write(Data, *ElfHeader);
+    StrTab.Content->write(Data + StrTab.Shdr->sh_offset);
+    // TODO: It would be preety cool if we didn't need DynSym.Content->Symbols
+    // and could just write into the Data directly.
+    WriteVector(Data + DynSym.Shdr->sh_offset, DynSym.Content->Symbols);
+    WriteVector(Data + Dynamic.Shdr->sh_offset, *Dynamic.Content);
+    WriteShdr(Data, StrTab);
+    WriteShdr(Data, DynSym);
+    WriteShdr(Data, DefSec);
+    WriteShdr(Data, TlsSec);
+    WriteShdr(Data, Dynamic);
+  }
+};
+
+/// This function opens a file for writing and then writes a binary ELF stub to
+/// the file.
+///
+/// @param FilePath File path for writing the ELF binary.
+/// @param Stub Source ELFStub to generate a binary ELF stub from.
+template <class ELFT>
+Error writeELFBinaryToFile(StringRef FilePath, const ELFStub &Stub) {
+  ELFBuilder<ELFT> Builder{Stub};
+  Expected<std::unique_ptr<FileOutputBuffer>> BufOrError =
+      FileOutputBuffer::create(FilePath, Builder.GetSize());
+  if (!BufOrError) {
+    Error FileReadError = BufOrError.takeError();
+    std::string Message;
+    raw_string_ostream Stream(Message);
+    Stream << FileReadError;
+    Stream << " when trying to open `" << FilePath <<"` for writing";
+    consumeError(std::move(FileReadError));
+    return createStringError(errc::invalid_argument, Stream.str().c_str());
+  }
+
+  // Write binary to file.
+  std::unique_ptr<FileOutputBuffer> Buf = std::move(*BufOrError);
+  Builder.Write(Buf->getBufferStart());
+
+  if (Error FileWriteError = Buf->commit())
+    return FileWriteError;
+
+  return Error::success();
+}
+
+} // end namespace
+
+namespace llvm {
+namespace elfabi {
+
+// This function wraps the ELFT writeELFBinaryToFile() so writeBinaryStub()
+// can be called without having to use ELFType templates directly.
+Error writeBinaryStub(StringRef FilePath, const ELFStub &Stub,
+                      ELFTarget OutputFormat) {
+  if (OutputFormat == ELFTarget::ELF32LE) {
+    return writeELFBinaryToFile<ELF32LE>(FilePath, Stub);
+  } else if (OutputFormat == ELFTarget::ELF32BE) {
+    return writeELFBinaryToFile<ELF32BE>(FilePath, Stub);
+  } else if (OutputFormat == ELFTarget::ELF64LE) {
+    return writeELFBinaryToFile<ELF64LE>(FilePath, Stub);
+  } else if (OutputFormat == ELFTarget::ELF64BE) {
+    return writeELFBinaryToFile<ELF64BE>(FilePath, Stub);
+  }
+  return createStringError(errc::invalid_argument,
+                           "Invalid binary output target");
+}
+
 Expected<std::unique_ptr<ELFStub>> readELFFile(MemoryBufferRef Buf) {
   Expected<std::unique_ptr<Binary>> BinOrErr = createBinary(Buf);
   if (!BinOrErr) {
     return BinOrErr.takeError();
   }
 
   Binary *Bin = BinOrErr->get();
   if (auto Obj = dyn_cast<ELFObjectFile<ELF32LE>>(Bin)) {

llvm/tools/llvm-elfabi/llvm-elfabi.cpp

 cl::opt<std::string>
     EmitTBE("emit-tbe",
             cl::desc("Emit a text-based ELF stub (.tbe) from the input file"),
             cl::value_desc("path"));
 cl::opt<std::string> SOName(
     "soname",
     cl::desc("Manually set the DT_SONAME entry of any emitted files"),
     cl::value_desc("name"));
+cl::opt<ELFTarget> BinaryOutputTarget(
+    "output-target", cl::desc("Create a binary stub for the specified target"),
+    cl::values(clEnumValN(ELFTarget::ELF32LE, "elf32-little",
+                          "32-bit little-endian ELF stub"),
+               clEnumValN(ELFTarget::ELF32BE, "elf32-big",
+                          "32-bit big-endian ELF stub"),
+               clEnumValN(ELFTarget::ELF64LE, "elf64-little",
+                          "64-bit little-endian ELF stub"),
+               clEnumValN(ELFTarget::ELF64BE, "elf64-big",
+                          "64-bit big-endian ELF stub")));
+cl::opt<std::string> BinaryOutputFilePath(cl::Positional, cl::desc("output"));
 
 /// writeTBE() writes a Text-Based ELF stub to a file using the latest version
 /// of the YAML parser.
 static Error writeTBE(StringRef FilePath, ELFStub &Stub) {
   std::error_code SysErr;
 
   // Open file for writing.
   raw_fd_ostream Out(FilePath, SysErr);
int main(int argc, char *argv[]) {
   if (!StubOrErr) {
     Error ReadError = StubOrErr.takeError();
     WithColor::error() << ReadError << "\n";
     exit(1);
   }
 
   std::unique_ptr<ELFStub> TargetStub = std::move(StubOrErr.get());
 
-  // Write out .tbe file.
-  if (EmitTBE.getNumOccurrences() == 1) {
-    TargetStub->TbeVersion = TBEVersionCurrent;
-    if (SOName.getNumOccurrences() == 1) {
-      TargetStub->SoName = SOName;
-    }
+  // Change SoName before emitting stubs.
+
+  // Write out .tbe file.
+  if (EmitTBE.getNumOccurrences() == 1) {
+    TargetStub->TbeVersion = TBEVersionCurrent;
     Error TBEWriteError = writeTBE(EmitTBE, *TargetStub);
     if (TBEWriteError) {
       WithColor::error() << TBEWriteError << "\n";
       exit(1);
     }
   }
+
+  // Write out binary ELF stub.
+  if (BinaryOutputFilePath.getNumOccurrences() == 1) {
+    if (BinaryOutputTarget.getNumOccurrences() == 0) {
+      WithColor::error() << "No binary output target specified.\n";
+      exit(1);
+    }
+    Error BinaryWriteError = writeBinaryStub(BinaryOutputFilePath, *TargetStub,
+                                             BinaryOutputTarget);
+    if (BinaryWriteError) {
+      WithColor::error() << BinaryWriteError << "\n";
+      exit(1);
+    }
+  }
 }