Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to remove unused code at compile time?

We've built a Go package that is used by many of us.

It's imported using the standard import ("package-name") method.

At compile time though, all of our utilities, including the very small ones, end up as very large binaries.

We've extracted all the strings in the utilities and discovered that the entire package is being compiled into each and every utility. Including functions that are not being used by those utilities.

EDIT 1:

Thank you to the people who are responding to this question.

Here's what we are seeing:

main.go

package main

import "play/subplay"

func main() {
    subplay.A()
}

play/subplay.go

package subplay

func A() {
    fmt.Printf("this is function A()")
}

func B() {
    fmt.Printf("secret string")
}

Function B() is never called. Yet, after building the binary, we find the string "secret string" into main.exe.

How can we remove unused code from Go programs at compile time?

like image 754
ABC Avatar asked Mar 16 '17 05:03

ABC


People also ask

Do C++ compilers call all unused functions?

Only a subset of the functions is called. All other functions are unused. Surprisingly, a lot of C++ developers assume that today’s optimizing compilers just take care of it. The compiler should be able to see that a function is never called and, therefore, exclude it from the executable.

How to remove unused code from a g++ program?

We have to instruct it explicitly to remove unused code. $ g++ -O2 -march=native -ffunction-sections -Wl,--gc-sections deadcode.cpp -o deadcode -ffunction-sectionsputs every function in its own ELF section. The linker only sees sections as a black box. --gc-sectionstells the linker to track calls into sections and remove unused ones.

How can I see how much unused code is in my application?

The Coverage tab in DevTools will also tell you how much CSS and JS code in your application is unused. By specifying a full Lighthouse configuration through its Node CLI, an "Unused JavaScript" audit can also be used to trace how much unused code is being shipped with your application.

How to remove unused () function from dead code?

The compiler can now see that unused()is only visible inside deadcode.cpp and there is no call to it in deadcode.cpp. Hence, the function is unreachable and removed as dead code. Instead of changing the file by hand, we can use a special flag of GCC. $ g++ -O2 -march=native -fwhole-program deadcode.cpp -o deadcode


1 Answers

The compiler already does this. All code ends up in package files (.a), but in the executable binary the Go tool does not include everything from imported packages, only what is needed (or more precisely: it excludes things that it can prove unreachable).

See possible duplicate Splitting client/server code.

One thing to note here: if an imported package (from which you only want to include things you refer to) imports other packages, this has to be done recursively of course.

For example if you import this package:

package subplay

func A() {}

And call nothing from it:

package main

import _ "play/subplay"

func main() {
}

The result binary (Go 1.8, linux, amd64) will be 960,134 bytes (roughly 1 MB).

If you change subplay to import net/http:

package subplay

import _ "net/http"

func A() {}

But still don't call anything from net/http, the result will be: 5,370,935 bytes (roughly 5 MB)! (Note that net/http also imports 39 other packages!)

Now if you go ahead and start using things from net/http:

package subplay

import "net/http"

func A() {
    http.ListenAndServe("", nil)
}

But in the main package you still don't call subplay.A(), the size of the executable binary does not change: remains 5,370,935 bytes!

And when you change the main package to call subplay.A():

package main

import "play/subplay"

func main() {
    subplay.A()
}

The result binary grows: 5,877,919 bytes!

If you change http.ListenAndServe() to http.ListenAndServeTLS():

func A() {
    http.ListenAndServeTLS("", "", "", nil)
}

Result binary is: 6,041,535 bytes.

As you can see, what gets compiled into the executable binary does depend on what you call / use from the imported packages.

Also don't forget that Go is a statically linked language, the result executable binary has to include everything it needs. See related question: Reason for huge size of compiled executable of Go

like image 95
icza Avatar answered Sep 23 '22 08:09

icza