Golang Garbage Collector 101

Uday Yadav - Dec 20 '20 - - Dev Community

Quick Look at Garbage Collector

A simple program that creates a byte array of 100000000 elements and lets print the memory allocations.
package main

package main 

import (
    "fmt"
    "runtime"
    "time"
)

func printStats(mem runtime.MemStats) {
    runtime.ReadMemStats(&mem)
    fmt.Println("mem.Alloc:", mem.Alloc)
    fmt.Println("mem.TotalAlloc:", mem.TotalAlloc)
    fmt.Println("mem.HeapAlloc:", mem.HeapAlloc)
    fmt.Println("mem.NumGC:", mem.NumGC)
    fmt.Println("-----")
}

func main() {
    var mem runtime.MemStats
    for i := 0; i < 2; i++ {
        s := make([]byte, 100000000)
        if s == nil {
            fmt.Println("Operation failed!")
        }
        printStats(mem)
    }
    time.Sleep(time.Second)
    // adding time.Sleep so that GC finishes it works and print out the output to terminal
}
Enter fullscreen mode Exit fullscreen mode

Understanding the code

There is a package in Golang standard library called runtimewhich contains alot of useful function like :

  • runtime.ReadMemStats(&mem)
  • runtime.GC()

Take a loot at : https://golang.org/pkg/runtime/

  1. func ReadMemStats
func ReadMemStats(m *MemStats)
Enter fullscreen mode Exit fullscreen mode

ReadMemStats populates m with memory allocator statistics.
The returned memory allocator statistics are up to date as of the call to ReadMemStats. This is in contrast with a heap profile, which is a snapshot as of the most recently completed garbage collection cycle.

  1. func GC
func GC()
Enter fullscreen mode Exit fullscreen mode

GC runs a garbage collection and blocks the caller until the garbage collection is complete. It may also block the entire program.

*Run this program using the following flag : *

$ GODEBUG=gctrace=1 go run gc.go 
Enter fullscreen mode Exit fullscreen mode

Output i receive [ don't get scared, will clean up ] :

// some other output //

gc 3 @0.029s 5%: 0.020+2.8+0.009 ms clock, 0.081+0.12/2.7/0.19+0.036 ms cpu, 13->15->10 MB, 15 MB goal, 4 P
mem.Alloc: 100092312
mem.TotalAlloc: 100092312
mem.HeapAlloc: 100092312
mem.NumGC: 0
-----
gc 1 @0.001s 3%: 0.035+0.20+0.002 ms clock, 0.14+0.041/0.037/0.10+0.010 ms cpu, 95->95->0 MB, 96 MB goal, 4 P
mem.Alloc: 100081456
mem.TotalAlloc: 100101064
mem.HeapAlloc: 100081456
mem.NumGC: 1
-----
gc 2 @0.021s 0%: 0.014+0.11+0.003 ms clock, 0.058+0.068/0.050/0.049+0.012 ms cpu, 95->95->0 MB, 96 MB goal, 4 P
Enter fullscreen mode Exit fullscreen mode

Let look at the second run :

-----
gc 1 @0.001s 3%: 0.035+0.20+0.002 ms clock, 0.14+0.041/0.037/0.10+0.010 ms cpu, 95->95->0 MB, 96 MB goal, 4 P
mem.Alloc: 100081456
mem.TotalAlloc: 100101064
mem.HeapAlloc: 100081456
mem.NumGC: 1
-----
gc 2 @0.021s 0%: 0.014+0.11+0.003 ms clock, 0.058+0.068/0.050/0.049+0.012 ms cpu, 95->95->0 MB, 96 MB goal, 4 P
Enter fullscreen mode Exit fullscreen mode
  • In first line : ignoring the value from CPU profiler, take a look at "95->95>0 MB". The first number is the heap size when the garbage collector is about to run.
  • The second value is the heap size when the garbage collector ends its operation. The last value is the size of the live heap that is 0
  • It allocated 100081456 bytes of memory, more than the 100000000 because some extra memory required for some internal stuff, you can verify this by reducing 100000000 to 3000000o or even 30000, on my machine it always took somewhere around 70k to 90k bytes, your number may vary.
  • Thus before running through the second iteration of the loop, it clears out the memory allocated during the first.

Also you can read the comments below for some interesting insights.

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Terabox Video Player