qualitative analysis of tcmalloc profiling data

[Sashan]

both profilers (libtcmalloc and libmprofile) can collect detailed records about every call to alloc/free/realloc including a callstack.

the libtcmalloc allows to further fine-tune collection of heap profile samples. There are two env. variables:

• HEAP_PROFILE_ALLOCATION_INTERVAL set to 1GB by default
• HEAP_PROFILE_INUSE_INTERVAL set to 100MB by default.

details can be found here: https://gperftools.github.io/gperftools/heapprofile.html

one of the options for gperf is to generate analysis to .pdf file. attached file shows allocation graph for lhash_test. The The HEAP_PROFILE_ALLOCATION_INTERVAL and HEAP_PROFILE_INUSE_ALLOCATION were set to 5GB. Just one heap sample got collected during the test. It looks like we need to further tune intervals to collect more heap samples and analyze them.

[Sashan]

test_lhash.pdf