MozillaZine

TB 60.4.0 32 bit - memory leaks

User Help for Mozilla Thunderbird
Puppy2012
 
Posts: 39
Joined: August 28th, 2012, 4:01 pm

Post Posted December 23rd, 2018, 11:07 am

I updated from the 59 version to 60.40. When Thunderbird is started the VM Size in Task Manager is about ~190 MB. When running for a 15 hours and just checking for new messages (IMAP folders), the VM Size is more than 350 MB. The 59 version didn't have the issue. About:memory reports error in maildb and warning:

WARNING: the following values are negative or unreasonably large.

explicit/maildb
explicit/(21 tiny)
explicit/(21 tiny)/heap-unclassified

This indicates a defect in one or more memory reporters. The invalid values are highlighted

tanstaafl
Moderator

User avatar
 
Posts: 45568
Joined: July 30th, 2003, 5:06 pm

Post Posted December 23rd, 2018, 11:20 am

What is maildb? I didn't spot it in the listing from about:memory. I normally run about:memory just once (before restarting) as each time you measure it that uses more memory.

Normally if you think you have a memory bug you'd run Thunderbird in safe mode (help -> restart with add-ons disabled) to verify its due to an add-on and then re-enable one add-on, test and repeat as needed until you identify the culprit.

https://wiki.mozilla.org/Thunderbird:Te ... e_Problems (how to identify memory leak source)
https://bugzilla.mozilla.org/show_bug.cgi?id=1240722 (Thunderbird leaks file descriptors (mostly .msf files) like a sieve causing high memory. 5 imap accounts. no virtual folders.)

tanstaafl
Moderator

User avatar
 
Posts: 45568
Joined: July 30th, 2003, 5:06 pm

Post Posted December 23rd, 2018, 11:22 am

Moved from Thunderbird Bugs to Thunderbird Support as its not discussing what to do with a confirmed bug filed with Bugzilla.

Puppy2012
 
Posts: 39
Joined: August 28th, 2012, 4:01 pm

Post Posted December 23rd, 2018, 6:08 pm

This is (anonymized) part of the memory report

172.03 MB (100.0%) -- explicit
├──478.06 MB (277.89%) -- maildb [?!]
│ ├──350.55 MB (203.77%) ── database(imap://xxx@aaa.bbb.ccc/INBOX) [?!]
│ ├──114.26 MB (66.42%) ── database(imap://xxx@aaa.bbb.ccc/Sent)
│ ├────7.27 MB (04.23%) ── database(imap://xxx@aaa.bbb.ccc/INBOX/Folder1)
│ ├────3.01 MB (01.75%) ── database(imap://xxx@aaa.bbb.ccc/INBOX/Folder2)
│ ├────2.43 MB (01.41%) ── database(imap://xxx@aaa.bbb.ccc/INBOX/Folder3)

└──-410.26 MB (-238.48%) -- (21 tiny) [?!]
├─────1.71 MB (00.99%) ++ atoms
├─────1.12 MB (00.65%) ++ xul-prototype-cache
├─────1.02 MB (00.59%) ++ layout
├─────0.98 MB (00.57%) ── profiler/profiler-state
├─────0.94 MB (00.55%) ++ xpconnect
├─────0.89 MB (00.52%) ── xpti-working-set
├─────0.79 MB (00.46%) ── icu
├─────0.64 MB (00.37%) ++ url-preloader
├─────0.61 MB (00.35%) ++ network
├─────0.49 MB (00.28%) ++ preferences
├─────0.43 MB (00.25%) ++ gfx
├─────0.22 MB (00.13%) ++ xpcom
├─────0.11 MB (00.07%) ++ dom
├─────0.09 MB (00.05%) ── telemetry
├─────0.05 MB (00.03%) ++ cycle-collector
├─────0.01 MB (00.01%) ── cookie-service
├─────0.00 MB (00.00%) ++ data-storage
├─────0.00 MB (00.00%) ── script-namespace-manager
├─────0.00 MB (00.00%) ── history-links-hashtable
├─────0.00 MB (00.00%) ── media/libogg
└──-420.36 MB (-244.35%) ── heap-unclassified [?!]

tanstaafl
Moderator

User avatar
 
Posts: 45568
Joined: July 30th, 2003, 5:06 pm

Post Posted December 24th, 2018, 6:01 am

I have global search/indexing enabled , 2 IMAP accounts and 4 add-ons (one a persona) on this machine. I don't have offline folders (from synchronization & sharing) enabled. I notice you have 5 database entries (which I assume are for offline folders), which appear to be summarized as maildb. If you temporarily disable offline folders (that won't delete them) and retest does the memory leak problem go away?

For comparison, this is the explicit allocations I see:

101.19 MB (100.0%) -- explicit
├───29.29 MB (28.95%) -- js-non-window
│ ├──14.40 MB (14.23%) -- zones
│ │ ├──11.61 MB (11.48%) -- zone(0xb016000)
│ │ │ ├───5.42 MB (05.36%) -- compartment([System Principal], shared JSM global)
│ │ │ │ ├──3.56 MB (03.52%) -- classes
│ │ │ │ │ ├──2.36 MB (02.33%) -- class(Object)/objects
│ │ │ │ │ │ ├──2.05 MB (02.03%) ── gc-heap
│ │ │ │ │ │ └──0.30 MB (00.30%) ++ malloc-heap
│ │ │ │ │ └──1.21 MB (01.19%) ++ (8 tiny)
│ │ │ │ ├──1.28 MB (01.27%) ++ scripts
│ │ │ │ └──0.58 MB (00.57%) ++ (8 tiny)
│ │ │ ├───4.63 MB (04.58%) ++ (18 tiny)
│ │ │ └───1.56 MB (01.54%) ++ shapes
│ │ ├───2.17 MB (02.15%) -- zone(0xb013000)
│ │ │ ├──2.13 MB (02.11%) -- strings
│ │ │ │ ├──2.12 MB (02.09%) -- string(<non-notable strings>)
│ │ │ │ │ ├──1.67 MB (01.65%) -- gc-heap
│ │ │ │ │ │ ├──1.66 MB (01.65%) ── latin1
│ │ │ │ │ │ └──0.00 MB (00.00%) ── two-byte
│ │ │ │ │ └──0.45 MB (00.45%) ── malloc-heap/latin1
│ │ │ │ └──0.02 MB (00.02%) ++ string(length=15052, copies=1 (removed ids and email addresses)
│ │ │ └──0.04 MB (00.04%) ++ (4 tiny)
│ │ └───0.61 MB (00.60%) ++ (8 tiny)
│ ├──13.66 MB (13.50%) -- runtime
│ │ ├───4.79 MB (04.74%) ── script-data
│ │ ├───4.11 MB (04.07%) -- gc
│ │ │ ├──4.00 MB (03.95%) ── nursery-committed
│ │ │ └──0.11 MB (00.11%) ++ (3 tiny)
│ │ ├───2.05 MB (02.03%) ── shared-immutable-strings-cache
│ │ ├───1.08 MB (01.07%) ── atoms-table
│ │ ├───1.06 MB (01.05%) ++ code
│ │ └───0.55 MB (00.55%) ++ (9 tiny)
│ └───1.23 MB (01.22%) ++ gc-heap
├───15.09 MB (14.91%) -- gfx
│ ├──14.92 MB (14.74%) ── heap-textures
│ └───0.17 MB (00.17%) ++ (5 tiny)
├───11.10 MB (10.97%) -- window-objects
│ ├───7.11 MB (07.03%) -- top(chrome://messenger/content/messenger.xul, id=3)
│ │ ├──5.47 MB (05.41%) -- active
│ │ │ ├──4.68 MB (04.62%) -- window(chrome://messenger/content/messenger.xul)
│ │ │ │ ├──2.23 MB (02.20%) ++ layout
│ │ │ │ ├──1.35 MB (01.33%) ++ js-compartment([System Principal], about:blank)
│ │ │ │ ├──1.09 MB (01.07%) ++ dom
│ │ │ │ └──0.02 MB (00.01%) ++ (2 tiny)
│ │ │ └──0.79 MB (00.78%) ++ (2 tiny)
│ │ └──1.64 MB (01.62%) ++ js-zone(0xdbce800)
│ ├───2.06 MB (02.04%) -- top(about:support, id=28)
│ │ ├──1.65 MB (01.63%) -- active/window(about:support)
│ │ │ ├──1.08 MB (01.07%) ++ layout
│ │ │ └──0.57 MB (00.57%) ++ (4 tiny)
│ │ └──0.41 MB (00.40%) ++ js-zone(0x1839d800)
│ └───1.93 MB (01.91%) ++ (7 tiny)
├────9.55 MB (09.43%) ── heap-unclassified
├────8.28 MB (08.18%) ++ (21 tiny)
├────7.91 MB (07.82%) -- script-preloader
│ ├──7.91 MB (07.82%) -- heap
│ │ ├──7.90 MB (07.81%) ── saved-scripts [2]
│ │ └──0.01 MB (00.01%) ++ (2 tiny)
│ └──0.00 MB (00.00%) ── non-heap/memmapped-cache
├────6.36 MB (06.28%) -- heap-overhead
│ ├──4.43 MB (04.37%) ── bin-unused
│ ├──1.19 MB (01.17%) ── page-cache
│ └──0.74 MB (00.73%) ── bookkeeping
├────4.23 MB (04.18%) -- images
│ ├──2.81 MB (02.78%) -- content/raster/used
│ │ ├──1.87 MB (01.85%) -- image(1366x200, file:///C:/Users/Donald/Documents/profiles/thunderbird/fuvxey58.default/lwtheme/lightweighttheme-header-1366x768?839924;0)
│ │ │ ├──1.04 MB (01.03%) -- locked/cannot_substitute/surface(1366x200)
│ │ │ │ ├──1.04 MB (01.03%) ── decoded-nonheap
│ │ │ │ └──0.00 MB (00.00%) ── decoded-heap
│ │ │ └──0.83 MB (00.82%) ── source
│ │ └──0.94 MB (00.93%) ++ image(1366x100, file:///C:/Users/Donald/Documents/profiles/thunderbird/fuvxey58.default/lwtheme/lightweighttheme-footer-1366x768?839924;0)
│ ├──1.40 MB (01.39%) -- chrome
│ │ ├──1.20 MB (01.19%) ++ vector/used
│ │ └──0.20 MB (00.20%) ++ raster/used
│ └──0.02 MB (00.02%) ++ uncached/raster/used/image(80x32, chrome://messenger/skin/icons/server.png)
├────3.93 MB (03.89%) -- storage/sqlite
│ ├──2.03 MB (02.00%) ++ (5 tiny)
│ └──1.91 MB (01.88%) ── other
├────3.69 MB (03.65%) -- startup-cache
│ ├──3.69 MB (03.65%) ── mapping
│ └──0.00 MB (00.00%) ── data
└────1.76 MB (01.74%) -- workers/workers(chrome)/worker(resource://gre/modules/osfile/osfile_async_worker.js, 0x144bb000)
├──1.24 MB (01.22%) -- runtime
│ ├──1.04 MB (01.03%) ++ gc
│ └──0.20 MB (00.19%) ++ (13 tiny)
└──0.52 MB (00.52%) ++ (3 tiny)

wsmwk
 
Posts: 2577
Joined: December 7th, 2004, 6:52 am

Post Posted December 24th, 2018, 7:00 am

350MB is quite reasonable.

maildb is the storage associated with opening .msf files. .msf files are the indexes to folders

tanstaafl
Moderator

User avatar
 
Posts: 45568
Joined: July 30th, 2003, 5:06 pm

Post Posted December 24th, 2018, 8:41 am

wsmwk wrote:maildb is the storage associated with opening .msf files. .msf files are the indexes to folders

Then how come I don't have one? 478.06 MB also seems high for *.msf files for four inbox and one sent folder.

Is there a wiki page or KB article somewhere that documents the output of about:memory for Thunderbird? I looked in https://wiki.mozilla.org/Thunderbird:Te ... e_Problems . It has a link to a non-existent https://wiki.mozilla.org/Memory_Overview page in step 8 plus a empty section with that name.

tanstaafl
Moderator

User avatar
 
Posts: 45568
Joined: July 30th, 2003, 5:06 pm

Post Posted December 24th, 2018, 9:17 am

wsmwk:

Is "Thunderbird loads a folder's *.msf file into memory whenever it opens the folder. By default it keeps up to 30 *.msf files open for 5 minutes (and their contents in memory), unless they are "special" folders, which it never closes. It loads the inbox.msf file for every account on startup." from http://kb.mozillazine.org/Performance_-_Thunderbird out of date?

That's partially based on https://bugzilla.mozilla.org/show_bug.cgi?id=723248 . mail.db.max_open appears to still default to 30 but mail.db.idle_limit now seems to be 300000 (not 3000). Is it still in seconds?

I know the inbox counts as a special folder but I didn't think the sent folder did. If it does, then why does only one get listed in Puppy2012's memory listing for maildb?

Return to Thunderbird Support


Who is online

Users browsing this forum: No registered users and 5 guests