[nodriver] Memory leak using with Chrome, Edge & Brave

[Abdelrahman-Hekal]

Good day @ultrafunkamsterdam
Thanks for the amazing nodriver project, I'm experiencing a continuous memory leak on a larger project when using nodriver and I tested this leak over the sample code below and as long as the code is running, it is leaking memory by 2MB per web page visited which is causing the program to be leaking around 10 GB when left running for 8 hours.

The code ran on Windows 11 and Linux where the same behaviour is noticed for both OS.

import nodriver as uc
import asyncio

async def main():

    url = "https://www.carrefouregypt.com/mafegy/en/c/NFEGY4000000?currentPage="
    browser = await uc.start(browser_args=["--incognito"])
    for i in range(1, 100):
        page, content = None, None
        page = await asyncio.wait_for(browser.get(url + str(i)), timeout=30) 
        content = await asyncio.wait_for(page.get_content(), timeout=30) 

uc.loop().run_until_complete(main())

[ilike2burnthing]

#1844

[Abdelrahman-Hekal]

Thanks @ilike2burnthing for referring to the uc issue but unfortunately the unclosed chrome processes of undetected-chrome is different than this issue with the nodrive package. The issue that I face is a memory leak within the python process itself as shown in the snapshot below.

[Abdelrahman-Hekal]

Update: I have tried three different browsers (Chrome, Brave and Edge) and the memory leak is still observed with all of the browsers so far

[ilike2burnthing]

There are a few other open issues pertaining to leaks, though again they seem to be for UC:

• Huge memory leak from chrome v121 #1735
• memory leak 50 MB per page #1826

As a test, try reverting to Chrome v119 and v115. If you need clean installers (check the signatures, they're legitimate offline Chrome installers) - https://filecr.com/windows/google-chrome/?id=847089664000

You'll need to uninstall Chrome first, otherwise it won't install the older version if a newer version is present, and then reinstall normally once done with testing, as it won't auto-update.

[zuiqinghe2021]

I encountered the same issue, and switching to an older version of the browser still didn't resolve it. Are there any good solutions?

[jwxce]

Is there a solution to this problem?

[develfe]

I noticed the same problem. If I iterate over an array of links, get_content() increases the memory usage of the python process each time. (memory leak).

[life-live]

Is there a solution to this problem?

[Abdelrahman-Hekal]

@life-live no solution is found yet so far, we highly appreciate it if you can give it some time when possible @ultrafunkamsterdam