New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Reading from /dev/stdin
is very slow
#685
Labels
bug
This is considered a bug and shall get fixed
mtail-Log Tailing
Issues related to log polling and tailing
Comments
Cool bug, thanks for the report! If someone picks this up before me, I'd try to attach a profiler to see what's taking so long. |
jaqx0r
added
bug
This is considered a bug and shall get fixed
mtail-Log Tailing
Issues related to log polling and tailing
labels
Jan 1, 2023
we've detected the same issue with mtail 3.0.0-rc50 (shipped with Debian bookworm) and latest version available (3.0.0-rc55) |
perf top report looks like this:
in our setup, mtail 3.0.0~rc43 (shipped with Debian bullseye) was working as expected |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
bug
This is considered a bug and shall get fixed
mtail-Log Tailing
Issues related to log polling and tailing
Processing this 7.5M line file normally takes ~2-3 minutes on my laptop:
But when it is piped on standard input like this:
it takes forever, reading ~2.5k lines/minute:
Tested on the latest relase downloaded from github and the simplest line counter program:
The text was updated successfully, but these errors were encountered: