-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hadoop/Spark slower on Windows VS Linux #42
Comments
Thank you for your email.We’ll disposal and reply as soon as possible~Best Wishes~
|
I share the same experience. In my linxu server the hdfs dfs -ls / command return the result immediately. In the windows server, it takes about 1 mins. The windows server has better hardware the the linux server. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
I have two machines that have identical Hardware. CPU, RAM, and BIOS configurations are exactly the same. I am running Spark 3.3.1 with Hadoop 3.3.1. The benchmark is also exactly the same. I am not using any HDFS at all.
Problem: Spark on Windows runs slower than Linux
Any idea why Windows implementation is slower? What is exactly inside hadoop.dll and winutils.exe.
The text was updated successfully, but these errors were encountered: