Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows Installation: Coursier hangs after downloading all Maven files, Kernel does not install #1010

Open
RaSi96 opened this issue Nov 2, 2022 · 3 comments

Comments

@RaSi96
Copy link

RaSi96 commented Nov 2, 2022

Greetings everyone,

I was trying to install Almond on Windows this time and ran into the following issue: after using BITSADMIN to download the required Coursier files and running .\coursier launch --fork almond -M almond.ScalaKernel -- --install, the 58 missing packages are successfully downloaded but the kernel itself doesn't seem to install. Instead, the installation seemingly hangs with no output. If I Ctrl+C the activity, I'm met with the following error:

almond-error

I've done the following:

  • installed Java 8 for Windows from Java's website and set JAVA_HOME
  • downloaded and extracted spark-3.3.1-bin-hadoop3-scala2.13 from Apache's repository and set SPARK_HOME
  • used BITSADMIN via CMD to download the Coursier files
  • used Coursier Launch to attempt to install the kernel and kernelspec.

This issue also occurs after I reboot my system and try to install the kernel fresh after startup. I've let the batch job run for 5 minutes to 1.5h with no progress. I have also tried running the command with --scala 2.13.8. Should I have Scala installed separately on my system?

As an aside and interestingly enough, the BITSADMIN commands only work via CMD and not Powershell; the latter returns a 0x80070057 error which looking up doesn't seem to help.

Any help would be greatly appreciated!

@RaSi96
Copy link
Author

RaSi96 commented Nov 3, 2022

I'm not familiar with Java at all, but I tried to look into this a little more today and from what I could gather, it seems to be a concurrency issue. Resource Monitor shows the only user of the file coursier-launch-1671778752678591189.jar from the image is Java. Thinking maybe this might be solved by a more recent version of Java, I tried installing Almond from scratch with the Java SE Development Kit 19.0.1, which also didn't work and gave me the same issue:

almond-hang

After I Ctrl+C:

almond-err

After I reinstalled the JDK I deleted the Coursier folder from %APPDATA% and re-ran the Windows commands from Almond's installation guide. Any ideas on how might I work around this issue?

@jacktlange
Copy link

I am having the same issue, were you able to resolve or work around this? Thanks! @RaSi96

@RaSi96
Copy link
Author

RaSi96 commented Jan 19, 2023

Hi @jacktlange, my apologies but I never really found a solution to this problem. I tried mixing and matching multiple different versions of Java, Scala and Spark and retrying the installation, but it didn't seem to work on Windows. On Arch Linux too I had limited functionality with Almond and the latest versions of Spark/Scala (#929) the last time I tried, though the process is a lot easier with Linux.

I wish I could be of more assistance to you, but as of now my workflow (fortunately) doesn't require the use of a Java/Spark/Scala pipeline; I'll leave this issue open though for future discussion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants