Jupyter freezes, needs forced quit, in Prof. Ed. 2019.1.3.

While working in the editor side of Jupyter (1.0.0 via Anaconda3), the IDE keeps freezing (with Apple's "spinning beachball of death"). 

OSX 10.14.5 / PyCharm 2019.1.3 / Python 3.7 / Anaconda3 / Jupyter 1.0.0 (core 4.5)

This is happening very frequently, on average I'd say about once per hour.

It's not the only problem I have been having with the new Jupyter/PyCharm. JetBrains people what is going on ??

This is very detrimental to my productivity (which is the opposite reason I chose PyCharm and the professional edition).

 

7 comments
Comment actions Permalink

Yes. PyCharm goes up about 780% CPU

Reading about the related issue, I am also using matplotlib, but I need to use this library. 

Also I have jdk1.8.0_201.jdk installed. (I am using PySpark which apparently prefers version 8).

  • I have the logs now but I can only see how to attach an image or insert a link here. How should I attach the log files?
  • I was not able to locate the CPU snapshot. I tried to follow this: "Invoke Help | Diagnostic | Profile Indexing. Click Invalidate and Restart (please note that Local History and Indices will be destroyed). Click Open Snapshot in ... to locate the snapshot." I selected "Profile indexing" from PyCharm's Help | Diagnostic dropdown menu. I selected "Invalidate caches / Restart" from PyCharm's File dropdown menu. It did stuff, CPU use went up sharply. But I don't know what/where is "Open Snapshot in ..." 
0
Comment actions Permalink

The key part here is JDK 8

Unfortunately, Jupyter support in PyCharm 2019.x requires JDK 11, no way around it.

Also, I don't see why you can't run PyCharm under JDK 11 and PySpark under JDK 8. From what I've just googled, PySpark use Java from JAVA_HOME env variable. But PyCharm has other ways to select boot JDK, described here: https://intellij-support.jetbrains.com/hc/en-us/articles/206544879-Selecting-the-JDK-version-the-IDE-will-run-under

So you can run PyCharm with JDK 11, while JAVA_HOME will be pointing to JDK 8, which will be picked up by PySpark. There may be other ways to configure JDK for PySpark too.

0
Comment actions Permalink

First, I set the JAVA_HOME variable to 1.8 as your comment suggests.

Next, I looked into switching this "Boot JDK" you mentioned. However, as you can see from the screenshot here, it seems it is already configured to version 11.This JDK is located in /Applications/PyCharm.app/Contents/jdk/Contents/Home/bin and when I do ./java -version, I get openjdk version "11.0.2" 2019-01-15. (As opposed to when I do java -version, which gives me that brand new Oracle jdk that I don't now think I needed to install: java version "11.0.3" 2019-04-16 LTS.

So it looks like the required version of JDK (version 11) comes bundled with and pre-configured as the Boot JDK with version PyCharm 2019. 

The key part here is that the reason for Jupyter-PyCharm 2019.1.3 freezing/crashing and burning my CPU up, remains unsolved.

0
Comment actions Permalink

Yes, JDK 11 is bundled with PyCharm, but you can select to use any other JDK via various methods. Anyway, check Help > About - what JDK version it shows? This is JDK actually used by PyCharm. If it's JDK 11 then the issue is something else.

In that case, please try to open and edit any Markdown (.md) file - do you get performance issue? (Markdown and Jupyter are using the same components).

0
Comment actions Permalink

Yes the boot JDK is 11, as I've made explicitly clear in my previous post with massive screenshot.

You still have not told me how to send you the logs or how to find the cpu snapshot.

 

I'm aborting use of PyCharm-Jupyter as the product was clearly not ready for release and JetBrains support is ineffective.

 

0
Comment actions Permalink

I'm mostly interested what do you have in Help > About pop up, as this reliably shows which JDK is currently used by PyCharm. Then, after confirming your current boot JDK, I want to you to try creating and editing any Markdown file, and if the issue is also reproduced, it will be much easier to identify.

You can upload the logs and CPU snapshots to: https://uploads.services.jetbrains.com/ and provide file name here.

0

Please sign in to leave a comment.