How does my cache become so large (and how can I prevent it)

I noticed that my .IdeaIC90 folder (on linux) became very very large (30 Gb +). After invalidating caches the indexing process took also a very long time.

It seems that PyCharm is biting itself stuck on a symlink in /usr/bin/X11 . This folder has a symlink named X11 to itself. It seems that PyCharm searches very deep and indexes everything it comes across (eventhough it is every level the same).

Is this the problem that makes my cache so big? If yes, is there some way to exclude /usr/bin/X11/X11 from being indexed?

Should I maybe file this as bug?

0
7 comments

Hello Peter,

Indeed, PyCharm currently does not handle recursive symlinks, and the index

can grow infinitely large if such symlinks are found under indexed directories.

However, it's definitely not supposed to index your entire hard drive, and

should have no reason to go into the /usr/bin/X11 directory.

Could you please attach ~/.PyCharm10/config/options/jdk.table.xml so that

we could see what paths PyCharm is indexing?

I noticed that my .IdeaIC90 folder (on linux) became very very large

(30 Gb +). After invalidating caches the indexing process took also a

very long time.

It seems that PyCharm is biting itself stuck on a symlink in

/usr/bin/X11 . This folder has a symlink named X11 to itself. It seems

that PyCharm searches very deep and indexes everything it comes across

(eventhough it is every level the same).

Is this the problem that makes my cache so big? If yes, is there some

way to exclude /usr/bin/X11/X11 from being indexed?

---

Original message URL:

http://www.jetbrains.net/devnet/message/5259950#5259950

--

Dmitry Jemerov

Development Lead

JetBrains, Inc.

http://www.jetbrains.com/

"Develop with Pleasure!"

0
Avatar
Permanently deleted user

I don't have a ~/.PyCharm10 folder, but attached the same file in the ~/.IdeaIC90 folder.



Attachment(s):
jdk.table.xml
0

Hello Peter,

I don't have a ~/.PyCharm10 folder, but attached the same file in the

~/.IdeaIC90 folder.

Thanks for your report! I've found the problem causing PyCharm to erroneously

add /usr/bin to the SDK paths, and it will be fixed in the next build. For

the time being, you can edit jdk.table.xml manually and remove the entries

for /usr/bin.

--

Dmitry Jemerov

Development Lead

JetBrains, Inc.

http://www.jetbrains.com/

"Develop with Pleasure!"

0
Avatar
Permanently deleted user

Thanks a lot for fixing! PyCharm is a great product!!!

0
Avatar
Permanently deleted user

Hi all,

Sorry to pop this one pretty old topic, but I have very similar problem, and not sure if this is the same one or another one.

I've also noticed that my cache is pretty heavy, and after some investigative work I've identified that it scans my D:\Temp directory (which is in turn pretty heavy too). It appeared then that PyCharm adds D:\Temp to "Paths to the selected interpreter" in the "Python interpreter" section in Settings. Even if I remove the D:\Temp from both the jdk.table.xml and the Python Interptere Settings - it gets there after a PyCharm restart again.

Is it the same issue? Or, is it a defect at all? May be I should have removed D:\Temp from some another config? But honestly I don't remember myself adding it anywhere to Python or PyCharm...

Thank you,

Timur

0

Hello Timur,

The list of paths is populated by running Python and getting the value of

sys.path. For some reason D:\Temp is included in it. To find out why, please

check the value of the PYTHONPATH environment variable and the contents of

Lib\site-packages under your Python installation directory.

Sorry to pop this one pretty old topic, but I have very similar

problem, and not sure if this is the same one or another one.

I've also noticed that my cache is pretty heavy, and after some

investigative work I've identified that it scans my D:\Temp directory

(which is in turn pretty heave too). It appeared then that PyCharm

adds D:\Temp to "Paths to the selected interpreter" in the "Python

interpreter" section in Settings. Even if I remove the D:\Temp from

both the jdk.table.xml and the Python Interptere Settings - it gets

there after a PyCharm restart again.

Is it the same issue? Or, is it a defect at all? May be I should have

removed D:\Temp from some another config? But honestly I don't

remember myself adding it anywhere to Python or PyCharm...

--

Dmitry Jemerov

Development Lead

JetBrains, Inc.

http://www.jetbrains.com/

"Develop with Pleasure!"

0
Avatar
Permanently deleted user

Indeed! Thank you Dmitry, it solves my problem. Indeed my issue is not related to the PyCharm in fact.

It appeares that I've been using sitecustomize.py for a while - I forgot to remove it after some investigation. And it was adding my D:\Temp to sys.path. Now its OK once it is removed.

Thanks again,

Tim

0

Please sign in to leave a comment.