Synchronize database taking much longer and using a ton of disk space after 2017.2 update
I upgraded to 2017.2. I'm on Windows 10 and connected to a Postgres server/database. Since the update syncing a database went from 5-7 minutes to 20+ minutes. It is now write to disk at a rate of 40-60MB/s during that time. Looking at the size of my .DataGrip2017.2 folder under my users folder, it is 15.2 GB compared to my .DataGrip2017.1 folder being only 401 MB.
It looks like it is storing a ton of data under config\projects\default\.idea\dataSources. Is this thing downloading the entire database locally now? How do I stop it from doing this?
请先登录再写评论。
Hi,
DataGrip downloads all schema data for proper code completion in case you choose all schemas in all data sources.
How many shemas, databases do you have?
You can disable source downloading for system schemas by choosing this option in your data source Options tab:
Thank you.
The image below is what I have selected. These are the following duration to sync each db
login: 6s | nishared: 3s | niwarehouse: 2s | test1pg: 20m
test1pg is a larger db than the others, but all of them combined are no where near the amount of space it is now taking up on my hard drive after syncing. Maybe around 1GB for the selected dbs vs 15.2GB it is using on my hard drive. test1pg has 10's of thousands views, functions, tables, while the other dbs are in the low hundreds. But again, before updating test1pg was taking 6m to sync and using around 400MB of hard drive space.
test1pg does have a lot of the pg_temp and pg_toast_temp schemas when I look at the Schemas tab if that matters but the "Except system schemas" option appears to be selected by default so I would think these are being excluded.
There are other dbs on this server which are not selected, but I don't see how those could be affecting this considering how fast the smaller dbs sync.
Any other suggestions?
Hi,
Could you attach a screenshot with folder sizes under your data source for test1pg folder? E.g.: for guest database with 2 schemas public and bookings it looks like:
Path for Windows:
%USER%\.DataGrip2017.2\config\projects\default\.idea\dataSources\%DATASOURCE_GUID%\_src_\database\guest\schema
Also, it would be helpful to see sources for some your views.
Thank you.
The zip file seems ok, only 8.22 MB. It's the 10,614 .tmp files that are now taking up 24.7 GB that is killing me :D
I deleted all the .tmp files and kicked off another sync. Watching the folder while the sync runs runs I see .tmp files being created and then immediately being deleted. Now it looks much better
I don't know what happened for those temp files to not get deleted and take up all that space, something must have went wrong at some point. It did take 25m to sync test1pg, which seems like a very long time when it was taking 6m to 7m before the update. Any suggestions on how to speed that up or why the time increased so much after the update?
Also, I'm not sure what you mean by "it would be helpful to see sources for some your views." What sources/views and how do I show you those? Does it matter now that the issue w/ the .tmp files has been resolved?
Hi,
For sure there is a problem.
Do you have any IDE logs, freeze dumps and etc.?
Could you zip and attach them?
Thank you.
How do I send you the zip file? It says I can only do image files.
You can create an issue in our YouTrack and attach file https://youtrack.jetbrains.com/issues/DBE or share by public link on google drive or etc.
I created an issue w/ the zip file attached
https://youtrack.jetbrains.com/issue/DBE-4946