Refresh On BigQuery tables is not working

已回答

Using DataGrip 2022.2.1

With the Java BQ Driver: DBMS: Google BigQuery (ver. 2.0) Case sensitivity: plain=mixed, delimited=exact Driver: SimbaJDBCDriverforGoogleBigQuery (ver. 01.02.25.1029, JDBC4.2) Effective version: BigQuery (ver. 1.2.25.1029)  Connection successful (45 sec, 697 ms)

When a new table is added to a BQ data set it doesn't show up in DataGrip.  We have tried:

  1. right click refresh on the data source in Data Grip
  2. close / open DataGrip
  3. File/Invalidate Caches
  4. Running a select agains the new BQ table (results return, but still no table listed in the database explorer

One item does cause a refresh and that is when we add a new table via DataGrip, we get a refresh and can see all of the tables in the BQ Dataset.

 

I have also cycled through all of the JDBC driver versions that are available and they all have the same issue.  This makes me think it is not a driver issue, but maybe a cache issue from the datagrip app.

 

Any suggestions are appreciated.

 

评论操作 固定链接

Hey Andy,

Please right-click on data source name in Database Explorer, select Diagnostics | Diagnostic Refresh and upload a file to https://uploads.jetbrains.com/, then provide its ID.

0
评论操作 固定链接

Hello Daniil:  Thank you for the help on this. 

Upload id: 2022_08_12_p9cnET27nRYrjp7u3zNZYd (file: introspector.0.0.log)

 

-Andy

0
评论操作 固定链接

Andy Powell,

Make sure, you create table in dataset/project in the same location/region via Web and via DG.  You can try to create any table via DataGrip and see where it was created.

Also, verify user, you're connecting with, has rights to see tables. Since there different way you connect to Web UI and JDBC.

Have you specified any data set in Default dataset?

0
评论操作 固定链接

Hey vasily chernov we have performed these steps in the same dataset project, we have a default dataset, we are connecting with Service Accounts via DataGrip and the SA has the same roles as the user accounts in the BQ Project.  After speaking with the team more, this is a recent issue after upgrading the application version.  Do you see new tables appear in the DG Database explorer without refreshing or after refreshing?  There is not a consistent way for us to update the tables visible via the database explorer.  Also happy to hop on a shared desktop session if that resolves this quicker.

 

0
评论操作 固定链接

Hello Daniil Maslov do you have any feedback on this?  Is there a way to install the previous version or 2 versions back to see if the issue is present in those versions?

0
评论操作 固定链接

Andy Powell, we're in the process of reproducing that issue.

You can download previous versions from https://www.jetbrains.com/datagrip/download/other.html and install it separately from the current one.

0
评论操作 固定链接

Andy Powell, can you reproduce it on 2022.1.5 version?

0
评论操作 固定链接

I think we need to go back to 2021.3 to be where we were before the upgrades.  I am going to work on testing it later today. I will let you know what I observe.

1
评论操作 固定链接

Andy Powell, sorry for the ping. Any updates?

0
评论操作 固定链接

Hey Daniil Maslov sorry for the delay.  I am getting the expected refresh results from DataGrip 2021.3.4

After initially setting up a new data connection for BigQuery it did not list all of the tables or even show there were tables in all of the datasets.  When I right-click and refresh on the connection, it does display the tables as expected.

 

Let me know if you would like any further details.

 

Thank you,

 

-Andy

 

1
评论操作 固定链接

Any progress here? I have the same issue on 2022.2.2.

0
评论操作 固定链接

FWIW, I just ran a CREATE TABLE statement from Datagrip and it triggered some kind of refresh where now it's showing all the new tables. So, a manually triggered refresh seems to be different from whatever Datagrip does after running DDL statements. Hopefully this helps nail down how to fix the bug.

0
评论操作 固定链接

Is the Port value set for your data source? I had the same issue with no tables appearing for any schema and then realized I had forgot to set the port to 443 for my BigQuery connection. Setting that fixed the issue and I can now see the tables.

2
评论操作 固定链接

Andy Powell, Erik

Could you please open BigQuery connection settings, set port 443 there and also make sure that Project ID is mentioned in URL like this: jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=<my-project-id>;
Does it help?

0

请先登录再写评论。