how can search large files?

When searching for a bit of text in a directory (Find In Path) just now, I had a warning dialog pop up that said several files were skipped because they "are too large and cannot be scanned".

Hmm, those files were all around 5-10 MiB in size, which is really small.  Why is IntelliJ having a problem scanning such small files?  I could see if they were GiBs, but not MiBs.

Is there any workaround for this problem, like some kind of setting in idea.properties?

I have searched the IntelliJ help, and did a web search as well, and the only thing that I could find was this old posting which got no response...

Oh, I am now using IntelliJ 10.0.1 Ultimate edition, if that matters.

6 comments
Comment actions Permalink

No one have any suggestions here?

I subsequently managed to find this old bug report on the large file error dialog.  But all it talks about is changing the wording--it does not talk about correcting the issue!

Any IntelliJ developers reading this?  Should a bug report be filed?  I do not understand why small few MiB sized files cannot be searched.

0
Comment actions Permalink

I deem IDEA to be a meager editor for plain old text search-and-replace purposes. When I need such things, I turn to egrep (if I'm only searching) or jEdit, if I'm doing bulk search-and-replace across many files (potentially across different directories). jEdit, unlike most Unix text processors, can match across line boundaries (as can IDEA).


Randall Schulz

0
Comment actions Permalink
captainmidnight wrote:I subsequently managed to find this old bug report on the large file error dialog.  But all it talks about is changing the wording--it does not talk about correcting the issue!

If you read that bug report more carefully, you will see that it is discussing changing the wording on a dialog box that prompts you if you want to search the large file(s) or not. So it is on a different behavior. Upon encountering a large file upon a search, IDEA use to prompt you if you want to search it. That behavior appears to have changed at some point so that it now simply does not searching those files.So the question becomes what was the reasoning for this change in behavior.

captainmidnight wrote: I do not understand why small few MiB sized files cannot be searched.


Size  is relative. Source code files tend to hover in the tens of Kilobytes  range, with 100KB being a large source code file, and 250KB being very  large. On the flip side though, there tends to be lots of source code files; hundreds or thousands being very realistic numbers.

My guess as to why IDEA is not searching your 5-10 MB sized files is based on  those concepts. IDEA is an IDE. As such its primary goal is to work with  source code. In an effort to optimize searches, it limits the size of  the files it searches though since it is an assumption that larger files  are not source code files, and/or searching them would substantially  reduce the efficiency of the search.  99% of the time this would not present a problem. Again, this is just my guess as to  why it does this.

captainmidnight wrote: 
Any IntelliJ developers reading this?


Keep in mind that traditional holiday times & practices, and vacation practices,  vary by country, culture, and even company.

0
Comment actions Permalink

I have same problem.
Some of my source files are over 7 Mb. And now I use Total Commander to search inside files. But I need to include those files in Idea search.
What is solution?

0
Comment actions Permalink

I'm using 15.0.1 and the search tells me:

"Files 'file1.xml' (6 megabytes) 'file2.xml' (6 megabytes) 'file3.xml' (20 megabytes) ... 'file13.xml' (5 megabytes) are too large and cannot be scanned"

For me "cannot be scanned" means there is no way to search in these files.
Is that right?

0
Comment actions Permalink

Hi,

I'm using IntelliJ 2016.1 - and I have to search in sql-Files (5MB).

But "Find in Path" doesn't work for me. After I have created the idea.properties-File with 

idea.max.intellisense.filesize=8000

I can search IN the File - but "Find in Path" still doesn't work.

I know, that 5MB big files for PHP-Code (Or Java) is very big - but not big for an sql-File (Backup Database).

So I tryed the "Swiss Army Knife for Databases and SQL" - Datagrip :-)

But this also does not work.

I am quite surprised that DataGrip can't handle this.

 

Is there a way to let DataGrip (or even better: IntelliJ) work with such files?

 

0

Please sign in to leave a comment.