sql - NoSQL for searching millions of pages? -

-

I have been provided with aprox 4-5 million images of old documents which my company has decided to remove. We are trying to go paperless but I am facing a problem which I am unable to fully understand. I have always used SQL for the amount of this data but now I have only images. I have already bought ABBYY Fine Reader OCR and it is currently working on OCR for all the files on Word or PDF. The problem is that they want to search this data in less than 7-10 seconds within this large scale and want to get all the results with the download link in the original image of the file.

I do not have any SQL but I think this is not the best way because I do not need to create a table with any schema and just the entire text of each image is the same page number and the link to the original file Will have to be linked with. According to my knowledge this age will take birth, what other solution can I use?

A document to search on a set, usually the best to create a reverse index The solution is Here I believe that you want to support the actions provided by Google, Bing, etc. ... but on your data.

The creation of a reverse index usually involves dividing the documents in words, and separately separates them into each indicator entry in the reverse index as a key word, and the name of the document (Or some other identifier of the document), and the document will contain the word as the location value.

You can do it manually, but it is not so trivial to parse the documents, remove words, eliminate non-critical words and index them. Using a dedicated product is easy.

Most RDBMS integers support extensions that provide indexing indexing. For example:

    • Generally, these RDBMS extensions Are less efficient than typical engines.

  • P > I think none of these products can index a few millions of documents.


    • Comments

    Post a Comment

    Popular posts from this blog

    java - org.apache.http.ProtocolException: Target host is not specified -

    -
    I have written a simple httprequest / response code and I am getting this error below: I used to type in my classpath httpclient, httpcore, common -Codecs and general logging. I am very new to Java and I do not know what's going on here. Please help me. code: import org.apache.http.client.HttpClient; Import org.apache.http.client.methods.HttpGet; Import org.apache.http.HttpResponse; Import org.apache.http.impl.client.HttpClientBuilder; Import org.apache.http.Header; Import org.apache.http.HttpHeaders; Public class UnshorteningUrl {public static zero main (string [] args throws exception {HttpGet request = zero; HTTP Client Client = HTTP ClientBuilder.credit (). Build (); Try {Request = New HTTP Gate ("trib.me/1lBFzSi"); HttpResponse httpResponse = client.execute (request); Header [] header = httpResponse.getHeaders (HttpHeaders.LOCATION); // Preconditions.checkState (headers.length == 1); String new url = header [0] .getValue (); System.out.println ("new url...
    Read more

    java - Gradle dependencies: compile project by relative path -

    -
    Is it possible to specify a dependency on another gradeal project in the granular (in android studios) outside the current project limits? For example, with a relative path like this: dependence {collection project ('../../ stdlib / dagger'}} MyApp (path / user / foo / workspace / mypad) The app (Path / User / Foo / Workspace / MyPass / App) And I have an Android Library Project with 3 subdomules: stdlib (path is / user / foo / Utilities (Path / User / Foo / Workspace / Stadlib / Utilis) http (Path / User / Foo / Workspace / Stadlib / HT) / Li> What I have to do is compile the Dagger, Util, http module in the MyApp project. The Stidelib Library module under heavy development And MyApp will grow in the form of Growth, so I do not want to push them into a Mewen repository. I am a little change. is likely to add another Gredle projects in some way? I will push the study library into the Maven repository after the source is in search of a temp...
    Read more

    ruby on rails - Object doesn't support #inspect when used with .include -

    -
    So I have participated in a glitch error that I do not even know how to debug. I am very new to the railing, so it has kicked my ass well when I use the .includes (school) seen by the student, it gives a blue box error, But when I look at any other model and .includes (school) , the school works just fine. class student & lt; ActiveRecord :: Base has has_many: relationships, foreign_key: "liker_id", dependent :: has_many: matches, foreign_key: "student_1_id", dependent :: deleted belong_to: school belong_to: conference belong_to: would_you_rather belong_to: home city belong_to: year is_to: Major and class school & lt; on the console activatecord :: Affiliate for the base: conference includes: respondent, class: "school", foreign_key: "rival_id" (e.g. For: School) Select SQL generated Select "School". * "School" from "school" "ID" IN (1) error message back NoMethodError: u...
    Read more