java - Reading data from HDFS - my program can't find the path -

- September 15, 2013

I am trying to read the contents of the file from HDFS. My code is below -

  Package General; Import java.io.buffferedReader; Import java.io.IOException; Import java.io.InputStreamReader; Import org.apache.hadoop.conf.configuration; Import org.apache.hadoop.fs.FileSystem; Import org.apache.hadoop.fs.Path; Public Class ReadFromHDFS {Public Static Zero Main (string [] args throws exceptions {if (args.length & lt; 1) {System.out.println ("Usage: ReadFromHDFS & lt; hdfs-file-path-to- Read-from & gt; "); System.out.println ("Example: ReadFromHDFS 'hdfs: / localhost: 9000 / myFirstSelfWriteFile'"); System.exit (-1); } {Try Path Path = New Path (Argos [0]); FileSystem fileSystem = FileSystem.get (new configuration ()); Buffer Reader buffedreader = new buffed reader (new inputstreamreader (file system.open (path)); string line = buffedreader .readline (); while (line! = Null) {System.out.println (line); line = buffer.readline ();}} Grip (IOException e) {e.printStackTrace ();}}}

However, I did not know how to program this path to my HDFS directory I tried -

  java-cp  Gen.ReadFromHDFS & lt; path & gt;

where With the path I tried to refer straight to the directory (what do I see when I do THeP FS-L), directory inside the file, adding hdfs: / localhost, hdfs: / and none do work from them Can anyone help me how to fix the path of my folder to HDFS? For example, when I give the path directly (without any prefix), it says that the file does not exist. / P>

Npadit: Now none of the solutions is also not working for me I get are always exceptions -

  java.io.FileNotFoundExceptoin: file & lt; Filename & gt; Does not exist. Trying to find this file locally.

 
 
 
 
 
   You must use classes in the package org.apache.hadoop.fs (FileSystem, FSDataInputStream, FSDataOutputStream and Path). There are several articles, but I will use this one from




















Get link





Facebook





X





Pinterest





Email





Other Apps




Comments





Post a Comment



Popular posts from this blog




java - org.apache.http.ProtocolException: Target host is not specified -



-



March 15, 2013








    I have written a simple httprequest / response code and I am getting this error below: I used to type in my classpath httpclient, httpcore, common -Codecs and general logging. I am very new to Java and I do not know what's going on here. Please help me.   code:    import org.apache.http.client.HttpClient; Import org.apache.http.client.methods.HttpGet; Import org.apache.http.HttpResponse; Import org.apache.http.impl.client.HttpClientBuilder; Import org.apache.http.Header; Import org.apache.http.HttpHeaders; Public class UnshorteningUrl {public static zero main (string [] args throws exception {HttpGet request = zero; HTTP Client Client = HTTP ClientBuilder.credit (). Build (); Try {Request = New HTTP Gate ("trib.me/1lBFzSi"); HttpResponse httpResponse = client.execute (request); Header [] header = httpResponse.getHeaders (HttpHeaders.LOCATION); // Preconditions.checkState (headers.length == 1); String new url = header [0] .getValue (); System.out.println ("new url...





Read more





java - Gradle dependencies: compile project by relative path -



-



July 15, 2015








    Is it possible to specify a dependency on another gradeal project in the granular (in android studios) outside the current project limits? For example, with a relative path like this:    dependence {collection project ('../../ stdlib / dagger'}}       MyApp (path / user / foo / workspace / mypad)   The app (Path / User / Foo / Workspace / MyPass / App)      And I have an Android Library Project with 3 subdomules:    stdlib (path is / user / foo /   Utilities (Path / User / Foo / Workspace / Stadlib / Utilis)   http (Path / User / Foo / Workspace / Stadlib / HT)  / Li>     What I have to do is compile the Dagger, Util, http module in the MyApp project.   The Stidelib Library module under heavy development And MyApp will grow in the form of Growth, so I do not want to push them into a Mewen repository. I am a little change.   is likely to add another Gredle projects in some way? I will push the study library into the Maven repository after the source is in search of a temp...





Read more





ruby on rails - Object doesn't support #inspect when used with .include
-



-



April 15, 2015








    So I have participated in a glitch error that I do not even know how to debug. I am very new to the railing, so it has kicked my ass well when I use the  .includes (school)  seen by the student, it gives a blue box error, But when I look at any other model and  .includes (school) , the school works just fine.    class student & lt; ActiveRecord :: Base has has_many: relationships, foreign_key: "liker_id", dependent :: has_many: matches, foreign_key: "student_1_id", dependent :: deleted belong_to: school belong_to: conference belong_to: would_you_rather belong_to: home city belong_to: year is_to: Major and class school & lt;    on the console    activatecord :: Affiliate for the base: conference includes: respondent, class: "school", foreign_key: "rival_id" (e.g. For: School) Select    SQL generated    Select "School". * "School" from "school" "ID" IN (1)    error message back    NoMethodError: u...





Read more

Search This Blog

Sign

java - Reading data from HDFS - my program can't find the path -

Comments

Post a Comment

Popular posts from this blog

java - org.apache.http.ProtocolException: Target host is not specified -

java - Gradle dependencies: compile project by relative path -

ruby on rails - Object doesn't support #inspect when used with .include -