编程语言
首页 > 编程语言> > Hadoop的JavaAPI

Hadoop的JavaAPI

作者:互联网

1.配置winutil的环境变量

然后在Path变量中加入

 

 

 

2.测试

创建一个普通的Java工程测试

FileSystem fs = null;
    
    @Before
    public void init() throws Exception{
        fs = FileSystem.get(new URI("hdfs://itcast01:9000"), new Configuration(), "root");
    }
    
    @Test
    public void testUpload() throws Exception{
        InputStream in = new FileInputStream("/root/install.log");
        OutputStream out = fs.create(new Path("/log123.log"));
        IOUtils.copyBytes(in, out, 1024, true);
    }
    
    @Test
    public void testMkdir() throws IllegalArgumentException, IOException{
        boolean  flag = fs.mkdirs(new Path("/a/aa"));
        System.out.println(flag);
    }
    
    @Test
    public void testDel() throws IllegalArgumentException, IOException{
        boolean flag = fs.delete(new Path("/a"), true);
        System.out.println(flag);
    }
    
    
    
    public static void main(String[] args) throws Exception {
        FileSystem fs = FileSystem.get(new URI("hdfs://itcast01:9000"), new Configuration());
        InputStream in = fs.open(new Path("/jdk"));
        OutputStream out = new FileOutputStream("/home/jdk1.7.tar.gz");
        IOUtils.copyBytes(in, out, 4096, true);
        
    }

3.处理Java连不上hdfs

①删除tmp(路径是个人安装在linux系统中hadoop下的tmp文件)

 

②修改配置修改namenode的地址为具体IP(之前写的localhost) 修改slaves文件,为具体IP   ③格式化hdfshadoopnamenode–format    

 

标签:fs,void,JavaAPI,Hadoop,Path,new,public,out
来源: https://www.cnblogs.com/xiaojiuguan/p/16184410.html