GFS Client

Implement a simple client for GFS (Google File System, a distributed file system), it provides the following methods:

1. read(filename). Read the file with given filename from GFS.
2. write(filename, content). Write a file with given filename & content to GFS.

There are two private methods that already implemented in the base class:

1. readChunk(filename, chunkIndex). Read a chunk from GFS.
2. writeChunk(filename, chunkIndex, chunkData). Write a chunk to GFS.

To simplify this question, we can assume that the chunk size is chunkSize bytes. (In a real world system, it is 64M). The GFS Client's job is splitting a file into multiple chunks (if need) and save to the remote GFS server. chunkSize will be given in the constructor. You need to call these two private methods to implement read & write methods.

Example

GFSClient(5)
read("a.txt")
>> null
write("a.txt", "World")
>> You don't need to return anything, but you need to call writeChunk("a.txt", 0, "World") to write a 5 bytes chunk to GFS.
read("a.txt")
>> "World"
write("b.txt", "111112222233")
>> You need to save "11111" at chunk 0, "22222" at chunk 1, "33" at chunk 2.
write("b.txt", "aaaaabbbbb")
read("b.txt")

 思路：注意writeChunk，按照test cases。是可以覆盖原来内容的。

/* Definition of BaseGFSClient
 * class BaseGFSClient {
 *     private Map<String, String> chunk_list;
 *     public BaseGFSClient() {}
 *     public String readChunk(String filename, int chunkIndex) {
 *         // Read a chunk from GFS
 *     }
 *     public void writeChunk(String filename, int chunkIndex,
 *                            String content) {
 *         // Write a chunk to GFS
 *     }
 * }
 */


public class GFSClient extends BaseGFSClient {
    /*
    * @param chunkSize: An integer
    */
    private HashMap<String, List<Integer>> hashmap;
    private int chunkSize;
    public GFSClient(int chunkSize) {
        this.chunkSize = chunkSize;
        this.hashmap = new HashMap<String, List<Integer>>();
    }

    /*
     * @param filename: a file name
     * @return: conetent of the file given from GFS
     */
    public String read(String filename) {
        if(!hashmap.containsKey(filename)){
            return null;
        } else {
            List<Integer> list = hashmap.get(filename);
            StringBuilder sb = new StringBuilder();
            for(Integer index: list) {
                sb.append(readChunk(filename, index));
            }
            return sb.toString();
        }
    }

    /*
     * @param filename: a file name
     * @param content: a string
     * @return: nothing
     */
    public void write(String filename, String content) {
        hashmap.put(filename, new ArrayList<Integer>());
        int start = 0;
        int index = 0;
        while(start < content.length()){
            int end = Math.min(start + chunkSize, content.length());
            String substr = content.substring(start, end);
            writeChunk(filename, index, substr);
            hashmap.get(filename).add(index);
            index++;
            start += chunkSize;
        }
    }
}

 

• 点赞
• 收藏
• 分享
• • 文章举报

flyatcmu 发布了575 篇原创文章 · 获赞 13 · 访问量 17万+ 他的留言板 关注

标签：chunkSize,GFS,chunk,filename,content,Client,String
来源： https://blog.csdn.net/u013325815/article/details/104144082