file_io.cpp File Reference
#include <thrill/vfs/file_io.hpp>#include <thrill/common/string.hpp>#include <thrill/vfs/bzip2_filter.hpp>#include <thrill/vfs/gzip_filter.hpp>#include <thrill/vfs/hdfs3_file.hpp>#include <thrill/vfs/s3_file.hpp>#include <thrill/vfs/sys_file.hpp>#include <tlx/die.hpp>#include <tlx/string/ends_with.hpp>#include <tlx/string/ssprintf.hpp>#include <tlx/string/starts_with.hpp>#include <algorithm>#include <string>#include <vector>
Include dependency graph for file_io.cpp:Go to the source code of this file.
Namespaces | |
| thrill | |
| thrill::vfs | |
Functions | |
| void | Deinitialize () |
| Deinitialize VFS layer. More... | |
| std::string | FillFilePattern (const std::string &pathbase, size_t worker, size_t file_part) |
| FileList | Glob (const std::vector< std::string > &globlist, const GlobType >ype=GlobType::All) |
| Reads a glob path list and deliver a file list, sizes, and prefixsums (in bytes) for all matching files. More... | |
| FileList | Glob (const std::string &glob, const GlobType >ype=GlobType::All) |
| Reads a glob path list and deliver a file list, sizes, and prefixsums (in bytes) for all matching files. More... | |
| void | Initialize () |
| Initialize VFS layer. More... | |
| bool | IsCompressed (const std::string &path) |
| bool | IsRemoteUri (const std::string &path) |
| Returns true, if file at filepath is a remote uri like s3:// or hdfs://. More... | |
| ReadStreamPtr | OpenReadStream (const std::string &path, const common::Range &range=common::Range()) |
| Construct reader for given path uri. More... | |
| WriteStreamPtr | OpenWriteStream (const std::string &path) |
| std::ostream & | operator<< (std::ostream &os, const Type &t) |
