Thrill  0.1
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Groups Pages
file_io.cpp File Reference
#include <thrill/vfs/file_io.hpp>
#include <thrill/common/string.hpp>
#include <thrill/vfs/bzip2_filter.hpp>
#include <thrill/vfs/gzip_filter.hpp>
#include <thrill/vfs/hdfs3_file.hpp>
#include <thrill/vfs/s3_file.hpp>
#include <thrill/vfs/sys_file.hpp>
#include <tlx/die.hpp>
#include <tlx/string/ends_with.hpp>
#include <tlx/string/starts_with.hpp>
#include <algorithm>
#include <string>
#include <vector>
+ Include dependency graph for file_io.cpp:

Go to the source code of this file.

Namespaces

 thrill
 
 thrill::vfs
 

Functions

void Deinitialize ()
 Deinitialize VFS layer. More...
 
std::string FillFilePattern (const std::string &pathbase, size_t worker, size_t file_part)
 
FileList Glob (const std::vector< std::string > &globlist, const GlobType &gtype=GlobType::All)
 Reads a glob path list and deliver a file list, sizes, and prefixsums (in bytes) for all matching files. More...
 
FileList Glob (const std::string &glob, const GlobType &gtype=GlobType::All)
 Reads a glob path list and deliver a file list, sizes, and prefixsums (in bytes) for all matching files. More...
 
void Initialize ()
 Initialize VFS layer. More...
 
bool IsCompressed (const std::string &path)
 
bool IsRemoteUri (const std::string &path)
 Returns true, if file at filepath is a remote uri like s3:// or hdfs://. More...
 
ReadStreamPtr OpenReadStream (const std::string &path, const common::Range &range=common::Range())
 Construct reader for given path uri. More...
 
WriteStreamPtr OpenWriteStream (const std::string &path)
 
std::ostream & operator<< (std::ostream &os, const Type &t)