Thrill  0.1
Public Member Functions | Protected Member Functions | Protected Attributes | List of all members
ReadLinesNode::InputLineIterator Class Reference

Detailed Description

Definition at line 102 of file read_lines.hpp.

+ Inheritance diagram for ReadLinesNode::InputLineIterator:
+ Collaboration diagram for ReadLinesNode::InputLineIterator:

Public Member Functions

 InputLineIterator (const vfs::FileList &files, ReadLinesNode &node)
 
 InputLineIterator (const InputLineIterator &)=delete
 non-copyable: delete copy-constructor More...
 
 InputLineIterator (InputLineIterator &&)=default
 move-constructor: default More...
 
InputLineIterator & operator= (const InputLineIterator &)=delete
 non-copyable: delete assignment operator More...
 
InputLineIterator & operator= (InputLineIterator &&)=default
 move-assignment operator: default More...
 

Protected Member Functions

 ~InputLineIterator ()
 
bool ReadBlock (vfs::ReadStreamPtr &file, net::BufferBuilder &buffer)
 

Protected Attributes

net::BufferBuilder buffer_
 Byte buffer to create line std::string values. More...
 
unsigned char * current_
 Start of next element in current buffer. More...
 
std::string data_
 String, which Next() references to. More...
 
size_t file_nr_
 Index of current file in files_. More...
 
const vfs::FileList & files_
 Input files with size prefixsum. More...
 
common::Range my_range_
 (exclusive) [begin,end) of local block More...
 
ReadLinesNode & node_
 Reference to node. More...
 
const size_t read_size = data::default_block_size
 Block read size. More...
 
common::StatsTimerStopped read_timer
 
size_t total_bytes_ = 0
 
size_t total_elements_ = 0
 
size_t total_reads_ = 0
 

Constructor & Destructor Documentation

◆ InputLineIterator() [1/3]

InputLineIterator ( const vfs::FileList &  files,
ReadLinesNode &  node 
)
inline

Definition at line 105 of file read_lines.hpp.

References ReadLinesNode::InputLineIterator::operator=().

◆ InputLineIterator() [2/3]

InputLineIterator ( const InputLineIterator &  )
delete

non-copyable: delete copy-constructor

◆ InputLineIterator() [3/3]

InputLineIterator ( InputLineIterator &&  )
default

move-constructor: default

◆ ~InputLineIterator()

~InputLineIterator ( )
inlineprotected

Definition at line 159 of file read_lines.hpp.

References DIABase::logger_, and ReadLinesNode::InputLineIterator::read_timer.

Member Function Documentation

◆ operator=() [1/2]

InputLineIterator& operator= ( const InputLineIterator &  )
delete

non-copyable: delete assignment operator

Referenced by ReadLinesNode::InputLineIterator::InputLineIterator().

◆ operator=() [2/2]

InputLineIterator& operator= ( InputLineIterator &&  )
default

move-assignment operator: default

◆ ReadBlock()

bool ReadBlock ( vfs::ReadStreamPtr &  file,
net::BufferBuilder &  buffer 
)
inlineprotected

Definition at line 143 of file read_lines.hpp.

References BufferBuilder::begin(), bytes, BufferBuilder::data(), LOG, ReadLinesNode::InputLineIterator::read_size, and BufferBuilder::set_size().

Referenced by ReadLinesNode::InputLineIteratorCompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed(), ReadLinesNode::InputLineIteratorUncompressed::Next(), and ReadLinesNode::InputLineIteratorCompressed::Next().

Member Data Documentation

◆ buffer_

net::BufferBuilder buffer_
protected

Byte buffer to create line std::string values.

Definition at line 129 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorUncompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed(), ReadLinesNode::InputLineIteratorUncompressed::Next(), and ReadLinesNode::InputLineIteratorCompressed::Next().

◆ current_

unsigned char* current_
protected

Start of next element in current buffer.

Definition at line 131 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorUncompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed(), ReadLinesNode::InputLineIteratorUncompressed::Next(), and ReadLinesNode::InputLineIteratorCompressed::Next().

◆ data_

std::string data_
protected

String, which Next() references to.

Definition at line 122 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed(), ReadLinesNode::InputLineIteratorUncompressed::Next(), and ReadLinesNode::InputLineIteratorCompressed::Next().

◆ file_nr_

size_t file_nr_
protected

Index of current file in files_.

Definition at line 127 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorUncompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed(), ReadLinesNode::InputLineIteratorUncompressed::Next(), and ReadLinesNode::InputLineIteratorCompressed::Next().

◆ files_

const vfs::FileList& files_
protected

Input files with size prefixsum.

Definition at line 124 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorUncompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed(), ReadLinesNode::InputLineIteratorUncompressed::Next(), and ReadLinesNode::InputLineIteratorCompressed::Next().

◆ my_range_

common::Range my_range_
protected

(exclusive) [begin,end) of local block

Definition at line 133 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorUncompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::HasNext(), ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), and ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed().

◆ node_

ReadLinesNode& node_
protected

Reference to node.

Definition at line 135 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), and ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed().

◆ read_size

const size_t read_size = data::default_block_size
protected

Block read size.

Definition at line 120 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorCompressed::InputLineIteratorCompressed(), ReadLinesNode::InputLineIteratorUncompressed::InputLineIteratorUncompressed(), and ReadLinesNode::InputLineIterator::ReadBlock().

◆ read_timer

common::StatsTimerStopped read_timer
protected

Definition at line 137 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIterator::~InputLineIterator().

◆ total_bytes_

size_t total_bytes_ = 0
protected

Definition at line 139 of file read_lines.hpp.

◆ total_elements_

size_t total_elements_ = 0
protected

Definition at line 141 of file read_lines.hpp.

Referenced by ReadLinesNode::InputLineIteratorUncompressed::Next(), and ReadLinesNode::InputLineIteratorCompressed::Next().

◆ total_reads_

size_t total_reads_ = 0
protected

Definition at line 140 of file read_lines.hpp.

The documentation for this class was generated from the following file: