Uses of Class
org.apache.sysds.runtime.instructions.spark.data.IndexedMatrixValue
Packages that use IndexedMatrixValue
Package
Description
-
Uses of IndexedMatrixValue in org.apache.sysds.runtime.compress
Method parameters in org.apache.sysds.runtime.compress with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionvoidCompressedMatrixBlock.append(MatrixValue v2, ArrayList<IndexedMatrixValue> outlist, int blen, boolean cbind, boolean m2IsLast, int nextNCol) voidCompressedMatrixBlock.slice(ArrayList<IndexedMatrixValue> outlist, IndexRange range, int rowCut, int colCut, int blen, int boundaryRlen, int boundaryClen) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.compress.io
Method parameters in org.apache.sysds.runtime.compress.io with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionlongWriterCompressed.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.controlprogram.caching
Methods in org.apache.sysds.runtime.controlprogram.caching that return types with arguments of type IndexedMatrixValueMethod parameters in org.apache.sysds.runtime.controlprogram.caching with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionvoidCacheableData.setStreamHandle(OOCStreamable<IndexedMatrixValue> q) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.instructions.ooc
Methods in org.apache.sysds.runtime.instructions.ooc that return IndexedMatrixValueModifier and TypeMethodDescriptionPlaybackStream.dequeue()static IndexedMatrixValueOOCEvictionManager.get(long streamId, int blockId) Get a block from the OOC cache (deserialize on read)Methods in org.apache.sysds.runtime.instructions.ooc that return types with arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionPlaybackStream.dequeueCB()CachingStream.findCached(MatrixIndexes idx) CachingStream.get(int idx) CachingStream.getReadStream()PlaybackStream.getReadStream()CachingStream.getWriteStream()PlaybackStream.getWriteStream()CachingStream.peekCached(MatrixIndexes idx) Finds a cached item without counting it as a consumption.Methods in org.apache.sysds.runtime.instructions.ooc with parameters of type IndexedMatrixValueModifier and TypeMethodDescriptionvoidPlaybackStream.enqueue(IndexedMatrixValue t) static voidOOCEvictionManager.put(long streamId, int blockId, IndexedMatrixValue value) Store a block in the OOC cache (serialize once)Method parameters in org.apache.sysds.runtime.instructions.ooc with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionvoidPlaybackStream.enqueue(OOCStream.QueueCallback<IndexedMatrixValue> callback) voidCachingStream.findCachedAsync(MatrixIndexes idx, Consumer<OOCStream.QueueCallback<IndexedMatrixValue>> callback) static voidTeeOOCInstruction.incrRef(OOCStreamable<IndexedMatrixValue> stream, int incr) Increments the reference counter of a stream by the set amount.voidCachingStream.peekCachedAsync(MatrixIndexes idx, Consumer<OOCStream.QueueCallback<IndexedMatrixValue>> callback) Finds a cached item asynchronously without counting it as a consumption.voidCachingStream.setSubscriber(Consumer<OOCStream.QueueCallback<IndexedMatrixValue>> subscriber, boolean incrConsumers) voidPlaybackStream.setSubscriber(Consumer<OOCStream.QueueCallback<IndexedMatrixValue>> subscriber) Constructor parameters in org.apache.sysds.runtime.instructions.ooc with type arguments of type IndexedMatrixValueModifierConstructorDescriptionCachingStream(OOCStream<IndexedMatrixValue> source) CachingStream(OOCStream<IndexedMatrixValue> source, long streamId) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.instructions.spark.data
Methods in org.apache.sysds.runtime.instructions.spark.data that return types with arguments of type IndexedMatrixValueConstructors in org.apache.sysds.runtime.instructions.spark.data with parameters of type IndexedMatrixValue -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.instructions.spark.utils
Methods in org.apache.sysds.runtime.instructions.spark.utils that return IndexedMatrixValueModifier and TypeMethodDescriptionstatic IndexedMatrixValueSparkUtils.toIndexedMatrixBlock(MatrixIndexes ix, MatrixBlock mb) static IndexedMatrixValueSparkUtils.toIndexedMatrixBlock(scala.Tuple2<MatrixIndexes, MatrixBlock> in) Methods in org.apache.sysds.runtime.instructions.spark.utils with parameters of type IndexedMatrixValueModifier and TypeMethodDescriptionstatic scala.Tuple2<MatrixIndexes,MatrixBlock> SparkUtils.fromIndexedMatrixBlock(IndexedMatrixValue in) static Pair<MatrixIndexes,MatrixBlock> SparkUtils.fromIndexedMatrixBlockToPair(IndexedMatrixValue in) Method parameters in org.apache.sysds.runtime.instructions.spark.utils with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionstatic List<scala.Tuple2<MatrixIndexes,MatrixBlock>> SparkUtils.fromIndexedMatrixBlock(List<IndexedMatrixValue> in) static List<Pair<MatrixIndexes,MatrixBlock>> SparkUtils.fromIndexedMatrixBlockToPair(List<IndexedMatrixValue> in) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.io
Methods in org.apache.sysds.runtime.io that return types with arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionReaderBinaryBlock.readIndexedMatrixBlocksFromHDFS(String fname, long rlen, long clen, int blen) Method parameters in org.apache.sysds.runtime.io with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionReaderTextCSVParallel.readMatrixAsStream(OOCStream<IndexedMatrixValue> outStream, String fname, long rlen, long clen, int blen, long estnnz) abstract longMatrixWriter.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) Consumes an out-of-core stream of matrix blocks and writes them to the target output path.longWriterBinaryBlock.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) longWriterBinaryBlockParallel.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) longWriterDelta.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) longWriterHDF5.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) longWriterMatrixMarket.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) longWriterTextCell.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) longWriterTextCSV.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) longWriterTextLIBSVM.writeMatrixFromStream(String fname, OOCStream<IndexedMatrixValue> stream, long rlen, long clen, int blen) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.matrix.data
Methods in org.apache.sysds.runtime.matrix.data that return types with arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionstatic ArrayList<IndexedMatrixValue>OperationsOnMatrixValues.performSlice(IndexedMatrixValue in, IndexRange ixrange, int blen) static List<IndexedMatrixValue>LibMatrixReorg.reshape(IndexedMatrixValue in, DataCharacteristics mcIn, DataCharacteristics mcOut, boolean rowwise, boolean outputEmptyBlocks) MR/SPARK reshape interface - for reshape we cannot view blocks independently, and hence, there are different CP and MR interfaces.Methods in org.apache.sysds.runtime.matrix.data with parameters of type IndexedMatrixValueModifier and TypeMethodDescriptionstatic voidOperationsOnMatrixValues.performMapGroupedAggregate(Operator op, IndexedMatrixValue inTarget, MatrixBlock groups, int ngroups, int blen, ArrayList<IndexedMatrixValue> outlist) static voidOperationsOnMatrixValues.performShift(IndexedMatrixValue in, IndexRange ixrange, int blen, long rlen, long clen, ArrayList<IndexedMatrixValue> outlist) static ArrayList<IndexedMatrixValue>OperationsOnMatrixValues.performSlice(IndexedMatrixValue in, IndexRange ixrange, int blen) static List<IndexedMatrixValue>LibMatrixReorg.reshape(IndexedMatrixValue in, DataCharacteristics mcIn, DataCharacteristics mcOut, boolean rowwise, boolean outputEmptyBlocks) MR/SPARK reshape interface - for reshape we cannot view blocks independently, and hence, there are different CP and MR interfaces.static voidLibMatrixReorg.rev(IndexedMatrixValue in, long rlen, int blen, ArrayList<IndexedMatrixValue> out) static voidLibMatrixReorg.rexpand(IndexedMatrixValue data, double max, boolean rows, boolean cast, boolean ignore, long blen, ArrayList<IndexedMatrixValue> outList) MR/Spark rexpand operation (single input, multiple outputs incl empty blocks)static voidLibMatrixReorg.rmempty(IndexedMatrixValue data, IndexedMatrixValue offset, boolean rmRows, long len, long blen, ArrayList<IndexedMatrixValue> outList) MR rmempty interface - for rmempty we cannot view blocks independently, and hence, there are different CP and MR interfaces.static voidLibMatrixReorg.roll(IndexedMatrixValue in, long rlen, int blen, int shift, ArrayList<IndexedMatrixValue> out) Method parameters in org.apache.sysds.runtime.matrix.data with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionvoidMatrixBlock.append(MatrixValue v2, ArrayList<IndexedMatrixValue> outlist, int blen, boolean cbind, boolean m2IsLast, int nextNCol) voidMatrixCell.append(MatrixValue valueIn2, ArrayList<IndexedMatrixValue> outlist, int blen, boolean cbind, boolean m2IsLast, int nextNCol) abstract voidMatrixValue.append(MatrixValue valueIn2, ArrayList<IndexedMatrixValue> outlist, int blen, boolean cbind, boolean m2IsLast, int nextNCol) static voidOperationsOnMatrixValues.performMapGroupedAggregate(Operator op, IndexedMatrixValue inTarget, MatrixBlock groups, int ngroups, int blen, ArrayList<IndexedMatrixValue> outlist) static voidOperationsOnMatrixValues.performShift(IndexedMatrixValue in, IndexRange ixrange, int blen, long rlen, long clen, ArrayList<IndexedMatrixValue> outlist) static voidLibMatrixReorg.rev(IndexedMatrixValue in, long rlen, int blen, ArrayList<IndexedMatrixValue> out) static voidLibMatrixReorg.rexpand(IndexedMatrixValue data, double max, boolean rows, boolean cast, boolean ignore, long blen, ArrayList<IndexedMatrixValue> outList) MR/Spark rexpand operation (single input, multiple outputs incl empty blocks)static voidLibMatrixReorg.rmempty(IndexedMatrixValue data, IndexedMatrixValue offset, boolean rmRows, long len, long blen, ArrayList<IndexedMatrixValue> outList) MR rmempty interface - for rmempty we cannot view blocks independently, and hence, there are different CP and MR interfaces.static voidLibMatrixReorg.roll(IndexedMatrixValue in, long rlen, int blen, int shift, ArrayList<IndexedMatrixValue> out) voidMatrixBlock.slice(ArrayList<IndexedMatrixValue> outlist, IndexRange range, int rowCut, int colCut, int blen, int boundaryRlen, int boundaryClen) voidMatrixCell.slice(ArrayList<IndexedMatrixValue> outlist, IndexRange range, int rowCut, int colCut, int blen, int boundaryRlen, int boundaryClen) abstract voidMatrixValue.slice(ArrayList<IndexedMatrixValue> outlist, IndexRange range, int rowCut, int colCut, int blen, int boundaryRlen, int boundaryClen) Slice out up to 4 matrixBlocks that are separated by the row and col Cuts. -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.ooc.cache
Methods in org.apache.sysds.runtime.ooc.cache that return types with arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionOOCCacheManager.putAndPin(long streamId, int blockId, IndexedMatrixValue value) OOCCacheManager.putAndPinRaw(BlockKey key, Object data, long size) OOCCacheManager.putAndPinRawSourceBacked(BlockKey key, Object data, long size, OOCIOHandler.SourceBlockDescriptor descriptor) OOCCacheManager.putAndPinSourceBacked(long streamId, int blockId, IndexedMatrixValue value, OOCIOHandler.SourceBlockDescriptor descriptor) OOCCacheManager.requestAnyOf(List<BlockKey> keys, int n, List<BlockKey> sel) OOCCacheManager.requestBlock(long streamId, long blockId) OOCCacheManager.requestBlock(BlockKey key) OOCCacheManager.requestManyBlocks(List<BlockKey> keys) OOCCacheManager.tryRequestBlock(long streamId, long blockId) OOCCacheManager.tryRequestBlock(BlockKey key) OOCCacheManager.tryRequestManyBlocks(List<BlockKey> keys) Methods in org.apache.sysds.runtime.ooc.cache with parameters of type IndexedMatrixValueModifier and TypeMethodDescriptionstatic voidOOCCacheManager.put(long streamId, int blockId, IndexedMatrixValue value) Store a block in the OOC cache (serialize once)OOCCacheManager.putAndPin(long streamId, int blockId, IndexedMatrixValue value) OOCCacheManager.putAndPinSourceBacked(long streamId, int blockId, IndexedMatrixValue value, OOCIOHandler.SourceBlockDescriptor descriptor) static voidOOCCacheManager.putSourceBacked(long streamId, int blockId, IndexedMatrixValue value, OOCIOHandler.SourceBlockDescriptor descriptor) Store a source-backed block in the OOC cache and register its source location. -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.ooc.cache.io
Fields in org.apache.sysds.runtime.ooc.cache.io with type parameters of type IndexedMatrixValueModifier and TypeFieldDescriptionfinal OOCStream<IndexedMatrixValue>OOCIOHandler.SourceReadRequest.targetConstructor parameters in org.apache.sysds.runtime.ooc.cache.io with type arguments of type IndexedMatrixValueModifierConstructorDescriptionSourceReadRequest(String path, Types.FileFormat format, long rows, long cols, int blen, long estNnz, long maxBytesInFlight, boolean keepOpenOnLimit, OOCStream<IndexedMatrixValue> target) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.ooc.cache.legacy
Methods in org.apache.sysds.runtime.ooc.cache.legacy that return types with arguments of type IndexedMatrixValue -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.ooc.memory
Methods in org.apache.sysds.runtime.ooc.memory that return IndexedMatrixValueModifier and TypeMethodDescriptionInMemoryQueueCallback.get()InMemoryQueueCallback.takeManagedResultForHandover()Methods in org.apache.sysds.runtime.ooc.memory that return types with arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionCachedAllowance.get(int index) InMemoryQueueCallback.keepOpen()CachedAllowance.tryGet(int index) Constructors in org.apache.sysds.runtime.ooc.memory with parameters of type IndexedMatrixValueModifierConstructorDescriptionInMemoryQueueCallback(IndexedMatrixValue result, DMLRuntimeException failure, MemoryAllowance allow, long reservedBytes) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.ooc.stream
Methods in org.apache.sysds.runtime.ooc.stream that return IndexedMatrixValueMethods in org.apache.sysds.runtime.ooc.stream that return types with arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionSourceOOCStream.SourceGroupCallback.getCallback(int idx) SourceOOCStreamable.getReadStream()SourceOOCStreamable.getWriteStream()SourceOOCStream.SourceGroupCallback.keepOpen()Methods in org.apache.sysds.runtime.ooc.stream with parameters of type IndexedMatrixValueModifier and TypeMethodDescriptionvoidSourceOOCStream.enqueue(IndexedMatrixValue val) voidSourceOOCStream.enqueue(IndexedMatrixValue value, OOCIOHandler.SourceBlockDescriptor descriptor) Method parameters in org.apache.sysds.runtime.ooc.stream with type arguments of type IndexedMatrixValueModifier and TypeMethodDescriptionvoidSourceOOCStream.enqueueGroup(List<IndexedMatrixValue> values, OOCIOHandler.GroupSourceBlockDescriptor descriptor) -
Uses of IndexedMatrixValue in org.apache.sysds.runtime.util
Methods in org.apache.sysds.runtime.util that return IndexedMatrixValueModifier and TypeMethodDescriptionstatic IndexedMatrixValueUtilFunctions.createIndexedMatrixBlock(MatrixBlock mb, DataCharacteristics mc, long ix) Methods in org.apache.sysds.runtime.util with parameters of type IndexedMatrixValueModifier and TypeMethodDescriptionstatic IndexRangeUtilFunctions.getSelectedRangeForZeroOut(IndexedMatrixValue in, int blen, IndexRange indexRange)