xdas.processing#

Functions#

process(atom, data_loader, data_writer)

Execute a chunked processing pipeline.

`DataArrayLoader`(da, chunks[, max_buffers, ...])	A class to handle data chunked data ingestion.
`RealTimeLoader`(path[, engine])	Real-time `DataArray` loader that watches a directory for new files.

Total bytes of the underlying DataArray.

`DataArrayWriter`(dirpath[, encoding, ...])	A class to handle chunked data egress.
`DataFrameWriter`(path[, parse_dates, create_dirs])	A class for writing pandas DataFrames to a CSV file asynchronously.
`StreamWriter`(path, dataquality[, kw_merge, ...])	A class for writing obspy Streams to miniseed files asynchronously.
`ZMQPublisher`(address[, encoding])	A class for publishing DataArray chunks over ZeroMQ.
`ZMQSubscriber`(address)	A class for subscribing to DataArray chunks over ZeroMQ.

`DataArrayWriter.submit`(chunk)	Asynchronously write chunk to disk and register the path for later concat.
`DataArrayWriter.write`(chunk)	Alias for `submit()`.
`DataArrayWriter.shutdown`()	Shut down the internal thread pool.
`DataArrayWriter.result`()	Flush all pending writes and return the concatenated `DataArray`.

`ZMQPublisher.submit`(da)	Send a DataArray over ZeroMQ.
`ZMQPublisher.write`(da)	Alias for `submit()`.
`ZMQPublisher.result`()	Return `None` — ZMQPublisher has no aggregated result.