Adds CsvDataset, which both reads and parses files.
authorRachel Lim <rachelim@google.com>
Tue, 15 May 2018 01:30:49 +0000 (18:30 -0700)
committerTensorFlower Gardener <gardener@tensorflow.org>
Tue, 15 May 2018 01:35:30 +0000 (18:35 -0700)
commit82cea6c11f8e3368f6b22a8833e958ccf38493b9
tree40e56983921d8e7a265745fb0dbf80faec25150d
parent026e00527d2e3133465e6d03f8a1a8d9bbf11799
Adds CsvDataset, which both reads and parses files.
Example usage: dataset = tf.contrib.data.CsvDataset(filenames, record_defaults=record_defaults, **kwargs)
Motivation: Fusing reading and parsing is more performant and correct than the previous canonical CSV parsing flow (`dataset = tf.data.TextLineDataset(filenames).map(lambda l: tf.decode_csv(l, **kwargs))`)

Closes #19077.

PiperOrigin-RevId: 196601381
tensorflow/contrib/cmake/tf_core_kernels.cmake
tensorflow/contrib/data/__init__.py
tensorflow/contrib/data/kernels/BUILD
tensorflow/contrib/data/kernels/csv_dataset_op.cc [new file with mode: 0644]
tensorflow/contrib/data/ops/dataset_ops.cc
tensorflow/contrib/data/python/kernel_tests/BUILD
tensorflow/contrib/data/python/kernel_tests/csv_dataset_op_test.py [new file with mode: 0644]
tensorflow/contrib/data/python/ops/readers.py