projects / platform / upstream / pytorch.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 99e28ba) | patch
Adding DataLoader2 class as future replacement of DataLoader (#63523)
authorVitaly Fedyunin <vitaly.fedyunin@gmail.com>
Fri, 20 Aug 2021 16:00:23 +0000 (09:00 -0700)
committerFacebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
Fri, 20 Aug 2021 16:01:55 +0000 (09:01 -0700)
commit5a7133b87fe2fd7d025d36855ed4cc06539a9299
treec8557dd6155fb39e56c7d90ac9a5b156702cfb31tree | snapshot
parent99e28baeba4f1ffb2623e64694b2aac13df5e0fbcommit | diff
Adding DataLoader2 class as future replacement of DataLoader (#63523)

Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/63523

Supports sharding and batching on loader level**
* #63522 Adding IterableAsDataPipe IterDataPipe
usefull for tests and simple cases

Supports sharding and batching on loader level

Test Plan: Imported from OSS

Reviewed By: ejguan

Differential Revision: D30426527

Pulled By: VitalyFedyunin

fbshipit-source-id: e5905d3364c4880e720dd62fb066f08881c71a6e
test/test_dataloader.py diff | blob | history
torch/utils/data/__init__.py diff | blob | history
torch/utils/data/dataloader_experimental.py [new file with mode: 0644] blob
Domain: Machine Learning / ML Framework;