Ming Xu (徐明) shibing624
🐬
shibing624
/ pytorch_pad_pack_minimal.py
Created
April 11, 2020 03:53
— forked from m-k-l-s/pytorch_pad_pack_minimal.py
pytorch: handling sentences of arbitrary length (dataset, data_loader, padding, embedding, packing, lstm, unpacking)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| sort-of minimal end-to-end example of handling input sequences (sentences) of variable length in pytorch | |
| the sequences are considered to be sentences of words, meaning we then want to use embeddings and an RNN | |
| using pytorch stuff for basically everything in the pipeline of: | |
| dataset -> data_loader -> padding -> embedding -> packing -> lstm -> unpacking (~padding) | |
| based mostly on: https://github.com/HarshTrivedi/packing-unpacking-pytorch-minimal-tutorial | |
| pytorch version 1.4.0 | |
| gist url: https://gist.github.com/MikulasZelinka/9fce4ed47ae74fca454e88a39f8d911a | |
| """ |