billpku/NER with BERT in Action- set embedding2

Created July 30, 2019 15:00

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/billpku/2f0a136f79aa4631832369d8d0d38205.js"></script>
Save billpku/2f0a136f79aa4631832369d8d0d38205 to your computer and use it in GitHub Desktop.

Download ZIP

Revisions

billpku created this gist Jul 30, 2019.

NER with BERT in Action- set embedding2

-Original file line number
+Diff line change
@@ -0,0 +1,3 @@
+    # Real token mask is 1,pad token(meaning a place holder for the empty space) is 0
+    attention_masks = [[int(i>0) for i in ii] for ii in input_ids]
+    attention_masks[0];