Dionysis Zindros, National Technical University of Athens dionyziz@gmail.com
pseudonymous anonymous web-of-trust identity trust bitcoin namecoin proof-of-burn timelock decentralized anonymous marketplace openbazaar
bue-twitter bue-twitter
bue-twitter
/ chunking-regex.ts
Created
August 15, 2024 09:54
Use regex to do chunking by using all semantic cues
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // Used in https://jina.ai/tokenizer (Aug. 14th version) | |
| // Define variables for magic numbers | |
| const MAX_HEADING_LENGTH = 6; | |
| const MAX_HEADING_CONTENT_LENGTH = 200; | |
| const MAX_HEADING_UNDERLINE_LENGTH = 200; | |
| const MAX_HTML_HEADING_ATTRIBUTES_LENGTH = 100; | |
| const MAX_LIST_ITEM_LENGTH = 200; | |
| const MAX_NESTED_LIST_ITEMS = 5; | |
| const MAX_LIST_INDENT_SPACES = 7; | |
| const MAX_BLOCKQUOTE_LINE_LENGTH = 200; |
bue-twitter
/ web-of-trust.md
Created
June 30, 2020 18:40
— forked from dionyziz/web-of-trust.md