in this section, you receive characters as they're available, then tokenize the current result to search for the title token ( actually, but you've stripped the brackets as part of tokenization).

1、

tokenization matters a lot for random text collections; in fairness to nltk, its bundled corpora have been packaged for easy and accurate tokenization with wstokenizer().

断词方法对随机文本集合来说至关重要；公平地讲，NLTK捆绑的全集已经通过WSTokenizer（）打包为易用且准确的断词工具。

互联网摘选

2、

secondly, the processing of the data required by search and classification,( in other words, document fetching, tokenization, lemmatization, and so on) is the same to a large extent.

其次，搜索和分类所需的数据处理（换句话说，就是获取文档、识别符号、对变体进行规范化等等）在很大程度上是相同的。

互联网摘选

3、

there's no need for a tokenization phase, and lookahead assertions can be used for a limited degree of context-sensitivity.

没有必要再进行符号化解析，或者用于有限度上下文敏感的前向断言。

互联网摘选

4、

the result is a sequence of line terminators and input characters, which are the terminal symbols for the third step in the tokenization process.

这样的结果就是一些老的行终端结束符和输入字符，这些终端字符对应着第三步标识符符号化的处理。

互联网摘选

5、

user input may be used to adjust filtering and tokenization of the messages.

用户输入的内容可能会用于校正过滤和用于标记消息。

互联网摘选

6、

apple is working with major credit card companies like visa, american express and mastercard to integrate a so-called tokenization system into apple pay.

苹果正在与Visa、美国运通公司（American Express）和万事达等主要信用卡公司合作，将所谓的标记化系统整合进Apple Pay。

互联网摘选

7、

it supports natural language processing like word stem reduction and tokenization in multiple languages.

它支持自然语言处理，比如多种语言中的词根缩减和标记化。

互联网摘选

8、

we are committed to corporate image planning, vi vision, logo design, pictorial design, packaging design, advertising design, corporate image website design services, etc.

我们致力于企业形象策划、VI视觉导入、标志设计、画册设计、产品包装设计、广告设计、企业形象网站设计等服务。

互联网摘选

9、

you had intended to create a new access control file in the already existing subdirectory/ share/ corporate/ website/ root/.

您打算在现存的子目录/share/corporate/website/root/中创建一个新的访问控制文件。

互联网摘选

10、

the structure of corporate website design, page information, and other factors will directly affect the viewer on the whole corporate website as well as the whole enterprise impression.

企业网站的结构设计、页面信息等因素将会直接影响浏览者对企业网站整体乃至整个企业的印象。

互联网摘选

11、

welcome to putra mining corporate website.

欢迎来到太子矿业公司网站。

互联网摘选

12、

furthermore, website design for companies to explore and make a few suggestions, corporate website design process can be used as the reference.

文章在分析国内企业网站设计现状的前提下，对企业网站设计进行探讨，并提出几点建议，可作为企业网站设计过程中的参考意见。

互联网摘选

13、

check out the corporate website.

查看公司网站。

互联网摘选

14、

the corporate website is the first place foreigners will go to find out more information about your business;

企业网站是外国人了解有关你公司商业信息的第一平台；

互联网摘选

15、

at the same time, make oneself an example, first to place their mobile phone number attached to the licensing.

同时以身作则，首先将自己的手机号码贴上去向牌。

互联网摘选

16、

managers to manage subordinates must make oneself an example.

管理者要想管好下属必须以身作则。

互联网摘选

17、

from the perspective of political ecology, gpm is a management tool, an institutional network, and a political culture.

从政治生态角度看，政府绩效管理是管理工具，是制度网络，也是政治文化。

互联网摘选

18、

case in point: align technology, the$ 550 million ( in revenue) maker of invisalign invisible braces, which have transformed orthodontics.

这家隐适美（Invisalign）隐型牙箍制造商年收入5.50亿美元，给牙齿正畸行业带来了颠覆性革命。

互联网摘选

19、

example #2: changing the name of a multi-partition database

例#2：修改多分区数据库的名称

互联网摘选

20、

in addition, automatic storage support has been added for multi-partition databases.

此外，自动存储支持还适用于多分区数据库。

互联网摘选