Python – 用于将文本拆分为句子的RegEx(句子标记化)

参见英文答案 > Python split text on sentences                                    10个
我想从一个字符串中创建一个句子列表然后将它们打印出来.我不想用NLTK来做这件事.因此,它需要在句子末尾的句点分割,而不是在小数,缩写或名称的标题上,或者如果句子有.com这是尝试正则表达式不起作用.

import re

text = """\
Mr. Smith bought cheapsite.com for 1.5 million dollars, i.e. he paid a lot for it. Did he mind? Adam Jones Jr. thinks he didn't. In any case, this isn't true... Well, with a probability of .9 it isn't.
"""
sentences = re.split(r' *[\.\?!][\'"\)\]]* *', text)

for stuff in sentences:
        print(stuff)    

示例输出的示例

Mr. Smith bought cheapsite.com for 1.5 million dollars, i.e. he paid a lot for it. 
Did he mind?
Adam Jones Jr. thinks he didn't.
In any case, this isn't true...
Well, with a probability of .9 it isn't.

解决方法:

(?<!\w\.\w.)(?<![A-Z][a-z]\.)(?<=\.|\?)\s

尝试这个.拆分你的字符串.你也可以查看演示.

http://regex101.com/r/nG1gU7/27

标签：python,regex,tokenize,nlp
来源： https://codeday.me/bug/20190923/1815042.html