将Spacy文档的一部分提取为新文档

有一个更好的解决方案,使用 as_doc() 在 Span 对象( https://spacy.io/api/span#as_doc ):

nlp = spacy.load('en_core_web_lg')
content = "This is my sentence. And here's another one."
doc = nlp(content)
for i, sent in enumerate(doc.sents):
    print(i, "a", sent, type(sent))
    doc_sent = sent.as_doc()
    print(i, "b", doc_sent, type(doc_sent))

提供输出:

0 a This is my sentence. <class 'spacy.tokens.span.Span'>   
0 b This is my sentence.  <class 'spacy.tokens.doc.Doc'>   
1 a And here's another one.  <class 'spacy.tokens.span.Span'>   
1 b And here's another one.  <class 'spacy.tokens.doc.Doc'>

(为了清晰起见,代码段完整写出-当然可以进一步缩短)

达到目的的一种相当丑陋的方法是构建一个句子列表,并从句子子集构建一个新文档。

sentences = [sent.string.strip() for sent in doc.sents][:100]
minidoc = nlp(' '.join(sentences))

感觉应该有更好的解决方案,但我想这至少可行。

char_end = 200
subdoc = nlp(doc.text[:char_end])