Text summarization (sentence extraction) module with simple HTTP API. (Currently supports Japanese only)

MIT License

• numpy
• scipy
• scikit-learn
• networkx
• flask
• MeCab or janome
• pulp (if you use ILP-based method)

pip install summpy
python -m summpy.server -H 127.0.0.1 -p 8080
curl "https://127.0.0.1:8080/?sent_limit=3&text=要約したい文章を入力。"
# URL encoded version is here.
# curl "https://127.0.0.1:8080/?sent_limit=3&text=%E8%A6%81%E7%B4%84%E3%81%97%E3%81%9F%E3%81%84%E6%96%87%E7%AB%A0%E3%82%92%E5%85%A5%E5%8A%9B%E3%80%82"

• text: text (utf-8)
• algo: (optional)
  • lexrank: LexRank, a graph-based summarization (default)
  • clexrank: Continuous LexRank
  • divrank: (experimental) DivRank (Diverse Rank, graph-based method). Since DivRank aims to provide non-redundant and high coverage information, it is suitable for multi-document summarization.
  • mcp: ILP-based method. Extracts sentences in terms of Maximum Coverage Problem.

Hyper parameters for how many sentences are shown (optional)

• sent_limit: number of sentences (only {lex,clex,div}rank)
• char_limit: number of characters
• imp_require: cumulative scores [0.0-1.0] (only {lex,clex,div}rank)

from (https://blog.recruit-tech.co.jp/2015/08/28/recruit_two_cx/)

curl "https://127.0.0.1:8080/?sent_limit=3&text=突然ですが、リクルートのリボンモデルを耳にしたことはあるでしょうか？..."

{
  summary: [
    "リクルートが提供する多くのサービスが後に言及するカスタマーとクライアント双方のマッチングを実現するサービスと称される背景にはこのリボンモデルがあります。",
    "そしてこのリボンモデルこそ、リクルートにおけるUXデザインそのもの、とも言えることができます。",
    "リボンモデルは国際規格の普及によって生まれた構想ではないものの、リボンモデルの構造はカスタマーとクライアントの体験設計基盤とも捉えることができ、UXデザインの普及・浸透と足並を揃えるかのように組織内に醸成されていきました。"
  ],
  debug_info: {}
}

https://<hostname>:<port>/static/test.html

from summpy.lexrank import summarize

# ensure type(text) is unicode
sentences, debug_info = summarize(
    text, sent_limit=5, continuous=True, debug=True
)

for sent in sentences:
    print sent.strip().encode(encoding)

For further details, see main part of summpy/lexrank.py or mcp_summ.py.

• G. Erkan and D. Radev. LexRank: graph-based lexical centrality as salience in text summarization. J. Artif. Int. Res. 22(1), pages 457-479, 2004. (link)

• Q. Mei, J. Guo, and D. Radev. DivRank: the Interplay of Prestige and Diversity in Information Networks. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '10), pages 1009-1018, 2010. (link)

• H. Takamura and M. Okumura. Text Summarization Model Based on Maximum Coverage Problem and its Variant. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL '09), pages 781-789, 2009. (link)