Recent Updates

Wayne 7:42 pm on December 4, 2018  

Free text/code online share tools

You can immediately open a browser and share the code/text link with other people. And you do not even need to register account for using .

These are some very useful site for remote sharing something in a prompt or do a very simple phone interview for startup.

  1. https://codeshare.io/
  2. https://www.codepile.net
  3. https://witeboard.com
  4. https://www.skype.com/en/interviews/
  5. Google doc

 

  1. Not free – http://collabedit.com/
  2. Not free – https://coderpad.io
Advertisements
Wayne 7:22 pm on November 30, 2018  

Spoken dialogue system open resources

OpenDial – java

https://github.com/plison/opendial

https://pdfs.semanticscholar.org/7981/324bcad5812ccf789d2091414e19138047dc.pdf

DeepPavlov – Python

https://github.com/deepmipt/DeepPavlov

Jindigo – Java

http://www.speech.kth.se/jindigo/

jVoiceXML – JAVA

https://github.com/JVoiceXML/JVoiceXML

CMU RavenClaw – C++/Perl

https://www.cs.cmu.edu/~dbohus/ravenclaw-olympus/index-dan.html

PED – prolog

http://planeffdia.sourceforge.net/main/

OwlSpeak – Java

https://sourceforge.net/projects/owlspeak/

IrisTK – java

http://www.iristk.net/index.html

InproTK – java python

https://bitbucket.org/inpro/inprotk

Rivr – Java – voiceXML

https://github.com/nuecho/rivr/#overview

 

summary ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

https://github.com/EllaVator/EllaVator/wiki/Open-source-dialog-frameworks

Cloud Commercial like the FB wit.ai, Microsoft LUIS, Nuance and google api.ai

Wayne 6:59 pm on November 30, 2018  

Speech Recognition and Speech Synthesis open resources

CMU-Sphinx  C/C++/JAVA

Kaldi

HTK

Julius

RWTH

simon

iATROS-speech

SHoUT

Zanzibar

OpenIVR

MSDN-SAPI：http://msdn.microsoft.com/zh-cn/library/ms723627.aspx

CMU-Sphinx: http://en.wikipedia.org/wiki/CMU_Sphinx

HTK Toolkit：http://htk.eng.cam.ac.uk/

Julius：http://en.wikipedia.org/wiki/Julius_(software)

RWTH ASR：http://en.wikipedia.org/wiki/RWTH_ASR

http://en.wikipedia.org/wiki/List_of_speech_recognition_software

 

http://ibillxia.github.io/blog/2012/11/24/several-plantforms-on-audio-and-speech-signal-processing/

http://zh.wikipedia.org/wiki/语音识别
http://baike.baidu.com/view/549184.htm

 

 

Wayne 6:51 pm on November 30, 2018  

Speaker Recognition and Diarization open resources

Speaker Recognition

ALIZE/LIA_RAL – C++

https://github.com/ALIZE-Speaker-Recognition/LIA_RAL

SIDEKIT  – python
http://lium.univ-lemans.fr/sidekit/
MSR Identity Toolbox – matlab
Microsoft https://www.microsoft.com/en-us/research/wp-content/uploads/2013/09/MSR-Identity-Toolbox-v1_1.pdf
Kaldi – scripting
Examples
===========================================================================

Discussion

http://habla.dc.uba.ar/gravano/ith-2014/presentaciones/Dehak_et_al_2010.pdf

 

GMM-UBM i-Vector

http://cslt.riit.tsinghua.edu.cn/mediawiki/images/c/cb/131104-ivector-microsoft-wj.pdf

https://people.csail.mit.edu/sshum/talks/ivector_tutorial_interspeech_27Aug2011.pdf

https://speechlab.sjtu.edu.cn/pages/sw121/homepage/2016/05/20/ivector-tutorial/

https://blog.csdn.net/xmu_jupiter/article/details/47209961

https://blog.csdn.net/zhangxueyang1/article/details/66971997

 

Speaker Diarization

LIUM – JAVA

http://www-lium.univ-lemans.fr/diarization/doku.php/welcome

https://github.com/StevenLOL/LIUM

kaldi CALLHOME_diarization – scripting

https://github.com/kaldi-asr/kaldi/tree/master/egs/callhome_diarization

https://github.com/Jamiroquai88/VBDiarization

Pyannote – python

https://github.com/pyannote/pyannote-audio

aalto speech – python for segment

https://github.com/aalto-speech/speaker-diarization

 

 

 

Wayne 10:52 pm on July 20, 2018  

Text structure extract from PDF brainstorming

1. Use existing tools like grobid.

https://github.com/kermitt2/grobid

Use machine learning to get scientific paper structure data.  It has demo page at here, http://cloud.science-miner.com/grobid/ . My tests show that it can extract title and some other data, but still content maybe mixed with footer and headers.  As this one is designed for academic docs, so it may have some issues to other types of PDF.

2. Borrow the ideas like grobid, to build a system to adapt to the PDF types that you use.
Unified format PDf may get better result, but not for general PDF.

3. Convert a PDF to doc file, and then use doc tools to extract content structures out?

 

Some brain storming ideas:

1). Use tool like pdfclown to extract position and style info of the PDF text data.

2). Then for same category PDF share patterned style and positions, we have chance to find the structures of file.

3). And based on the style of text, it is possible have a tree-like text structure, but this tree may not match with the real chapters tree. This method can help on section levels and titles

4). How to find the main content text?
By statistical info of the text font, the biggest portion of the occurrence normally the text content section. As the main content has different styles with other part, it is possible get good result here.

5). By check from bottom of each page to center’s first line, if PDF have many pages and a unified footer format, then it possible to find what style and font is for footer, and possible find out the footer pattern by statistical.

6). Use same trick of footer, it is possible find out the header if page have.

7). If we have position and style info of the PDF text data.
Then we maybe can do classification based on the position and styles training too to find the basic structure of file.

 

Some similar work and papers

a chinese patente for this:
https://patents.google.com/patent/CN107358208A/zh

a ch team works called Xed

https://diuf.unifr.ch/main/diva/research/research-projects/xed
http://diuf.unifr.ch/diva/siteDIVA04/publications/XedDIAL04.pdf

LA-PDFText
https://scfbm.biomedcentral.com/articles/10.1186/1751-0473-7-7
https://github.com/GullyAPCBurns/lapdftext

HP paper
https://www.researchgate.net/publication/220932927_Layout_and_Content_Extraction_for_PDF_Documents
https://link.springer.com/content/pdf/10.1007%2F978-3-540-28640-0_20.pdf

a text classification algorithm
https://www.sciencedirect.com/science/article/pii/S153204641630017X
that follows a multi-pass sieve framework to automatically classify PDF text snippets (for brevity, texts) into TITLE, ABSTRACT, BODYTEXT, SEMISTRUCTURE, and METADATA categories.

Wayne 10:42 pm on July 20, 2018  

Tools for PDF text extract

PDF Tools list

Jpedal (commercial software)
https://www.snowtide.com/ (commercial software)
itext (commercial software)

apache tika

Home

Grobid

LA-PDFText
pdftotext
pftohtml
pdftoxml
PdfBox
pdf2xml
LA-PdfText
PdfMiner
pdfXtk
pdf-extract
pdfx
PDFExtract

Icecite

 

1. Tools compare and benchmark

http://okfnlabs.org/blog/2016/04/19/pdf-tools-extract-text-and-data-from-pdfs.html
http://ad-publications.informatik.uni-freiburg.de/benchmark.pdf

PDF format
https://stackoverflow.com/questions/88582/structure-of-a-pdf-file

2. How to remove the header and footer from PDF

http://www.massapi.com/class/pd/PDFTextStripperByArea.html
https://www.programcreek.com/java-api-examples/index.php?api=org.apache.pdfbox.util.PDFTextStripperByArea
http://what-when-how.com/itext-5/parsing-pdfs-part-2-itext-5/

3. Find paragraph in text

https://stackoverflow.com/questions/39196676/how-to-read-a-paragraph-from-a-file-in-java

https://stackoverflow.com/questions/14990619/getting-paragraph-count-from-tika-for-both-word-and-pdf

4. Find sentences

https://stackoverflow.com/questions/9492707/how-can-i-split-a-text-into-sentences-using-the-stanford-parser

7. Structure extract from PDF

 

https://github.com/kermitt2/grobid
https://diuf.unifr.ch/main/diva/research/research-projects/xed
http://diuf.unifr.ch/diva/siteDIVA04/publications/XedDIAL04.pdf
https://github.com/GullyAPCBurns/lapdftext
https://www.researchgate.net/publication/220932927_Layout_and_Content_Extraction_for_PDF_Documents
https://link.springer.com/content/pdf/10.1007%2F978-3-540-28640-0_20.pdf
https://www.sciencedirect.com/science/article/pii/S153204641630017X