A mathematical model for universal semantics
July 29, 2019 ยท Declared Dead ยท ๐ IEEE Transactions on Pattern Analysis and Machine Intelligence
Repo contents: Basque.nb, Danish.nb, Dutch.nb, English.nb, Finnish.nb, French.nb, German.nb, Hungarian.nb, Korean.nb, Latin.nb, Polish.nb, Russian.nb, SoftwareManual.pdf, SoftwareManual.tex, Spanish.nb, Turkish.nb, WikiQA.nb, WikiSelecta.zip
Authors
Weinan E, Yajun Zhou
arXiv ID
1907.12293
Category
cs.CL: Computation & Language
Cross-listed
cs.AI,
cs.LG
Citations
4
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Repository
https://github.com/yajun-zhou/linguae-naturalis-principia-mathematica
โญ 4
Last Checked
1 month ago
Abstract
We characterize the meaning of words with language-independent numerical fingerprints, through a mathematical analysis of recurring patterns in texts. Approximating texts by Markov processes on a long-range time scale, we are able to extract topics, discover synonyms, and sketch semantic fields from a particular document of moderate length, without consulting external knowledge-base or thesaurus. Our Markov semantic model allows us to represent each topical concept by a low-dimensional vector, interpretable as algebraic invariants in succinct statistical operations on the document, targeting local environments of individual words. These language-independent semantic representations enable a robot reader to both understand short texts in a given language (automated question-answering) and match medium-length texts across different languages (automated word translation). Our semantic fingerprints quantify local meaning of words in 14 representative languages across 5 major language families, suggesting a universal and cost-effective mechanism by which human languages are processed at the semantic level. Our protocols and source codes are publicly available on https://github.com/yajun-zhou/linguae-naturalis-principia-mathematica
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ Computation & Language
๐
๐
Old Age
๐
๐
Old Age
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
R.I.P.
๐ป
Ghosted
Language Models are Few-Shot Learners
R.I.P.
๐ป
Ghosted
RoBERTa: A Robustly Optimized BERT Pretraining Approach
R.I.P.
๐ป
Ghosted
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
R.I.P.
๐ป
Ghosted
Deep contextualized word representations
Died the same way โ ๐ฆด Skeleton Repo
R.I.P.
๐ฆด
Skeleton Repo
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification
R.I.P.
๐ฆด
Skeleton Repo
Deep Learning for 3D Point Clouds: A Survey
R.I.P.
๐ฆด
Skeleton Repo
Adversarial Examples: Attacks and Defenses for Deep Learning
R.I.P.
๐ฆด
Skeleton Repo