Semantic Graphs and Examples

You've got to admit it, graphs have an allure that terms do not have. From silly graphs like

to matters of life and death graphs like

people simply love the stuff. Terms, even the lambda-calculus ones, do not have such an appeal.

So it makes some sense to see if we can capitalize on graphs' affordances for Natural Language semantics, of the style we like.

This is a guest blog post by Dick Crouch. Nah, I lie. It's the mathematics of his stuff that I am trying to understand. There is a collection of slides in the archive of the Delphi-in meeting in Stanford, summer 2016 too (Standardizing Interface Representations for Downstream Tasks like Entailment or Reasoning), but the notes are older, from May 2015.

These are notes towards a proposal for a graphical semantic representation for natural language. Its main feature is that it layers a number sub-graphs over a basic sub-graph representing the predicate-argument structure of the representation. These sub-graphs include:

• A context / scope sub-graph. This represents the structure of propositional contexts (approximately possible worlds) against which predicates and arguments are to be interpreted. This layer is used to handle boolean connectives like negation and disjunction, propositional attitude  and other clausal contexts (belief, knowledge, imperatives, questions, conditionals), and quantifier scope (under development). The predicate-argument and context graphs go hand in hand, and one cannot properly interpret a predicate-argument graph without its associated context graph.
• A property sub-graph. This associates terms in the predicate-argument graph with lexical, morphological, and syntactic features (e.g. cardinality, tense and aspect morphology, specifiers)
• A lexical sub-graph. This associates terms in the predicate-argument graph with lexical entries. There will can be more than one lexical sub-graph for each word, and it is populated by the  concepts, and semantic information obtainable from a knowledge base such as Princeton WordNet, for example.
• A link sub-graph. This contains co-reference and discourse links between terms in the pred-arg graph. (It has also been used in entailment and contradiction detection to record term matches between premise and conclusion graphs)
• Other sub-graphs are possible. A separate temporal sub-graph for spelling out the semantics of tense and aspect is under consideration.

This proposal has been partially implemented, and appears to have some practical utility. But theoretically it has not been fully fleshed out. These notes do not perform this fleshing out task, but just aim to describe some of the motivations and issues.

To give an initial idea of what these graphs are like, here are some  examples showing the basic predicate-argument and context structures for some simple sentences. The predicate-argument nodes are shown in blue, and the contexts in grey.

 

1. John did not sleep.

produces the graph above. All sentences are initially embedded under the true context (t) -- on the top right. However, the negation induces a new context embedded under t. In this negated context, an instance of the concept "sleeping by John" can be instantiated. But the effect of the "not" link between t and the embedded context means that this concept is held to be uninstantiable in t.

Every context will have a context-head (ctx_hd) link to a node in the predicate argument graph. The node in the predicate argument graph represents a lexical concept (possibly further restricted by syntactic arguments). The context head concept is always held to be instantiable in its corresponding context. But whether it continues to be instantiable in sub- or super-ordinate context depends on the kind of link between the contexts.

Not explicitly shown in this graph, but present in the actual graphs are further non-head links from each predicate-argument term to their introducing contexts.

If you want to relate this to Discourse Representation Structures, you can see the context labels as being the names of DRS boxes.

2. John believes that Mary does not like him.

This is a slightly more complex example where we can see that the word "believe" introduces an additional context for the complement clause "Mary does not like him". In the t context, there is a believing by John of something. What that something is is spelled out in the clausal context (ctx_5x1), which is a negation of the clausal context "Mary likes him". The example also show a co-reference link between the subject of believe and the object of like.

3. John or Mary slept.

This illustrates the treatment of disjunction. Like negation, disjunction is viewed as a context introducer (i.e. natural language disjunction is inherently modal / intensional, unlike disjunction in classical propositional or first-order logic). The way to read the graph is that there is some group object that is the subject of sleep. Both the group object and the sleeping by the group object are asserted to be instantiable in the top level context. The group object is further restricted by its membership properties: in one context John is an element of the object, and in another Mary is an element of the group object.

4. John loves Mary.

ok, I bet this one got you by surprise!

Just for the hell of it this time here is a fuller graph for a simpler sentence, showing the other lexical and property sub-graphs. The "lex" arcs point to possible word senses for the predicate-argument terms. Not shown in the diagram is that the labels on the sense nodes encode information about the  taxonomic concepts associated with the word senses. Likewise not illustrated in any of these graphs is the fact the predicate-argument node labels encode things like part of speech, stem and surface form, position in sentence, etc.
 

The way these graphs are  obtained is completely separable from, and less important than an abstract definition of semantic graph structures that allows one to specify how to process semantics in various ways (e.g. direct inference on graphs, conversion of graphs to representations suitable for theorem proving, etc.).

Maybe you think that the use of transfer semantics as above seems like  an overkill, at least for the purposes of providing inputs for natural language inference. The transfer semantic pipeline was originally set up to ease the conversion of linguistic semantic representations onto more canonical knowledge representations. As such, there is considerable emphasis on normalizing different semantic representations so that wherever possible the same content is represented in the same way: this simplifies conversion to KR. 

But  maybe there is no particular reason to do all this normalization on the inputs if all you wanted to do was inference. It might  be better to figure out a lighter-weight process for adding extra layers of semantic information direct to dependency structure produced by the parser. Much like many others are doing nowadays.

But the kinds of representations that make sense for inference, this is indeed something that it is worth thinking hard about.

Goods and Services

This chart explains a lot. Toys really got much cheaper. And the absurd price of college fees and medical care is really true.
Shame it does not calculate (and I have never seen numbers for)  externalities. but then, how could we calculate them?

Why are Google and others making their AI tools open?

Roger K. Moore (husband's ex-boss) tweeted in May 2016:

Of course they're happy to release their tools, they're sitting on all the data needed to use them effectively

but of course this explains why they can do it, without bad consequences for themselves. 

It doesn't explain why they do it.

The obvious explanation is that perhaps some of the clever clogs around  will find newer means of making more money.

Anyways, they say (Open Source Projects Are Transforming Machine Learning and AI)

 "open source tools are arriving that can run on affordable hardware and allow individuals and small organizations to perform prodigious data crunching and predictive tasks" 

and separating fact from hype is every time harder.

Meanwhile it makes sense to pay attention to

How You Speak To Siri & Alexa Matters More Than You Think — Here's Why

 

 

Papers about Constructive Modal Logics

I am trying to organize my papers  by subject, so that I can have a clear view of stuff I still want to do. I got hold of all Google Scholar knows about my publications and made it into a bib file and was pleasantly surprised to  find 126 "things". I could be much worse, I say. 

For work in constructive modal logic, it all started when Gavin and I had a paper that he presented in Amsterdam, in a conference called "Logic at Work", I think. I believe this was in 1992. Because publications sometimes get completely out of whack, this only appeared in Studia Logica in 2000. For the time being, I  simply grab the list from Scholar, to mull it over.

1. Gavin M Bierman and V C V De Paiva. Intuitionistic necessity revisited. School of Computer Science Research Reports, University of Birmingham CSR, 1996. 

2. Neil Ghani, Valeria de Paiva, and Eike Ritter. Explicit substitutions for constructive necessity. In ICALP International Conference on Automata, Languages and Programming, 1998. 

3. P Nick Benton, Gavin M. Bierman, and Valeria CV de Paiva. Computational types from a logical perspective. Journal of Functional Programming, 8(02):177–193, 1998. 

4. Natasha Alechina, Valeria de Paiva, and Eike Ritter. Relating categorical and Kripke semantics for intuitionistic modal logics. In Proceedings of the Conference on Advances in Modal Logic (AIML’98), Uppsala, Sweden. CSLI, 1998.  (buggy, corrected in #7 below)

5. Gavin M. Bierman and Valeria C.V. de Paiva. On an intuitionistic modal logic. Studia Logica, 65(3):383–416, 2000. 

6. Gianluigi Bellin, Valeria de Paiva, and Eike Ritter. Extended Curry-Howard correspondence for a basic constructive modal logic. In Proceedings of Methods for Modalities, 2001. 

7. Natasha Alechina, Michael Mendler, Valeria de Paiva, and Eike Ritter. Categorical and Kripke semantics for constructive S4 modal logic. In  Computer Science Logic, pages 292–307. Springer Berlin Heidelberg, 2001. 

8. Valeria de Paiva. Natural deduction and context as (constructive) modality. In International and Interdisciplinary Conference on Modeling and Using Context, pages 116–129. Springer Berlin Heidelberg, 2003. 

9. Valeria de Paiva, Rajeev Gore, and Michael Mendler. Modalities in constructive logics and type theories. Journal of Logic and Computation, Special Issue, 2004. 

10. Michael Mendler and Valeria de Paiva. Constructive CK for contexts. In Proceedings of the first Workshop on Context Representation and Reasoning-CONTEXT05, Stanford, 2005. 

11. Valeria de Paiva. Constructive description logics: what, why and how. Context Representation and Reasoning, Riva del Garda, 2006. 

12. Valeria de Paiva and Eike Ritter. Basic constructive modality. Logic without frontiers: Festschrift for Walter Alexandre Carnielli on the occasion of his 60th birthday. College Publications, pages 411–428, 2011. 

13. Valeria de Paiva and Brigitte Pientka. Intuitionistic Modal Logic and Applications (IMLA 2008). Information and Computation, 209(12):1435–1436, 2011. 

14. Valeria de Paiva and Natasha Alechina. Contextual constructive description logics. ARCOE-11, page 16, 2011. 

15. Valeria de Paiva. Contexts for quantification. Proceedings of CommonSense, 2013. 

16. Valeria de Paiva, Mario Benevides, Vivek Nigam, and Elaine Pimentel. Proceedings of the 6th Workshop on Intuitionistic Modal Logic and Applications (IMLA 2013) in association with UNILOG 2013. Electronic Notes in Theoretical Computer Science, 300:1–104, 2014. 

17. Charles Stewart, Valeria de Paiva, and Natasha Alechina. Intuitionistic modal logic: A 15-year retrospective. Journal of Logic and Computation,  exv042, 2015. 

Remembering Grisha Mints

This is the text of a short eulogy that I delivered on the 2nd Sept 2014, in honour of Professor Grigori Mints. This was over skype for a session part of WOLLIC 2014 in Valparaiso, Chile.

Ruy de Queiroz, Grisha Mints and myself organized the volume from the WOLLIC meeting in 2006 at Stanford. We had many other projects that I would've liked to have  completed with Grisha, but that was not to be. I miss him lots!

(a somber mood today for many reasons).

Dear Colleagues,

It's with a heavy heart that I'm joining you over Skype to share one or two quick memories of Grisha Mints.

Grisha was a wonderful teacher and mentor, as I'm sure most of you know.

 Speaking in his seminar (the Logic Seminar in Stanford  has  always been his and Sol's seminar, for me at least), it was always kind of a bit nerve-wrecking as you had this feeling that things would always be checked, because what we do requires this kind of attention to detail in proofs, so you do need to know the details of what you were saying. so you're always (or at least I was) always  afraid you'd be found wanting in rigour or wanting on the quality of your responses or of your explanations,  but you knew you wouldn't be ignored... whether you're talking about baby logic or cutting edge stuff, rigor was and is necessary and expected.

Grisha's love was `tough love', as many of the tributes to him have shown. He was wonderful at asking people what they were doing and why they were doing it, but you had to be prepared to hear that it wasn't worth doing  and why so...

I always knew about this side of his personality, the strict Russian professor, who knew much and did not tolerate fools, as far the mathematics of what we do is concerned.  What I did not know much about, to begin with,  was this other social side of him as the friend, colleague and mentor always willing to give people a helping hand when he knew they needed it.. This is also coming up in all the tributes to Grisha, and I'm one of ones who can  say that when I needed help, (as the start-up I was working on disappeared as part of the big economic crises of 2008), he was there for me, offering me to lecture at Stanford, a sure way to make me more noticed and more employable.  Just the chat we had about it, was already a big boost for my morale, which was in a bad state.. Knowing that he thought I could teach one of his  classes in Stanford did help, as did the classes themselves as they were lots of  fun. For this, as well as everything else, I will always be grateful...

I am only sad that (when looking over all the gmail we exchanged in the last fifteen years) I saw lots of plans and good ideas, some purely mathematical ones, some more about getting other people interested in the subjects of Logic, Language, Computation that you guys are discussing in Valparaiso, that we didn't have the time to do together. I thought we had plenty of time, so many of the things that I would've done with someone else, I didn't do, because I thought they weren't good enough for Grisha. I hope to be able to do  some of this stuff in his honour, but I know that they will have to be  good, very good, as the master did not approve of mathematical frivolities. But this is another, a third important lesson I learned from him directly: do let your ideas fight with other ideas, have the courage of expressing yourself in the seminars and in the discussions. Our field is a difficult one, it's very mixed, you can always have the impression that you know much less than others in the room, but at least we can ask questions and all mathematical questions can be asked. if they are easy we answer quickly and move on, if they're too hard, we acknowledge it and move on to whatever we want to discuss today. Just ask the questions, he said.

Rest in peace Professor Mints, you are very much missed here!

Papers about our Portuguese WordNet

We need to add a proper bibliography to the webpage of our project OpenWordNet-PT.

Here are some things that need to be in there. I guess we should have one list for the work on the resource itself and one for applications? I don't know quite yet.

1. de Paiva, Valeria, Fabricio Chalub, Livy Real, and Alexandre Rademaker. 2016. “Making Virtue Of Necessity: a Verb Lexicon.” In PROPOR – International Conference On the Computational Processing of Portuguese. Tomar, Portugal.Details
2. Chalub, Fabricio, Livy Real, Alexandre Rademaker, and Valeria de Paiva. 2016. “Semantic Links For Portuguese.” In 10th Edition Of Its Language Resources and Evaluation Conference (LREC). Portoroz, Slovenia.Details
3. Real, Livy and Valeria de Paiva, "Plurality in Wordnets". In Proceedings of the LexSem+Logics Workshop 2016,  arXiv preprint arXiv:1608.04767, Tomar, Portugal.
4. de Paiva, Valeria and Livy Real,  "Universal POS Tagging for Portuguese: Issues and Opportunities". In Proceedings of the LexSem+Logics Workshop 2016, arXiv preprint arXiv:1608.04767, Tomar, Portugal.
5. Real, Livy, Valeria de Paiva, Fabricio Chalub, and Alexandre Rademaker. 2016. “Gentle With Gentilics.” In Joint Second Workshop On Language and Ontologies (LangOnto2) and Terminology and Knowledge Structures (TermiKS) (Co-Located with LREC 2016). Slovenia.Details
6. de Paiva, Valeria, Livy Real, Hugo Gonçalo Oliveira, Alexandre Rademaker, Cláudia Freitas, and Alberto Simões. 2016. “An Overview of Portuguese WordNets.” In Global Wordnet Conference 2016. Bucharest, Romenia.Details
7. Real, Livy, Fabricio Chalub, Valeria de Paiva, Claudia Freitas, and Alexandre Rademaker. 2015. “Seeing Is Correcting: Curating Lexical Resources Using Social Interfaces.” In Proceedings Of 53rd Annual Meeting of The Association for Computational Linguistics and The 7th International Joint Conference on Natural Language Processing of Asian Federation of Natural Language Processing - Fourth Workshop on Linked Data in Linguistics: Resources and Applications (LDL 2015). Beijing, China.Details
8. Rademaker, Alexandre, Dário Augusto Borges Oliveira, Valeria de Paiva, Suemi Higuchi, Asla Medeiros e Sá, and Moacyr Alvim. 2015. “A Linked Open Data Architecture for the Historical Archives of the Getulio Vargas Foundation.” International Journal On Digital Libraries 15 (2-4). Springer Berlin Heidelberg: 153–67. doi:10.1007/s00799-015-0147-1.Details
9. Oliveira, Hugo Gonçalo, Valeria de Paiva, Cláudia Freitas, Alexandre Rademaker, Livy Real, and Alberto Simões. 2015. “As Wordnets Do Português.” Oslo Studies In Language 7 (1): 397–424.Details
10. de Paiva, Valeria, Dário Oliveira, Suemi Higuchi, Alexandre Rademaker, and Gerard De Melo. 2014. “Exploratory Information Extraction From a Historical Dictionary.” In IEEE 10th International Conference On e-Science (e-Science), 2:11–18. IEEE. doi:http://dx.doi.org/10.1109/eScience.2014.50.Details
11. Real, Livy, Valeria de Paiva, and Alexandre Rademaker. 2014. “Extending NomLex-PT Using AnCora-Nom.” In Proceedings Of Workshop on Tools and Resources for Automatically Processing Portuguese and Spanish (ToRPorEsp), edited by Laura Alonso Alemany, Muntsa Padró, Alexandre Rademaker, and Aline Villavicencio. São Carlos, Brazil: Biblioteca Digital Brasileira de Computação, UFMG, Brazil. http://www.lbd.dcc.ufmg.br/bdbcomp/servlet/Evento?id=755.Details
12. de Paiva, Valeria, Cláudia Freitas, Livy Real, and Alexandre Rademaker. 2014. “Improving The Verb Lexicon of OpenWordnet-PT.” In Proceedings Of Workshop on Tools and Resources for Automatically Processing Portuguese and Spanish (ToRPorEsp), edited by Laura Alonso Alemany, Muntsa Padró, Alexandre Rademaker, and Aline Villavicencio. São Carlos, Brazil: Biblioteca Digital Brasileira de Computação, UFMG, Brazil. http://www.lbd.dcc.ufmg.br/bdbcomp/servlet/Evento?id=755.Details       
    
    
13. Freitas, Cláudia, Valeria de Paiva, Alexandre Rademaker, Gerard de Melo, Livy Real, and Anne de Araujo Correia da Silva. 2014. “Extending a Lexicon Of Portuguese Nominalizations with Data from Corpora.” In Computational Processing Of the Portuguese Language, 11th International Conference, PROPOR 2014, edited by Jorge Baptista, Nuno Mamede, Sara Candeias, Ivandré Paraboni, Thiago A. S. Pardo, and Maria das Graças Volpe Nunes. São Carlos, Brazil: Springer.Details
14. de Paiva, Valeria, Livy Real, Alexandre Rademaker, and Gerard de Melo. 26ADAD. “NomLex-PT: A Lexicon Of Portuguese Nominalizations.” In Proceedings Of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), edited by Nicoletta Calzolari (Conference Chair), Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, and Stelios Piperidis. Reykjavik, Iceland: European Language Resources Association (ELRA).Details
15. Real, Livy, Alexandre Rademaker, Valeria de Paiva, and Gerard de Melo. 2014. “Embedding NomLex-BR Nominalizations into OpenWordnet-PT.” In Proceedings Of the 7th Global WordNet Conference, edited by Heili Orav, Christiane Fellbaum, and Piek Vossen, 378–82. Tartu, Estonia. http://globalwordnet.org/global-wordnet-conferences-2/.Details
16. Rademaker, Alexandre, Valeria de Paiva, Gerard de Melo, Livy Real, and Maira Gatti. 2014. “OpenWordNet-PT: A Project Report.” In Proceedings Of the 7th Global WordNet Conference, edited by Heili Orav, Christiane Fellbaum, and Piek Vossen. Tartu, Estonia. http://globalwordnet.org/global-wordnet-conferences-2/.Details
17. de Paiva, Valeria, Alexandre Rademaker, and Gerard de Melo. 2012. “OpenWordNet-PT: An Open Brazilian Wordnet For Reasoning.” In Proceedings Of COLING 2012: Demonstration Papers, 353–60. Mumbai, India: The COLING 2012 Organizing Committee. http://www.aclweb.org/anthology/C12-3044.Details
18. de Paiva, Valeria, and Alexandre Rademaker. 2012. “Revisiting a Brazilian WordNet.” In Proceedings of Global Wordnet Conference. Matsue: Global Wordnet Association.Details

Some Workshops we organized:

1.  Logics and Ontologies for Portuguese

November, 21-25th 2011, FGV, Rio de Janeiro.

2. Workshop on Logics and Ontologies for Natural Language (LogOnto)

September 22, 2014, Associated with FOIS2014, Rio de Janeiro.

3. Third Workshop on Logics and Ontologies, 

 First Workshop on Lexical Semantics for Lesser-Resourced Languages

LexSem+Logics 2016

13th July, 2016,Tomar, Portugal.

 

Ada Lovelace Day 2016

 

This year I am honouring Manuela Sobral in my Ada Lovelace Day post.
(phew I almost missed it again!..)

 Just in case you're new to the idea of Ada Lovelace's Day, every one who blogs (even eventually) should post something on 11th October about the achievements of women in Science or Maths. 

Now there's plenty of women doing Category Theory in Portugal and Manuela is partially to `blame' for it. Coimbra University (a beautiful place) has always been very welcoming to women mathematicians, especially category theorists. 

The picture of Manuela  is from the meeting

Categorical Methods in Algebra and Topology

for her 70th birthday in 2014! Thanks Jorge Picado and Maria Manuel Clementino!

I believe I've met Manuela in Montreal at Category Theory 1991, where the picture below was taken. Maria Manual Clementino, who organized the meeting for Manuela is also in the picture, with a young looking me.

For many years, I had a wrong picture in this post, my apologies! 

Thanks Maria Manuel for putting me right.