Thursday, July 18, 2013

Bridge and CommonSense

When I left PARC in May 2008 to try to do Cuil I realized that I didn't want to drop my research in Natural Language semantics. In particular I really wanted to carry on thinking about "proof-theoretic semantics for natural languages", but I was in a bit of a bind, given that I had no system to try experiments on (the Bridge system is proprietary to Xerox) and no people  to do this work with (friends were either in Powerset, a competitor of sorts,  or in PARC trying their own versions).
But I am nothing if not persistent (my dad would say 'teimosa') so I gave a talk about my plans to continue this kind of work at SRI (A Bridge not to far) and wrote a paper about it (Bridges from Language to Logic: Concepts, Contexts and Ontologies).

Later, together with Annie Zaenen, Cleo Condoravdi and Lauri Karttunen, I've been working (as an off campus member) of the Language and Natural Reasoning group. This is fun, we've organized  workshops and are editing a special volume of LiLT. Out of this work I have written a paper on quantification using the kind of logic discussed above, the paper Contexts for Quantification appeared in this year's CommonSense symposium.

Wednesday, July 17, 2013

Particles: Bah!...

I find it kind of difficult to keep two blogs, one at work, one personal...So I have not written much here. Which is just as well, as I have been behind with lots and lots of things to do and very few done. So this is not a proper post, but a 'hang-in-there' post, wait for me, I will be back. Soon. I hope.


 
Tania Rojas-Esponda gave a talk last week at Nuance on questions under discussion and particles. The abstract is below, together with Tania's  short bio, requested by me. This post is simply a page to hang her slides and paper from, before she puts them in her own website.

QUDs and S-trees: Formal tools for reading between the lines in dialogue

Abstract:
A central premise in pragmatics is that additional information can be obtained from utterances by factoring in contextual cues, such as the goals of interlocutors. I will talk about the notion of a Question under Discussion (QUD for short), a question that is seen as guiding the moves of participants in discourse. By leveraging work from the semantics of questions, we can give formal characterizations of the structure of conversation and of speaker cooperation. I will illustrate a variety of ways in which QUDs are useful. These include ambiguity resolution, inference, and new avenues for understanding non-truth-conditional expressions, such as discourse particles.


Bio:
Tania Rojas-Esponda's path started in mathematics (BA Princeton, Part III Univ. of Cambridge, MS Stanford). She later found a way to combine her formal skills with her long-standing passion for languages via the study of linguistics. Currently, Tania is a PhD candidate in the Stanford linguistics department. She has done research in semantics/pragmatics and in phonology. For her thesis, she is investigating formal approaches to understanding discourse particles.
(Cleo Condoravdi, Tania's co-advisor, joined us too)

Monday, July 8, 2013

OpenWN-PT going places...

Really glad to see that, despite its shortcomings, people are finding uses for our free, automatically created version of WordNet, OpenWN-PT described in the paper http://aclweb.org/anthology/C/C12/C12-3044.pdf.
(OpenWordNet-PT: An Open Brazilian Wordnet for Reasoning
Valeria de Paiva, Alexandre Rademaker, Gerard de Melo.)
The first printed version of the work appeared in the Global Wordnet Association meeting:
de Paiva, Valeria, and Alexandre Rademaker. 2012. “Revisiting a Brazilian WordNet”. In Proceedings of Global Wordnet Conference, Matsue, Japan. Global Wordnet Association.

The data on OpenWN-PT can be gotten from Github, http://github.com/arademaker/wordnet-br.

Meanwhile, besides appearing in Wordnets in the world  and  Open Multilingual Wordnet, the OpenWN-PT made it to FreeLing (as can be seen in http://devel.cpl.upc.edu/freeling/svn/trunk/COPYING, and as we were told by Marcos Garcia). Marcos and Pablo Gamallo also have a fairly big Portuguese dictionary incorporated to FreeLing, see their paper

Finally some other open resources for Portuguese (email in Nov, 30, 2012), thanks Claudia!
Onto.PT v.0.4.1: versão actual da ontologia lexical, estruturada
como uma wordnet (synsets + relações), e construída automaticamente a
partir de dicionários e tesauros para a língua portuguesa.
Para descarregar: http://ontopt.dei.uc.pt/index.php?sec=download
Para consultar: http://ontopt.dei.uc.pt/index.php?sec=consultar

- PAPEL 3.2: nova versão da rede lexical desenvolvida no âmbito da
Linguateca, com o apoio da Porto Editora.
Contém triplos semânticos na forma "palavra relação palavra" obtidos
automaticamente através de gramáticas, executadas sobre o conteúdo do
Dicionário PRO da Língua Portuguesa.
Para descarregar PAPEL e gramáticas: http://www.linguateca.pt/PAPEL/

- Redes lexicais extraídas a partir do Dicionário Aberto e do
Wikcionário.PT, seguindo o mesmo procedimento que no PAPEL.
Para descarregar: http://ontopt.dei.uc.pt/index.php?sec=recursos

Saturday, July 6, 2013

NLCS in New Orleans, yeah...

Lately I have been bad at writing blog posts...
Or not writing them, as the case maybe.. Anyways I have recently got back from the Natural Language and Computer Science (NLCS) Workshop that I co-organized with Larry Moss (Indiana University), associated with Logic in Computer Science (LiCS) 2013.

The workshop turned out really well, despite some organizational hazards. As we said in the proposal and call for papers  for the workshop:

Formal tools coming from logic and category theory are important in both natural language semantics and in computational semantics. Moreover, work on these tools borrows heavily from all areas of theoretical computer science. In the other direction, applications having to do with natural language have inspired developments on the formal side. The workshop invites papers on both topics. Specific topics include, but are not limited to:
  • logic for semantics of lexical items, sentences, discourse and dialog
  • continuations in natural language semantics
  • formal tools in textual inference, such as logics for natural language inference
  • applications of category theory in semantics
  • linear logic in semantics
  • formal approaches to unifying data-driven and declarative approaches to semantics



Invited speakers:
Robin Cooper, University of Gothenburg, Sweden.

Ian Pratt-Hartmann, University of Manchester, UK.

Wlodek Zadrozny, UNC, Charlotte, North Carolina.


NLCS Workshop
120 Newcomb Hall
(Building 74 on the Campus Map)


Program


9:00 Valeria de Paiva, Nuance.com
Welcome [Slides]

9:10 Wlodek Zadrozny, University of North Carolina, Charlotte
After Watson [Slides]

10:10 Robin Cooper, University of Gothenburg, Sweden
Adapting Type Theory with Records for Natural Langauge Semantics [Slides]

11:20 Bruno Mery and Christian Retoré, Université de Bordeaux and IRIT, Toulouse
Advances in the Logical Representation of Lexical Semantics [Slides]

1:45 Christophe Fouqueré and Myriam Quatrini, Laboratoire d'Informatique de Paris-Nord and Institut de Mathématiques de Luminy A.N.R. LOCI
Inferences and Dialogues in Ludics [Slides]

2:30 Ian Pratt-Hartmann, University of Manchester
The Relational Syllogistic [Slides]

3:30 Alex Djalali, Stanford University
Extending a Natural Language Proof Theory: On Ordinary Comparatives [Slides]

4:40 Wren Thornton, Indiana University
Chiastic Lambda-Calculi [Slides]
5:30 Larry Moss, Indiana University
Current Work on Natural Logic [Slides]

Sunday, June 16, 2013

Taking Stock

Well, I have not been doing as much as I should, of course.

But since September, 2012 I have already submitted 10 papers, so things could be worse. (and if you count the book edited with Tracy H. King then we're up to eleven possible publications since Sept 2012)

Mostly it's all about old work that I was doing before  joining my new employer Nuance Communications. Actually only one paper is related to my Nuance work, but is still a continuation of the work at PARC. My manager presented this work for me at CommonSense 2013 in Cyprus.

There were the two pieces of work for COLING2012 (Existential Change Transitive verbs and the OpenWordNet-BR),  the three  pieces for Unilog (Contextual Constructive Description Logic with Natasha, a constructive modal temporal logic with Dick, and Glue for Proof Theorists, for Luiz Carlos and Peter Schroeder-Heister "Abstract Proof Theory Workshop"). Then there was the paper on intuitionistic n-graphs with Marcela, the rewriting of the old Linear Logic based Model of State and the work on Contexts for Quantification, submitted to CommonSense. Finally there is some work on lexical resources for Brazilian Portuguese (nominalizations) just submitted by my collaborator Livy Real to STIL 2013. And I submitted the work on Natural Numbers Objects (with Charles Morgan and Samuel Gomes da Silva to the LSFA in Sao Paulo. Of course I don't know how many of these will be accepted or yield new, more exciting work, but I guess my immediate goal of producing more with  new collaborators is going ok...

Sunday, June 9, 2013

Rationality@Stanford

Over the last weekend I was at the

2nd CSLI Workshop on Logic, Rationality and Intelligent Interaction

in Stanford. The program was very diverse and interesting.
I was super happy because CSLI decided to get rid of some of its volumes, so they had a table full of books with a sign "Attendees of the Workshop, please help yourselves". Wow!
Since we have just started our Sunnyvale NLU Research Lab, this was brilliant!

I was also pleasantly surprised by one of the students there starting her talk by saying that  she was glad to see me in the audience, since I had given her her Thesis Project.
And when she talked about it, it was pretty impressive. I had only mentioned the famous Wigner paper,

The Unreasonable Effectiveness of Mathematics in the Natural Sciences,

because I thought the philosophy students needed some exciting stuff to keep them motivated...
In any case this was really very nice!

Saturday, May 4, 2013

Abstract Proof Theory Workshop? Proofs for Linguists!

The second talk I gave at Unilog 2013 last month in Rio was at the Abstract Proof Theory Workshop, on Glue Semantics for Proof Theorists. The slides are here.

I've been meaning to talk about this since 2000, when Sol Feferman sent an email around asking where people thought Proof theory would be going in the new millenium. It sounds a bit quaint now, I know...

But back then I wrote a long email that I guess never got to Sol (he must have dozens of others like that) about Proof Theory in Natural Language Semantics. For me, the whole idea of using proofs in Natural Language derivations of sentencehood was a new thing, then. Something that I learned about from Mary Dalrymple, John Lamping, Vineet Gupta(we had weekly meetings around that time), Anette Frank, Josef van Genabith and especially the husband, Dick Crouch. I also planned to talk about that in Rome, when Claudia Casadio invited me to a workshop there. But I never got to the workshop, I had small kids, and a complicated job then.

Now 13 years later, things are different and what used to be a fringe application of proof theory to Natural Language is quite important, involving the possibility of millions of dollars, perhaps... It's certain that Natural Language is nowadays a sexy area of Computer Science, one where there are jobs, grants and projects. Maybe the symbolic ways of doing it are not that fashionable. But with the amount of interest and kudos sloshing around, surely some can be put into the idea (which I find surprisingly cute) that ambiguity in Natural Language can be cast as the problem of finding all the proofs in Natural Deduction of a certain atomic formula, from a given set of premisses, where cuts with the identity can be added at judicious points.

OK, I know people need more information than this to find it cute and I hope to write some more about it some time soon, but yeah, not only linguists (or computational semanticists) need to know about proofs, they also need to know how to insert into a proof "sensible" cuts with an identity. Now for proof theorists cuts with identity are totally trivial things. You've done your cut-elimination proof when  you get to cuts with identity, you can always add cuts with identity anywhere you want, as they don't change things, so the paradigm has changed completely when you're doing "parsing as deduction". But since these deductions are our kinds of deductions in Glue Semantics (plain Curry-Howard implicational linear logic trees), our theory ought to be able to keep up with this idea...

So just for my own sake, let me rephrase the stuff above. When we study proofs in ND, thinking of the simply typed lambda-calculus as a way of coding (propositional intuitionistic logic) proofs  Curry-Howard style, we know that there are two main paradigms to think about. One is the normalization paradigm: Given a typed term, corresponding to a proof  either from zero or some finite number of assumptions, you try to normalize it and this normalization produces a computation. The second is the proof-search paradigm. Given a typed term with a fixed number of premisses you try to find a proof that produces the given term. Usually in the normalization paradigm you worrry about different derivations, as they correspond to different terms and you have to work to prove that these different terms all reduce to the same normal form, to some essential version. By contrast, in the proof search paradigm, given a collection of assumptions and a formula that follows from them, you are usually happy to find a (or one) proof that these assumptions prove the formula. You know there could be other proofs of the same formula from the same assumptions, but usually you're not worried about finding all the proofs of any given S from a collection of assumptions Gamma.

Some philosophers (like Prawitz himself) might straddle the two paradigms and worry about when two proofs should be considered the same (usually when they're beta equivalent and eta related), but for the linguists pursuing the kind of program sketched above this is crucial. Then need to know all the proofs of S from Gamma and moreover, they need to know which ones they should consider  "the same". Further only in certain bits of the trees corresponding to this proofs, the modifiers (the degenerate trees that correspond to A proves A) can be inserted. So they need to construct all the proofs of S from the given assumptions, they need to decide when two such proofs should be equal (and hence have the same meaning, so we don't count them twice), they need to know where the modifiers can be inserted in an appropriate way, and they need to do it pretty fast. Why? Because if they want to use these trees as their sentence meanings, and if they have any hope of understanding a bit of text and replying to it while someone else is waiting for their system, then they have to be extremely good proof theorists. The problem of finding all the trees (meanings corresponding to the proofs of a sentence) fast  is quite hard and very much the kind of problem that proof-theorists should be able to help with, if they can extend their theory in that direction.