Saturday, November 26, 2011

Boardgames / RPGs anyone?

Now for something completely different: KR is over and free time might become a bit less impossible to obtain, so I've got to ask:

Is anyone else interested in boardgames or role playing games among us? Want to start a game group for one of these?

Additional details: From boardgames I'm mostly interested in eurogames (Catan, Puerto Rico etc), although I'm willing to play pretty much anything. For RPGs, I'm currently mostly into indie narrativist games (eg Dogs in the Vineyard) and horror games; but, again, I'm willing to play pretty much anything.

Thanks for reading (and apologies if this is spam to you),
-Nikolas

Friday, November 25, 2011

ELPL - Empirical findings

Hey peeps,

While sifting through the masses of documents about assignment 1, we found that we have to list some empirical findings about the probabilities of words and productions. I've attached our findings in a document. Could anyone check if it matches your own findings?

https://docs.google.com/open?id=0B5e7DAOiLEZwYjhjODFkZGQtMjI1My00Mjg2LTgzY2UtOGYxZjA3OTdjNGQ0

Cheers

Tuesday, November 22, 2011

Off topic: ice skating near the UVA

Hey guys, its been a while since we got together and did something informal/fun as a group. So far its mainly been work work work and the occasional ping pong game... So I was thinking, why don't we do something again sometime soon like next week when we're not so busy (i.e. once we have gotten the KR exam and ELPL deadline out of the way).

My suggestion: there's a pretty big outdoors ice skating track about 10 minutes walking from Science Park (its called Jaap Eden for those who want to check it out - only available in Dutch though). I've heard from others that they had an enjoyable time there and its not really that expensive: renting a pair of skates costs around 5-6 euro and the entrance fee is about 3 euros per student if I purchase a bunch of entrances in one go and get major discount. Maybe we could go there on an afternoon for a couple of hours when we're not busy with studying...

Below in the table are the opening hours for the outdoors ice skating track:



There's also a big indoor ice skating hall at that location, which is open from 13:00-15:45 every day (in the weekend its open at 12:00). So if its raining then thats an alternative.


So I was thinking Monday afternoon would be a good time to go as we don't have class at that time. We could skate, eat something and afterwards either go home or skate some more ;) But of course, this is just my suggestion, if anyone else has any other activities in mind feel free to share.
I will probably be buying a pack of entrances for the ice skating regardless if we organize an AI field trip or not, so anyone who is interested in going skating soon (even if you want to go on your own) then let me know, you could buy the ticket off me and get like €2.10 discount :P



ps: if Nikolas or anyone else can create an off-topic tab for the blog then that'd be great so that we can keep the informal stuff together in one place. I tried but didn't manage to figure out how to do it.

Friday, November 18, 2011

CYK and unit rules

There was some heated discussion on CYK and unit production rules during today's ELPL lab session. In essence, the CYK algorithm expects all the grammar rules to be in the form A -> B C except for when words (terminals) are produced in which case it expects them to be in the form A -> a. This is known as the Chomsky Normal Form (CNF),

However, as we have all seen, our treebanks are not like that; there are some unit productions. I spent some time making up variations of CYK that would work with less strict assumptions but to no avail. It really felt that the problem isn't something that can be easily overcome with a simple hack. From what I could tell, there was some deeply ingrained constraint that probably makes it impossible for any simple modification of CYK to work with a grammar like the one we have.

Still, not all hope is lost. Wikipedia says:
Any context-free grammar can be represented in CNF
I suppose that, by extension, this must be true for PCFGs as well. So, in essence, we should be able to find an algorithm to transcribe our syntax trees and/or grammar to this form, with no loss of information, right? It seems that this might be our best bet. Wikipedia again suggests one. The same algorithm (and some motivation on why it works) can be found in Michael Sipser's "Introduction to the Theory of Computation".

However, this transcription to the CNF might introduce new symbols or merge existing ones. That could pose a problem with the evaluation later because the parsing is expected to produce syntax trees that use the same terminology as the ones in the training dataset.

But! If I understand the algorithm correctly, the only contentious point is when eliminating rules of the form A -> B C D ... which introduces new symbols. Luckily, we don't have any rules in that form.

So, we could just go through the grammar and each time we find a unit rule, A -> B, we remove it. Then, for each rule in the form B -> u (where u is a string that can be composed of terminal and non-terminal symbols) we add the rule A -> u, unless it's one of those unit rules we removed before. This is repeated until no unit rules are left.

A possible issue with the above approach is how to deal with the frequencies / probabilities of these rules. How are we supposed to decide the probabilities of the new rules based on the removed ones? Other than this one thorn, do you think this is a good solution?

Saturday, November 12, 2011

Bayesian inference and neuroscience

 I watched this great talk given by Daniel Wolpert the other day, titled The real reason for brains. It included some stuff on Bayesian inference that are pretty relevant with what we're doing at the university, especially MLPR. I hope you like it:

Friday, November 11, 2011

CYK for dummies

Hi guys,

here I share a nice PDF (tnx Mihai!) about the CYK algorithm:


The tables shown in the document (1.2, CYK by example) are very useful to understand the idea behind the algorithm, I think that the key point to quickly understand them is just being aware that, for a sentence S, each cell (X,Y), represents the sub-string of S starting with the word X and having length Y.

Enjoy :-)
Dario

 Edit: Additional resources from the comments, credit goes to Robrecht:
Edit again: Even more stuff, credit goes to Wenjin:

someone to make a 2- student group with, Elements of Language Processing and Learning- first assignment

Hi all,
I am a second year student of the Master of Logic. I am taking the AI course Elements of Language Processing and Learning, taught by Khalil Sima'an.

I am looking for a student I can make a group with since the student I was working with decided to drop the course. Is there someone who is still working alone? In the case, I would be happy if you could contact me as soon as possible.

Thank you,
Alessandra

Tuesday, November 8, 2011

Using Git

Hi all,

I am running into some problems with git+google code and thought that maybe someone here knows what to do?

robrecht@robrecht-laptop:~/Dropbox/MSc/ELP$ git clone https://code.google.com/p/elpl-cykparser/
Initialized empty Git repository in /home/robrecht/Dropbox/MSc/ELP/elpl-cykparser/.git/
warning: You appear to have cloned an empty repository.
robrecht@robrecht-laptop:~/Dropbox/MSc/ELP$ cd elpl-cykparser/
robrecht@robrecht-laptop:~/Dropbox/MSc/ELP/elpl-cykparser$ git add *
robrecht@robrecht-laptop:~/Dropbox/MSc/ELP/elpl-cykparser$ git commit -m "Test"
[master (root-commit) c08045f] Test
1 files changed, 56 insertions(+), 0 deletions(-)
create mode 100644 CFG_parser.py
robrecht@robrecht-laptop:~/Dropbox/MSc/ELP/elpl-cykparser$ git push
fatal: https://code.google.com/p/elpl-cykparser//info/refs not found: did you run git update-server-info on the server?

I don't think google really needs to update their servers for this :P

So the creation of the repository works, adding files works and committing the changes works, but when I want to push it, it fails.

Anyone any idea?

thanks in advance!

Feedback on MAS2

Tijmen,

In principle I don't provide feedback on assignment 2, but if you'd like feedback drop me a line.

You're right about assignment 1; I updated your grade on Blackboard. Your final grade is not affected.

Cheers
/``````````````````````````````````````````````````````````````````````````````````
MASS spam Matthijs' mailbox now with requests on feedback! :P

Sunday, November 6, 2011

Share your expert retrieval reports

I just finished the report and sent it. Judging from the effort spent working on this and the grade from last time, it's probably not very good. But seeing that no one has shared their report so far, it should be better than nothing.


Feel free to edit this post and add your report in the list above.

Friday, November 4, 2011

Normalization + merge script

Yo men,

I just coded a script that normalizes the results of a trec query, for IR; I link the code here, maybe it will be time-saving for someone..

update: added the merge script, for the wheighted merging of N result lists (usage and some more information inside the script)

trec_norm.py
trec_merge.py

Thursday, November 3, 2011

IMS Reader

Seems like the 2010 reader that's on blackboard doesn't work. Has anyone been able to download it? Is there going to be a new one for 2011?

In the meantime, you can still find the old 2009 reader at Gever's site. It even has two versions, one low resolution and one high resolution. Neat.

Don't thank me; instead direct your thanks to Gabriel and the teacher assistant who discovered this.

Wednesday, November 2, 2011

IMS schedule for non-Outlookers

Professor Gevers just sent the IMS schedule via email; you may have received the winmail.dat file containing the attachment, which can be handled only by a MS Outlook-compatible mail client.. For those not provided with such a client, I link the content:

Schedule.ppt

Bye,
Dario

P.S. This may be useful in case of "winmail.dat": http://www.winmaildat.com/ :-)

P.P.S The result for MAS exam are available on Blackboard!

Tuesday, November 1, 2011

Pursuit domain exercises: post-mortem

How did everyone like the MAS assignments?

I thought they were pretty nice. I especially liked how you were allowed to experiment a bit and figure stuff on your own. I enjoyed coming up with wacky algorithms or wacky improvements/variations to given algorithms.

I didn't like the competitive element (but maybe that's because I don't like losing? :P) with the capture times and whatnot. And I really didn't like debugging technicalities that had more to do with the limitations of the package we had to build on than anything else.

Anyway, I decided to make all my code publicly available. I used version control, so you can even see what improvements I made in each version (also, how I left both assignments for the last minute). I also uploaded both reports, which you can find in the downloads section. Here's the main page:

Inflation?

I was wondering whether this reduction of KR to only 4 weeks also results in a worse service of the university towards the students in the sense of teaching hours. I tried to look up the old schedule (of the last years) but it seems that those links on http://rooster.uva.nl/ only lead to empty pages, although loading this empty page takes a while...

Anyway, when comparing KR with ELPL I figured that there are less teaching hours for KR, of course.
According to my calculation ELPL has 24 hours of lectures and labs, where KR only has 14 hours. Please correct me if I'm wrong.

Well of course, we should be happy about that, otherwise it might be extremely stress full. Really? What are these video lectures good for? A replacement?

Hmm, what am I paying more than 1700€ a year for??

IR Assignment 2.

Hi all.

Once more, something completly abstract and incoherent... This is way too thoretical, for even the practical part to make any sence.
So, in a few words to wrap-up:

"What the hell are we supposed to do?"

Sentences like "It is up to you to come up with a way of doing this" or "the data gives you a lot of freedom as to what you want to look at in this assignment" or "you can try very different experiments to get there" or "and much, much more".

You know, I am used to having to do something under strict specifications and explicit requirements.
e.g. Use this. Do that. Find 1, 2, 3. Build 4, 5, 6.

The endless freedom of specifications and the randomly seeming resources given for this assignment, really frustrate me... I need to work in something solid!