sharpnlp Forum Rss Feed

New Post: The maximum entropy models that you have for download are linked with Reuters Corpus?

tsamers — Wed, 17 Apr 2013 15:47:46 GMT

I have download the maximum entropy models that drive the nlp tools and iam wondering if they linked with data library like Reuters corpus

New Post: Is there a German model and how to add your own abbreviations?

mkimber — Mon, 15 Apr 2013 14:06:21 GMT

I'd be interested in a response to this (also Dutch, French and Spanish lang support)

Thanks

Mike

New Post: Is this project dead?

mwunderlich — Mon, 15 Apr 2013 14:06:06 GMT

Hi all,

In case someone is reading this, I am wondering whether or not SharpNLP is still being actively developed. I posted a question to the forum on 20th of March, to which I haven't received an answer, yet. Also, the last release seems to be from 2006 ?!
So, if SharpNLP is not being developed anymore, are there any good C# alternatives out there? (I am aware of GATE and OpenNLP)

Cheers,

Martin

New Post: Is there a German model and how to add your own abbreviations?

mwunderlich2 — Wed, 20 Mar 2013 19:37:38 GMT

Hi,

I just got started digging into SharpNLP and I am very excited about the possibilities it provides. To get started, I was trying to use the sentence detector and it worked fine on an English text. Is there also a maxent model available for German? Actually, is there a complete list of supported languages somewhere?
I was also wondering how one could provide your own list of abbreviations of the sentence detector to use. Is this possible?

Cheers,

Martin

New Post: An easy(ish) alternative to porting OpenNlp to C#

greeny — Fri, 22 Feb 2013 20:15:09 GMT

Cheers k0ss,

Not really got as much time as i'd like for NLP at the moment, but will give it a try when i can.

Cheers

New Post: An easy(ish) alternative to porting OpenNlp to C#

k0ss — Thu, 21 Feb 2013 19:59:10 GMT

Hello, folks - using parser is straight forward - the same way as you would do in java. Here is an example :

        try
        {
            fileInputStream = new FileInputStream(string.Concat(ModelPath, "en-parser-chunking.bin"));

            try
            {
                ParserModel model = new ParserModel(fileInputStream);
                this.FParser = ParserFactory.create(model);
            }
   var strBldr = new java.lang.StringBuffer();


        string directoryName = Path.GetDirectoryName(Assembly.GetExecutingAssembly().GetName().CodeBase);
        var ModelPath = string.Concat((new Uri(directoryName)).LocalPath, "\\Models\\");

        topParses = ParserTool.parseLine(InputText, FParser, 1);
        foreach (var topParse in topParses)
        {
            topParse.show(strBldr);
        }

        }

It works perfectly fine. Loading model takes about 3-4 seconds however - it looks longer than in native java solution. But parsing time seems fine. No performace testing have been performed so far.

New Post: How can I extract triplet (subject, predicate, object) from sentence using SharpNLP

kathirvel21 — Fri, 04 Jan 2013 12:05:32 GMT

Hello everyone -

I am also working on the extraction of Triplets. Is anybody knows about any tool which generates the triplets from a given sentence? If you know any tool online, please let me know.

Thanks,
Kathir

New Post: An easy(ish) alternative to porting OpenNlp to C#

greeny — Mon, 26 Nov 2012 15:53:04 GMT

Cheers Zuvvy, you're most welcome.

I'm afraid i don't have any spare time to devote to any collaboration at the moment,
but i hope you get some interest.

Cheers
Paul

New Post: An easy(ish) alternative to porting OpenNlp to C#

zuvvy — Mon, 26 Nov 2012 12:13:32 GMT

Much obliged Paul! Exactly what I was looking for.

Anyone else using OpenNlp in .Net potentially looking collaborate on a library?

New Post: How can I extract triplet (subject, predicate, object) from sentence using SharpNLP

Kvadrilius — Wed, 15 Aug 2012 05:28:27 GMT

Hi, everyone!

Can you help me.

Now I am developing program for extracting triplet (subject, predicate, object) from sentence. I read article about extraction http://ailab.ijs.si/delia_rusu/Papers/is_2007.pdf, coded algorithm, but it is not working. Maybe somebody knows how to solve this task using SharpNLP?

New Post: An easy(ish) alternative to porting OpenNlp to C#

DRedding — Wed, 15 Aug 2012 04:25:26 GMT

For what it's worth, i was able to take Paul's version of Open NLP and use it to generate some visuals that are a little easier to interpret (at least for my brain). You can find an example image here

(http://dl.dropbox.com/u/38604282/output.png)

The debugging code is kind of rooted in my application, but i'd be happy to share if anyone is interested.

Thanks!
Dave.

New Post: An easy(ish) alternative to porting OpenNlp to C#

greeny — Wed, 01 Aug 2012 15:53:00 GMT

Hi Dave,
You are most welcome.

Sorry, i got myself in a bit of a muddle with mail.jar there.
You can download javamail1_4_5.zip from
http://www.oracle.com/technetwork/java/javasebusiness/downloads/java-archive-downloads-eeplat-419426.html#javamail-1.4.5-oth-JPR
mail.jar is in that zip file (sorry,i can't give a direct download as you have to accept their t&c's)
It's probably not necessary to include it, but at least you will know it's not that causing your problems.

I can't really help with your main problem, although i have a strong hunch it's something to do with permissions.
Perhaps running a command window as administrator might help.

Glad you could at least run the little demo, you can always use the opennlp.dll from that in your own projects.

Cheers
Paul

New Post: An easy(ish) alternative to porting OpenNlp to C#

DRedding — Tue, 31 Jul 2012 16:11:29 GMT

Hi Paul.

Thanks for the Update!

I'm still running into the same issue as early(Double checking to unblock the zips and doing everything I can to make sure the files are free and clear). But i'll keep plugging away at it.

Edit: I was able to d/l your demo app and run that though. Thanks for all the great help!

One thing I did note is that the D/l of UIMA doesn't seem to have the mail.jar in it's lib folder ( or any folder for that matter). Any advice on where it could be found?

Thanks!
Dave.

New Post: An easy(ish) alternative to porting OpenNlp to C#

greeny — Tue, 31 Jul 2012 11:25:11 GMT

UPDATE FOR VERSION 1.5.2

Hi,
Here is an alternative to to porting the java OpenNlp code to C#.

Using the amazing IKVM http://www.ikvm.net/index.html the java files can be converted to a .Net assembly (dll).
Thus allowing you to use the latest releases of Opennlp from C# (or any other .net language).
I have done this, and so far it is working very well.

Here is a quick guide if you're interested.

(Don't forget to unblock any downloaded files, by right clicking on Zip file – Properties - Unblock)

Download & extract the latest OpenNlp release from http://opennlp.apache.org/cgi-bin/download.cgi . At the time of writing this is apache-opennlp-1.5.2-incubating-bin.zip
The four .jar files (opennlp-maxent-3.0.2-incubating.jar, jwnl-1.3.3.jar, opennlp-tools-1.5.2-incubating.jar, opennlp-uima-1.5.2-incubating.jar ) in the lib folder can be used to compile a .net assembly as follows.

Download & Extract Apache UIMA sdk from http://uima.apache.org/downloads.cgi#Latest%20Official%20Releases At the time of writing this is uimaj-2.4.0-bin.zip

Two jar files required are uima-core.jar and mail.jar in the lib folder
Download & extract the latest IKVM from http://sourceforge.net/projects/ikvm/files/ At the time of writing this is version? ikvmbin-7.1.4532.2.zip
For simplicity, copy the five .jar files above into the ikvmbin-7.1.4532.2/bin folder
From a command window, In the ikvmbin-7.1.4532.2/bin folder use IKVMC & the above five jar files make the opennlp.dll as follows:
ikvmc -target:library -assembly:opennlp opennlp-maxent-3.0.2-incubating.jar jwnl-1.3.3.jar opennlp-uima-1.5.2-incubating.jar opennlp-tools-1.5.2-incubating.jar uima-core.jar mail.jar

Note: There are some errors in the compilation due to missing references log4j-x.x.x.jar & javax.jms.jar but they don't cause a problem & i'm trying to keep things as simple as possble.
Copy the following from the ikvmbin-7.1.4532.2/bin folder to your project folder (or the folder of your choice)
- opennlp.dll (the assembly you have just created)
- IKVM.Runtime.dll
- IKVM.OpenJDK.Core.dll
- IKVM.OpenJDK.Jdbc.dll
- IKVM.OpenJDK.Text.dll
- IKVM.OpenJDK.Util.dll
- IKVM.OpenJDK.XML.API.dll
- IKVM.OpenJDK.Charsets.dll (Thanks carl4os)
(I found using reflection which IKVM dll's are referenced in the opennlp.dll )

Add references to these assemblies in your project & use at will :-)

You will need the models for your language from http://opennlp.sourceforge.net/models-1.5/

The OpenNlp manual is a good place to start http://incubator.apache.org/opennlp/documentation/manual/opennlp.html

Note: This is still a java in .net clothes, so care has to be taken over some things.
e.g when loading models the inputstreams are java types (referenced from the assemblies above)

string modelpath = "C:\models\";  \\Wherever you've stored your downloaded models
java.io.FileInputStream modelInpStream = new java.io.FileInputStream(ModelPath + "en-sent.bin");
opennlp.tools.sentdetect.SentenceModel sentenceModel =new opennlp.tools.sentdetect.SentenceModel(modelInpStream);
opennlp.tools.sentdetect.SentenceDetectorME SentenceDetectorME=new opennlp.tools.sentdetect.SentenceDetectorME(sentenceModel);

Mostly though it seems to be very straightforward & works well.

Once set up it takes only a few seconds to create an opennlp.dll assembly from the latest releases
and so it is very easy to keep it bang up to date.

I have a VERY basic demo program that i quickly knocked up. I've bundled it all up as a c# Winforms project already compiled so you can just extract it (don't forget to unblock the zip file first) & run the Nlp.exe In the Bin\debug folder. Of course the source code is included as well.
The models are in there too in the debug folder, the program expects the model folder to be in the same folder as nlp.exe (i said it was quick & dirty ;-)
Here's the file (it's ~100Mb !! as it includes the models) https://dl.dropbox.com/u/24630720/nlp.zip

Hope this may be of use to someone.

Cheers

Paul

New Post: An easy(ish) alternative to porting OpenNlp to C#

greeny — Tue, 31 Jul 2012 11:22:00 GMT

Hi,

I'm not sure what the problem is. Two things spring to mind.
Did you unblock all the zip files you downloaded? (some of the messages are security related)
There is a more current version of IKVM available (7.1.4532.2) that might help.

Also 1.5.2 introduces dependencies that make the whole job a bit more complicated
I have posted an updated method below which works ok for me.
hopefully it will work for you too.

Cheers
Paul

New Post: An easy(ish) alternative to porting OpenNlp to C#

DRedding — Mon, 30 Jul 2012 16:40:13 GMT

I cannot seem to get your solution to work. I keep getting this handy little error. Any ideas what i'm missing?

...\NLP\ikvm-7.0.4335.0\bin> ikvmc -target:library-assembly:opennlp opennlp-maxent-3.0.2-incubating.jar jwnl-1.3.3.jar opennlp-tools-1.5.2-incubating.jar

Unhandled Exception: System.ArgumentException: Index was out of range. Must be non-negative and less than the size of the collection.

at System.Security.Util.Hex.ConvertHexDigit(Char val)
at System.Security.Util.Hex.DecodeHexString(String hexString)
at System.Security.Policy.StrongNameMembershipCondition.ParseKeyBlob()
at System.Security.Policy.StrongNameMembershipCondition.get_PublicKey()
at System.Security.Policy.StrongNameMembershipCondition.System.Security.Policy.IReportMatchMembershipCondition.Check(Evidence evidence, Object& usedEvidence)

at System.Security.Policy.PolicyLevel.IsFullTrustAssembly(ArrayList fullTrustAssemblies, Evidence evidence)
at System.Security.Policy.PolicyLevel.Resolve(Evidence evidence, Int32 count, Char[] serializedEvidence)
at System.Security.PolicyManager.CodeGroupResolve(Evidence evidence, BooleansystemPolicy)
at System.Security.PolicyManager.ResolveHelper(Evidence evidence)
at System.Security.PolicyManager.Resolve(Evidence evidence)
at System.Security.SecurityManager.ResolvePolicy(Evidence evidence, PermissionSet reqdPset, PermissionSet optPset, PermissionSet denyPset, PermissionSet& denied, Boolean checkExecutionPermission)
at System.Security.SecurityManager.ResolvePolicy(Evidence evidence, PermissionSet reqdPset, PermissionSet optPset, PermissionSet denyPset, PermissionSet& denied, Int32& securitySpecialFlags, Boolean checkExecutionPermission)

New Post: I have an improvement to the Tokenizer

DRedding — Mon, 30 Jul 2012 15:47:02 GMT

I know this reply is coming a little late, but I would most defiantly be interested in any updates that bring this bad boy up to snuff.

New Post: I have a threadsafe version

justinflang — Fri, 15 Jun 2012 15:42:40 GMT

Sounds interesting. Could you share your code with us?

New Post: What is an nbin file?

JamesHurst — Thu, 07 Jun 2012 21:06:52 GMT

Hi, please excuse my knuckle-head question: What is an nbin file, and what are we supposed to do with this. Where in your documentation does it explain this?

Thank you,

New Post: I have a threadsafe version

zsu — Fri, 25 May 2012 02:15:00 GMT

I have modified the codes to make it thread safe and also fix some bugs a while back. If anyone have interest I can dig it out and share it when I have time. I also modified netspell and make it much faster(about 10 times according to my coworker's test) and threadsafe.