Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot
 
PerlMonks  

Re: Casual Communication, AI, and Text Processing

by dragonchild (Archbishop)
on Mar 28, 2002 at 16:48 UTC ( [id://155037]=note: print w/replies, xml ) Need Help??


in reply to Casual Communication, AI, and Text Processing

Basically, you're trying to quick-parse sentences. My cousin did her master's thesis on comparing two algorithms for natural language parsing. Just two, and she got a Masters.

The problem is that the rules for parsing a natural language are context-driven. In your example, "my dog" is the subject because it precedes "is", not because it's a noun. (And, just to make things more complicated, "dog" is considered a noun solely due to placement. There is a verb "dog", too.)

I'll give you another example. "Pole, you Pole!" That is a perfectly good imperative sentence in english. It breaks down as "Verb (command), Object". However, if I change it to "Pole, you pole!" ... That breaks down to "Object, Verb (command)". The only difference was capitalization. But, I suspect all the english-speakers could understand what I was saying. How would you encapsulate those rules?

I'm not trying to say it can't be done. In fact, I'm working on an algorithm myself, in my spare time. However, I certainly do not think that Perl is the place to do it. The data structures are too large and the algorithms too computationally-intensive for Perl to be a good language.

------
We are the carpenters and bricklayers of the Information Age.

Don't go borrowing trouble. For programmers, this means Worry only about what you need to implement.

  • Comment on Re: Casual Communication, AI, and Text Processing

Replies are listed 'Best First'.
Re: Re: Casual Communication, AI, and Text Processing
by one4k4 (Hermit) on Mar 28, 2002 at 17:02 UTC
    Hrm, I like your commentary. Very interesting indeed. I was thinking of maybe something similar to the concept behind soundex in the SQL langauge. Even doing the "soundex" like calculations on a table level? But my interest is indeed sparked, and I shall go from here.

    I did, however, create a very basic sourceforge project for this idea located at sourceforge.net/projects/ieokb. Expect things to change. And change often. Sourceforge is basically there for CVS and portability.

    Thank you so much for your thoughts, they're a *big* help.

    _14k4 - perlmonks@poorheart.com (www.poorheart.com)

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://155037]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others lurking in the Monastery: (2)
As of 2024-04-19 18:44 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found