http://qs321.pair.com?node_id=1214788


in reply to Re: Parallel-processing the code
in thread Parallel-processing the code

Thanks very much Mario and others for your valuable input.

I tried running your code, but it is generating blank output.

I am appending below input and output file formats: In input file there are over 1000000 chunks of sentences (e.g. user review), with chunks separated by a blank line (shown below). I am trying to extract some pre-tagged patterns from the sentences. Such as, extract D*ID1*Spore1 game*D from sentence and then separate ID of the game from its name; all names later are concatenated as shown in the output format below.

Please let me know how your MCE-based code needs to be modified.

Thanks once again.


Input file format:
1
--
A new DVD with both the PC and Mac release for EA's D*ID1*Spore1 game*D.
D*ID2*Spore2*D is not that type of game.
That is why I gave D*ID1*Spore1*D a 3 star.

2
--
D*ID2*Spore2*D is a wonderful game.
A new DVD with both the PC and Mac release for EA's D*ID1*Spore1*D.

3
--
Once you get the D*ID1*spore1*D cursor on your screen, click command-Q.
.
.

Output format:
ID1=>Spore1 game|Spore1|spore1 #case sensitive unique names only in hash value
ID2=>Spore2