Convert a string to word list table
birdyApr 5 2011 — edited May 12 2011Hi all
Note: All of the below are
I have a strange requirement in that, I have a table which supplies me with a string of descriptions
For eg
Table_A
description
-------------------------------------
THE BOY IS SMART.
A GUY AND A GIRL
A MEMO%RAB?LE WEEK
THE,POLICE ARE INVESTIGATING
Also I have a pre-defined list of words which need to be ignored
For eg:
Ignore_table
ignore_list
---------------------
THE
IS
A
A
ARE
I need to convert each sentence or string in table_A into a list of words.
Any potential delimiter( whitespace, comma,pipe etc defined in the spec) needs to be considered. Potentially a reference table with all the possible delimiters defined can be used
Example output would be
word_table
wordlist
--------------
THE
BOY
IS
SMART
A
GUY
AND
A
GIRL
MEMO
RAB
LE
WEEK
THE
POLICE
ARE
INVESTIGATING
This table will then be used as a source to compare against the pre-defined list of ignore words and select the ones which are not to be ignored.
Case is not an issue as everything needs to be converted to upper case.
is creating this "word_table" possible?
any advise or tips will really help
birdy