Hi All,
I am having difficulty parsing using Saxon and TagSoup parser on a namespace html document. The relevant content of this document are as follows:
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
..
</head>
<body>
<div id="container">
<div id="content">
<table class="sresults">
<tr>
<td>
<a href="http://www.abc.com/areas" title="Hollywood, CA">hollywood</a>
</td>
<td>
<a href="http://www.abc.com/areas" title="San Jose, CA">san jose</a>
</td>
<td>
<a href="http://www.abc.com/areas" title="San Francisco, CA">san francisco</a>
</td>
<td>
<a href="http://www.abc.com/areas" title="San Diego, CA">San diego</a>
</td>
</tr>
.
</body>
</html>
Below is the relevant code snippets illustrates how I have attempted to retrieve the contents (value of <a>):
import java.util.*;
import org.jdom.*;
import org.jdom.xpath.*;
import org.saxpath.*;
import org.ccil.cowan.tagsoup.Parser;
( 1 ) frInHtml = new FileReader("C:\\Tmp\\ABC.html");
( 2 ) brInHtml = new BufferedReader(frInHtml);
( 3 ) // SAXBuilder saxBuilder = new SAXBuilder("org.apache.xerces.parsers.SAXParser");
( 4 ) SAXBuilder saxBuilder = new SAXBuilder("org.ccil.cowan.tagsoup.Parser");
( 5 ) org.jdom.Document jdomDocument = saxbuilder.build(brInHtml);
( 6 ) XPath xpath = XPath.newInstance("/ns:html/ns:body/ns:div[@id='container']/ns:div[@id='content']/ns:table[@class='sresults']/ns:tr/ns:td/ns:a");
( 7 ) xpath.addNamespace("ns", "http://www.w3.org/1999/xhtml");
( 8 ) java.util.List list = (java.util.List) (xpath.selectNodes(jdomDocument));
( 9 ) Iterator iterator = list.iterator();
( 10 ) while (iterator.hasNext())
( 11 ) {
( 12 ) Object object = iterator.next();
( 13 ) // if (object instanceof Element)
( 14 ) // System.out.println(((Element)object).getTextNormalize());
( 15 ) if (object instanceof Content)
( 16 ) System.out.println(((Content)object).getValue());
}
.
This program would work on the same document without the default namespace, hence, it would not be necessary to include ns prefix along in the XPath statements (line 6-7) either. Moreover, I was using org.apache.xerces.parsers.SAXParser to have successfully retrieve content of <a> from the same document without default namespace in the past.
I would like to achieve the following objectives if possible:
( i ) Exclude DTD and namespace in order to simplifying the parsing process. How this could be done?
( ii ) If this is not possible, how to include it in XPath statements (line 6-7) so that the value of <a> is picked up correctly?
( iii ) Would changing from org.apache.xerces.parsers.SAXParser to org.ccil.cowan.tagsoup.Parser make any difference as far as using XPath is concerned?
( iv ) Failing to exlude DTD, how to change the lookup of a PUBLIC DTD to a local SYSTEM one and include a local DTD for reference?
I am running JDK 1.6.0_06, Netbeans 6.1, JDOM 1.1, Saxon6-5-5, Tagsoup 1.2 on Windows XP platform.
Any assistance would be appreciated.
Thanks in advance,
Jack