Comments on: WebHarvest: Easy Web Scraping from Java http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/ Tue, 02 Aug 2011 09:59:57 +0000 hourly 1 http://wordpress.org/?v=3.0.2 By: Khaleel http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/comment-page-1/#comment-234 Khaleel Sun, 03 Jul 2011 17:13:37 +0000 http://masochismtango.com/?p=478#comment-234 scrapeurljava.lang.IllegalArgumentException: Host name may not be null, when I try calling Scrapeurl directly, What has gone wrong? scrapeurljava.lang.IllegalArgumentException: Host name may not be null, when I try calling Scrapeurl directly, What has gone wrong?

]]> By: ikhsan http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/comment-page-1/#comment-228 ikhsan Sun, 24 Apr 2011 10:41:21 +0000 http://masochismtango.com/?p=478#comment-228 Web scraping technique with JAVA http://ikhsanaulia.blogspot.com/2011/04/teknik-dasar-web-scraping-menggunakan.html Web scraping technique with JAVA
http://ikhsanaulia.blogspot.com/2011/04/teknik-dasar-web-scraping-menggunakan.html

]]> By: Daniel Bell http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/comment-page-1/#comment-226 Daniel Bell Sat, 05 Mar 2011 13:46:59 +0000 http://masochismtango.com/?p=478#comment-226 Third time's the charm: <dependency> <groupId>org.webharvest.wso2</groupId> <artifactId>webharvest-core</artifactId> <version>2.0.0.wso2v1</version> <exclusions> <exclusion> <groupId>commons-email</groupId> <artifactId>commons-email</artifactId> </exclusion> <exclusion> <artifactId>saxon</artifactId> <groupId>net.sf.saxon</groupId> </exclusion> <exclusion> <groupId>org.htmlcleaner</groupId> <artifactId>htmlcleaner</artifactId> </exclusion> </exclusions> </dependency> <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-email</artifactId> <version>1.2</version> </dependency> <dependency> <groupId>net.sf.saxon</groupId> <artifactId>saxon</artifactId> <version>8.7</version><!-- Should be 8.9 --> </dependency> <dependency> <groupId>net.sourceforge.htmlcleaner</groupId> <artifactId>htmlcleaner</artifactId> <version>2.2</version> </dependency> Third time’s the charm:
<dependency>
<groupId>org.webharvest.wso2</groupId>
<artifactId>webharvest-core</artifactId>
<version>2.0.0.wso2v1</version>
<exclusions>
<exclusion>
<groupId>commons-email</groupId>
<artifactId>commons-email</artifactId>
</exclusion>
<exclusion>
<artifactId>saxon</artifactId>
<groupId>net.sf.saxon</groupId>
</exclusion>
<exclusion>
<groupId>org.htmlcleaner</groupId>
<artifactId>htmlcleaner</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-email</artifactId>
<version>1.2</version>
</dependency>
<dependency>
<groupId>net.sf.saxon</groupId>
<artifactId>saxon</artifactId>
<version>8.7</version><!– Should be 8.9 –>
</dependency>
<dependency>
<groupId>net.sourceforge.htmlcleaner</groupId>
<artifactId>htmlcleaner</artifactId>
<version>2.2</version>
</dependency>

]]> By: Daniel Bell http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/comment-page-1/#comment-225 Daniel Bell Sat, 05 Mar 2011 13:45:24 +0000 http://masochismtango.com/?p=478#comment-225 Hmm... let's try that again.. org.webharvest.wso2 webharvest-core 2.0.0.wso2v1 commons-email commons-email saxon net.sf.saxon org.htmlcleaner htmlcleaner org.apache.commons commons-email 1.2 net.sf.saxon saxon 8.7<!-- Should be 8.9 --> net.sourceforge.htmlcleaner htmlcleaner 2.2 Hmm… let’s try that again..

org.webharvest.wso2
webharvest-core
2.0.0.wso2v1

commons-email
commons-email

saxon
net.sf.saxon

org.htmlcleaner
htmlcleaner

org.apache.commons
commons-email
1.2

net.sf.saxon
saxon
8.7

net.sourceforge.htmlcleaner
htmlcleaner
2.2

]]> By: Daniel Bell http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/comment-page-1/#comment-224 Daniel Bell Sat, 05 Mar 2011 13:42:34 +0000 http://masochismtango.com/?p=478#comment-224 Thanks for the post! For anyone wanting to use webharvest 2 with Maven, try the following snippet: org.webharvest.wso2 webharvest-core 2.0.0.wso2v1 commons-email commons-email saxon net.sf.saxon org.htmlcleaner htmlcleaner org.apache.commons commons-email 1.2 net.sf.saxon saxon 8.7<!-- Should be 8.9 --> net.sourceforge.htmlcleaner htmlcleaner 2.2 Thanks for the post! For anyone wanting to use webharvest 2 with Maven, try the following snippet:

org.webharvest.wso2
webharvest-core
2.0.0.wso2v1

commons-email
commons-email

saxon
net.sf.saxon

org.htmlcleaner
htmlcleaner

org.apache.commons
commons-email
1.2

net.sf.saxon
saxon
8.7

net.sourceforge.htmlcleaner
htmlcleaner
2.2

]]> By: Armen http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/comment-page-1/#comment-197 Armen Mon, 19 Jul 2010 23:55:36 +0000 http://masochismtango.com/?p=478#comment-197 Hey I included your page link in my blog for java examples If that is ok with you. However, thought you might be able to help me figure out my problem. I run this script and I get a xquery error, why? here is my code: http://www.courtinfo.ca.gov/reference/rfp/ <![CDATA[ ]]> <!-- list consists of all rows in the main HTML table on the page --> ${url}${pdfpage} <![CDATA[ declare variable $doc as node() external; declare variable $currDate as node() external; {normalize-space(data($row))} $currDate ]]> <![CDATA[ ]]> Hey I included your page link in my blog for java examples If that is ok with you. However, thought you might be able to help me figure out my problem. I run this script and I get a xquery error, why?
here is my code:

http://www.courtinfo.ca.gov/reference/rfp/

<![CDATA[ ]]>

${url}${pdfpage}

<![CDATA[
declare variable $doc as node() external;
declare variable $currDate as node() external;

{normalize-space(data($row))}
$currDate

]]>

<![CDATA[ ]]>

]]> By: Web-Harvest | Garejoor http://masochismtango.com/2010/02/15/webharvest-web-scraping-from-java/comment-page-1/#comment-196 Web-Harvest | Garejoor Fri, 16 Jul 2010 16:01:26 +0000 http://masochismtango.com/?p=478#comment-196 [...] using java sample Filed under Uncategorized Click here to cancel reply. [...] [...] using java sample Filed under Uncategorized Click here to cancel reply. [...]

]]>