如何用Java获取网页源代码
来源:互联网 发布:python 读取mp4 编辑:程序博客网 时间:2024/05/29 04:48
import java.io.BufferedReader;
import java.io.IOException;
import java.io.InputStream;
import java.io.InputStreamReader;
import java.net.HttpURLConnection;
import java.net.URL;
public class HtmlParser {
public static String getHtmlContent(URL url, String encode) {
StringBuffer contentBuffer = new StringBuffer();
int responseCode = -1;
HttpURLConnection con = null;
try {
con = (HttpURLConnection) url.openConnection();
con.setRequestProperty("User-Agent", "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)");// IE代理进行下载
con.setConnectTimeout(60000);
con.setReadTimeout(60000);
// 获得网页返回信息码
responseCode = con.getResponseCode();
if (responseCode == -1) {
System.out.println(url.toString() + " : connection is failure...");
con.disconnect();
return null;
}
if (responseCode >= 400) // 请求失败
{
System.out.println("请求失败:get response code: " + responseCode);
con.disconnect();
return null;
}
InputStream inStr = con.getInputStream();
InputStreamReader istreamReader = new InputStreamReader(inStr, encode);
BufferedReader buffStr = new BufferedReader(istreamReader);
String str = null;
while ((str = buffStr.readLine()) != null)
contentBuffer.append(str);
inStr.close();
} catch (IOException e) {
e.printStackTrace();
contentBuffer = null;
System.out.println("error: " + url.toString());
} finally {
con.disconnect();
}
return contentBuffer.toString();
}
public static String getHtmlContent(String url, String encode) {
if (!url.toLowerCase().startsWith("http://")) {
url = "http://" + url;
}
try {
URL rUrl = new URL(url);
return getHtmlContent(rUrl, encode);
} catch (Exception e) {
e.printStackTrace();
return null;
}
}
public static void main(String argsp[]){
System.out.println(getHtmlContent("http://www.baidu.com","utf-8")) ;
}
}
import java.io.IOException;
import java.io.InputStream;
import java.io.InputStreamReader;
import java.net.HttpURLConnection;
import java.net.URL;
public class HtmlParser {
public static String getHtmlContent(URL url, String encode) {
StringBuffer contentBuffer = new StringBuffer();
int responseCode = -1;
HttpURLConnection con = null;
try {
con = (HttpURLConnection) url.openConnection();
con.setRequestProperty("User-Agent", "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)");// IE代理进行下载
con.setConnectTimeout(60000);
con.setReadTimeout(60000);
// 获得网页返回信息码
responseCode = con.getResponseCode();
if (responseCode == -1) {
System.out.println(url.toString() + " : connection is failure...");
con.disconnect();
return null;
}
if (responseCode >= 400) // 请求失败
{
System.out.println("请求失败:get response code: " + responseCode);
con.disconnect();
return null;
}
InputStream inStr = con.getInputStream();
InputStreamReader istreamReader = new InputStreamReader(inStr, encode);
BufferedReader buffStr = new BufferedReader(istreamReader);
String str = null;
while ((str = buffStr.readLine()) != null)
contentBuffer.append(str);
inStr.close();
} catch (IOException e) {
e.printStackTrace();
contentBuffer = null;
System.out.println("error: " + url.toString());
} finally {
con.disconnect();
}
return contentBuffer.toString();
}
public static String getHtmlContent(String url, String encode) {
if (!url.toLowerCase().startsWith("http://")) {
url = "http://" + url;
}
try {
URL rUrl = new URL(url);
return getHtmlContent(rUrl, encode);
} catch (Exception e) {
e.printStackTrace();
return null;
}
}
public static void main(String argsp[]){
System.out.println(getHtmlContent("http://www.baidu.com","utf-8")) ;
}
}
- 如何用Java获取网页源代码
- 如何用inet下载网页源代码
- 如何用地址栏查看网页的源代码
- 如何用restlet获取网页内容
- 如何用Visual Studio编译Java源代码
- java 获取网页源代码
- Java获取网页源代码
- Java获取网页源代码
- java 获取网页源代码
- 转载:如何用java实现抓取网页?
- 如何用java实现抓取网页?
- 如何用Java判断网页编码
- 如何用ASP实现网页伪静态页源代码
- 如何用jquery获取网页中的文字或者对象
- Java程序获取网页源代码
- java获取响应网页源代码
- 如何用Foxmail发送网页
- 如何用DHTML编制网页
- 用html实现圆角边框
- CSS块级元素和行内元素及可变元素
- linux 下MP4Box命令
- POJ 3553 拓扑
- CHM无法正常打开、查看
- 如何用Java获取网页源代码
- 安卓系统连接打印机
- Oracle统计分析函数集,over(partition by..) 的运用
- Spring+Hibernate处理大批量数据
- List Set Map
- Linux下安装ant
- VS的JS智能感知插件
- linux查找目录下的所有文件中是否含有某个字符串
- JavaScript开发工具WebStorm教程