SparkSql 不支持Date Format (支持Timestamp)

时间:2023-03-08 15:17:21
SparkSql 不支持Date Format (支持Timestamp)

最近项目中需要用到sparksql ,需要查询sql Date类型, 无奈,官方现阶段 1.6.0 还不支持Date类型,不过支持Timestamp类型,所以问题可以解决了。

1.解析

SimpleDateFormat dateFormat = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss");
Date beginDate = null;
Date endDate = null;
try {
beginDate = (Date) dateFormat.parse(param3[0]);
endDate = dateFormat.parse(param3[1]);
} catch (ParseException e) {
e.printStackTrace();
}
System.out.println("beginDate.getTime()"+ beginDate.getTime()+"-----" + endDate.getTime());

.csharpcode, .csharpcode pre
{
font-size: small;
color: black;
font-family: consolas, "Courier New", courier, monospace;
background-color: #ffffff;
/*white-space: pre;*/
}
.csharpcode pre { margin: 0em; }
.csharpcode .rem { color: #008000; }
.csharpcode .kwrd { color: #0000ff; }
.csharpcode .str { color: #006080; }
.csharpcode .op { color: #0000c0; }
.csharpcode .preproc { color: #cc6633; }
.csharpcode .asp { background-color: #ffff00; }
.csharpcode .html { color: #800000; }
.csharpcode .attr { color: #ff0000; }
.csharpcode .alt
{
background-color: #f4f4f4;
width: 100%;
margin: 0em;
}
.csharpcode .lnum { color: #606060; }

String sql = "SELECT * FROM carMonitorBean WHERE DCOLLECTIONDATE >= " + beginDate.getTime() + " AND DCOLLECTIONDATE <="
+endDate.getTime()+ " AND HOURTIME >=3 AND HOURTIME <=5";

.csharpcode, .csharpcode pre
{
font-size: small;
color: black;
font-family: consolas, "Courier New", courier, monospace;
background-color: #ffffff;
/*white-space: pre;*/
}
.csharpcode pre { margin: 0em; }
.csharpcode .rem { color: #008000; }
.csharpcode .kwrd { color: #0000ff; }
.csharpcode .str { color: #006080; }
.csharpcode .op { color: #0000c0; }
.csharpcode .preproc { color: #cc6633; }
.csharpcode .asp { background-color: #ffff00; }
.csharpcode .html { color: #800000; }
.csharpcode .attr { color: #ff0000; }
.csharpcode .alt
{
background-color: #f4f4f4;
width: 100%;
margin: 0em;
}
.csharpcode .lnum { color: #606060; }

2. spark Sql 可以参看官网提供的文档如下:

http://spark.apache.org/docs/latest/sql-programming-guide.html#sql

如对您有帮助,请多多支持。