|
#2
sdta2021-05-31 11:01
|
https://www.lottery.
只有本站会员才能查看附件，请 登录
56 回复
|
#3
jinanshui2021-05-31 15:31
回复 2楼 sdta
|
|
|
#4
sdta2021-05-31 16:02
|
|
#5
吹水佬2021-05-31 16:44
回复 3楼 jinanshui
|
|
|
#6
吹水佬2021-05-31 16:49
|
|
|
#7
jinanshui2021-05-31 21:37
|
|
|
#8
sdta2021-05-31 22:45
|
|
|
#9
sdta2021-05-31 23:04
|
|
|
#10
sdta2021-05-31 23:26
|
|
|
#11
jinanshui2021-06-01 06:59
|
|
|
#12
sdta2021-06-01 07:19
|
|
|
#13
jinanshui2021-06-01 07:43
以下是引用sdta在2021-6-1 07:19:55的发言： 下载数据用时比较长（8秒左右），解析数据应该能控制在1秒内 老师，您是大神级高手，我是一个小菜鸟  |
|
|
#14
sdta2021-06-01 08:06
|
|
|
#15
sdta2021-06-01 09:49
|
|
|
#16
sdta2021-06-01 10:00
|
|
|
#17
吹水佬2021-06-01 14:29
以下是引用sdta在2021-6-1 07:19:55的发言： 下载数据用时比较长（8秒左右），解析数据应该能控制在1秒内 下载的数据有5M多，记录也2000多条，用STREXTRACT()要秒杀有难度。 试试用JavaScript应该能秒杀 只有本站会员才能查看附件，请 登录  程序代码：CREATE CURSOR tt (DrawNum C(5), DrawResult C(20)) cUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0" oHttp = CREATEOBJECT("MSXML2.XMLHTTP") oHttp.Open("GET", cUrl, .F.) oHttp.Send() jsCode = 'var data='+oHttp.responseText+';var list=data["value"]["list"];' oSC = CREATEOBJECT("ScriptControl") oSC.Language = "JavaScript" oSC.AddCode(jsCode) FOR i=0 TO oSC.eval('list.length')-1 INSERT INTO tt VALUES (oSC.eval('list['+TRANSFORM(i)+']["lotteryDrawNum"]'),; oSC.eval('list['+TRANSFORM(i)+']["lotteryUnsortDrawresult"]')) ENDFOR SELECT * FROM tt RETURN |
|
|
#18
吹水佬2021-06-01 15:30
JS部分这样写好读一点
程序代码：jsCode = 'var data=' + oHttp.responseText + ';' +; 'var list=data["value"]["list"];' +; 'function getList(n,name){return list[n][name];}' oSC = CREATEOBJECT("ScriptControl") oSC.Language = "JavaScript" oSC.AddCode(jsCode) FOR i=0 TO oSC.eval('list.length')-1 INSERT INTO tt VALUES (oSC.run("getList",i,"lotteryDrawNum"),; oSC.run("getList",i,"lotteryUnsortDrawresult")) ENDFOR |
|
|
#19
sdta2021-06-01 16:13
|
|
|
#20
吹水佬2021-06-01 17:23
|
|
|
#21
schtg2021-06-01 18:13
|
|
|
#22
jinanshui2021-06-01 20:41
|
|
|
#23
jinanshui2021-06-01 21:02
|
|
|
#24
sdta2021-06-01 21:18
|
|
|
#25
sdta2021-06-01 21:19
|
|
|
#26
sdta2021-06-01 21:23
|
|
|
#27
吹水佬2021-06-01 22:18
回复 22楼 jinanshui
测试结果的确有点慢，比对了一下：
耗时：254秒 程序代码：CREATE CURSOR 大乐透 (红1 C(2), 红2 C(2), 红3 C(2),红4 C(2),红5 C(2),兰1 C(2),兰2 C(2),期号 C(5)) lcUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0" oHTTP=NEWOBJECT("MSXML2.XMLHTTP") oHTTP.Open("GET", lcUrl, .F.) oHTTP.SETREQUESTHEADER("Content-Type", "text/html;charset=UTF-8") oHTTP.Send() lcText = oHTTP.ResponseText t1 = SECONDS() FOR lnj = 1 TO OCCURS("lotteryDrawNum", lcText) lyText = STREXTRACT(lcText,',"lotteryDrawNum":"','"', lnj) lmText = STREXTRACT(lcText,'lotteryUnsortDrawresult":"','"', lnj) h1 = Substr(lmText ,1,2) h2 = Substr(lmText ,4,2) h3 = Substr(lmText ,7,2) h4 = Substr(lmText ,10,2) h5 = Substr(lmText ,13,2) l1 = Substr(lmText ,16,2) l2 = Substr(lmText ,19,2) INSERT INTO 大乐透 VALUES (h1,h2,h3,h4,h5,l1,l2,lyText) ENDFOR ? SECONDS() - t1 && 254秒 用JS代码相对也只要1秒多点，真有点意外，大家测试一下： 程序代码：CREATE CURSOR 大乐透 (红1 C(2), 红2 C(2), 红3 C(2),红4 C(2),红5 C(2),兰1 C(2),兰2 C(2),期号 C(5)) cUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0" oHttp = CREATEOBJECT("MSXML2.XMLHTTP") oHttp.Open("GET", cUrl, .F.) oHttp.Send() t1 = SECONDS() jsCode = 'var data=' + oHttp.responseText + ';' +; 'var list=data["value"]["list"];' +; 'function getList(n,name){return list[n][name];}' oSC = CREATEOBJECT("ScriptControl") oSC.Language = "JavaScript" oSC.AddCode(jsCode) FOR i=0 TO oSC.eval('list.length')-1 lyText = oSC.run("getList",i,"lotteryDrawNum") lmText = oSC.run("getList",i,"lotteryUnsortDrawresult") h1 = Substr(lmText ,1,2) h2 = Substr(lmText ,4,2) h3 = Substr(lmText ,7,2) h4 = Substr(lmText ,10,2) h5 = Substr(lmText ,13,2) l1 = Substr(lmText ,16,2) l2 = Substr(lmText ,19,2) INSERT INTO 大乐透 VALUES (h1,h2,h3,h4,h5,l1,l2,lyText) ENDFOR ? SECONDS() - t1 && 1.6秒 |
|
|
#28
sdta2021-06-01 22:49
回复 27楼 吹水佬
|
|
|
#29
sdta2021-06-01 23:02
程序代码：CLEAR CREATE CURSOR 大乐透 (红1 C(2), 红2 C(2), 红3 C(2),红4 C(2),红5 C(2),兰1 C(2),兰2 C(2),期号 C(5), 球具 N(1)) cUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0&" + SUBSTR(SYS(2015), 2) t1 = SECONDS() oHttp = CREATEOBJECT("MSXML2.XMLHTTP") oHttp.Open("GET", cUrl, .F.) oHttp.Send() lcText = oHttp.ResponseText ? "下载数据：", SECONDS() - t1 t1 = SECONDS() lcText = STREXTRACT(lcText, '{"list":[{"', '') ALINES(laText, lcText, '{}},{"') FOR ln1 = 1 TO ALEN(laText, 1) ALINES(laStr, laText[ln1], '},{"', '":', ',"', '[{"', '}]') ALINES(laHm, &laStr[14], SPACE(1)) INSERT INTO 大乐透 VALUES (laHm[1], laHm[2], laHm[3], laHm[4], laHm[5], laHm[6], laHm[7], &laStr[12], &laStr[20]) ENDFOR ? "解析数据：", SECONDS() - t1 && 0.6秒 BROWSE [此贴子已经被作者于2021-6-1 23:19编辑过] |
|
|
#30
sdta2021-06-01 23:11
|
|
|
#31
jinanshui2021-06-02 03:59
|
|
|
#32
schtg2021-06-02 05:26
|
|
|
#33
吹水佬2021-06-02 10:46
以下是引用sdta在2021-6-1 23:11:24的发言： STREXTRACT()在解析这种大块头JSON数据中速度确实慢，ALINES()速度则飞快，建议大家以后解析类似这种大块头的文本，使用ALINES()函数。ALINES()是解析文本字符的利器。 这个循环有2000多次，STREXTRACT()在循环体每次从头起搜索大块头肯定快不了。 ALINES()在分配内存和读入数据时有点耗时，以后寻址取数就快了。 循环体内如果能用其他字符串函数代替ALINES()应该会快点，用ALINES()来处理较规范的数据确是便捷些。 有点不明白，VFP既然有SYS(2600)使用到指针，为何不提供处理指针的方法? 试用指针来处理这个问题，好象可以做到 0.1 秒杀，大家试试看： 程序代码：DECLARE LONG GetProcessHeap IN Kernel32 DECLARE LONG HeapAlloc IN kernel32 LONG, LONG, LONG DECLARE LONG HeapFree IN Kernel32 LONG, LONG, LONG DECLARE LONG strstr IN msvcrt LONG,STRING@ CREATE CURSOR 大乐透 (红1 C(2), 红2 C(2), 红3 C(2),红4 C(2),红5 C(2),兰1 C(2),兰2 C(2),期号 C(5),球具 N(1)) cUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0&" + SUBSTR(SYS(2015), 2) oHTTP=NEWOBJECT("MSXML2.XMLHTTP") oHTTP.Open("GET", cUrl, .F.) oHTTP.SETREQUESTHEADER("Content-Type", "text/html;charset=UTF-8") oHTTP.Send() lcText = oHTTP.ResponseText t1 = SECONDS() nSize = LEN(lcText)+1 pText = HeapAlloc(GetProcessHeap(), 8, nSize) SYS(2600, pText, nSize, lcText+0h00) p = strstr(pText, "lotteryDrawNum") DO WHILE p > 0 DrawNum = SYS(2600, p+17, 5) p2 = strstr(p, "lotteryDrawResult") + 20 p = strstr(p2, "lotteryEquipmentCount") + 23 EquipmentCount = VAL(SYS(2600, p, 1)) INSERT INTO 大乐透 VALUES (SYS(2600, p2, 2),; SYS(2600, p2+3, 2),; SYS(2600, p2+6, 2),; SYS(2600, p2+9, 2),; SYS(2600, p2+12, 2),; SYS(2600, p2+15, 2),; SYS(2600, p2+18, 2),; DrawNum, EquipmentCount) p = strstr(p, "lotteryDrawNum") ENDDO ? SECONDS() - t1 && 0.094 HeapFree(GetProcessHeap(), 1, pText) SELECT * FROM 大乐透 RETURN |
|
|
#34
sdta2021-06-02 11:01
回复 33楼 吹水佬
|
|
|
#35
jinanshui2021-06-02 16:59
|
|
|
#36
sdta2021-06-02 17:12
|
|
|
#37
sdta2021-06-02 21:35
|
|
|
#38
吹水佬2021-06-03 08:30
|
|
|
#39
sdta2021-06-04 12:02
|
|
|
#40
nbwww2021-06-04 15:05
|
|
|
#41
吹水佬2021-06-04 15:43
回复 39楼 sdta
|
|
|
#42
sdta2021-06-04 15:45
回复 33楼 吹水佬
|
|
|
#43
吹水佬2021-06-04 16:01
|
|
|
#44
sdta2021-06-04 17:07
在吹版代码的基础上做了改进，适应不定长数据的提取。大家可以测试下（时间比吹版的时间稍长些）
API代码部分来源于大师（行者孙）及本论坛的大师吹水佬。 程序代码：DECLARE LONG StrDup IN shlwapi STRING @lpsz DECLARE LONG LocalFree IN kernel32 LONG DECLARE LONG strstr IN msvcrt LONG,STRING @ CREATE CURSOR dlt (开奖日期 C(10), 红1 C(2), 红2 C(2), 红3 C(2),红4 C(2),红5 C(2),兰1 C(2),兰2 C(2),期号 C(5),球具 N(1)) cUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0&" + SUBSTR(SYS(2015), 2) oHTTP=NEWOBJECT("MSXML2.XMLHTTP") oHTTP.Open("GET", cUrl, .F.) oHTTP.Send() lcText = oHTTP.ResponseText t1 = SECONDS() hMem = StrDup(@lcText) sys(2600, hMem, len(lcText)) nSize = 100 && 根据JSON块数据的长度做适当调整 p0 = strstr(hMem, "lotteryDrawNum") DO WHILE p0 > 0 DrawNum = STREXTRACT(SYS(2600, p0, nSize), ':', ',"') p1 = strstr(p0, "lotteryDrawResult") p2 = strstr(p1, "lotteryDrawTime") p0 = strstr(p2, "lotteryEquipmentCount") lcqh = DrawNum lckjrq = STREXTRACT(SYS(2600, p2, nSize), ':', ',"') lcjh = STREXTRACT(SYS(2600, p1, nSize), ':', ',"') lcqj = STREXTRACT(SYS(2600, p0, nSize), ':', ',"') INSERT INTO dlt VALUES (&lckjrq, SUBSTR(lcjh, 2, 2), SUBSTR(lcjh, 5, 2), SUBSTR(lcjh, 8, 2), SUBSTR(lcjh, 11, 2), SUBSTR(lcjh, 14, 2), SUBSTR(lcjh, 17, 2), SUBSTR(lcjh, 20, 2), &DrawNum, &lcqj) p0 = strstr(p0, "lotteryDrawNum") ENDDO LocalFree(hMem) CLEAR DLLS ? SECONDS() - t1 && 0.2秒内 BROWSE [此贴子已经被作者于2021-6-4 17:20编辑过] |
|
|
#45
吹水佬2021-06-05 08:42
回复 44楼 sdta
|
|
|
#46
sdta2021-06-05 09:06
|
|
|
#47
吹水佬2021-06-05 10:04
写个类似STREXTRACT()，从VFP的视觉看起来顺眼一点
程序代码：DECLARE LONG _strdup IN msvcrt as api_strdup STRING@ DECLARE LONG free IN msvcrt as api_free LONG DECLARE LONG strstr IN msvcrt as api_strstr LONG,STRING@ CREATE CURSOR dlt (开奖日期 C(10), 红1 C(2), 红2 C(2), 红3 C(2),红4 C(2),红5 C(2),兰1 C(2),兰2 C(2),期号 C(5),球具 N(1)) cUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0&" + SUBSTR(SYS(2015), 2) oHTTP=NEWOBJECT("MSXML2.XMLHTTP") oHTTP.Open("GET", cUrl, .F.) oHTTP.Send() lcText = oHTTP.ResponseText t1 = SECONDS() pText = api_strdup(@lcText) ptr = pText DrawNum = _STREXTRACT(@ptr, [lotteryDrawNum":"], ["]) DO WHILE ptr > 0 DrawResult = _STREXTRACT(@ptr, [lotteryDrawResult":"], ["]) INSERT INTO dlt VALUES (; _STREXTRACT(@ptr, [lotteryDrawTime":"], ["]),; SUBSTR(DrawResult,1,2),; SUBSTR(DrawResult,4,2),; SUBSTR(DrawResult,7,2),; SUBSTR(DrawResult,10,2),; SUBSTR(DrawResult,13,2),; SUBSTR(DrawResult,16,2),; SUBSTR(DrawResult,19,2),; DrawNum,; VAL(_STREXTRACT(@ptr, [lotteryEquipmentCount":], [,]))) DrawNum = _STREXTRACT(@ptr, [lotteryDrawNum":"], ["]) ENDDO ? SECONDS() - t1 api_free(pText) CLEAR DLLS SELECT * FROM dlt RETURN FUNCTION _STREXTRACT(pStr, cStr1, cStr2) pStr = api_strstr(pStr, cStr1) IF pStr > 0 pBegin = pStr + LEN(cStr1) pEnd = api_strstr(pBegin, cStr2) IF pEnd > 0 pStr = pEnd + LEN(cStr2) RETURN SYS(2600, pBegin, pEnd-pBegin) ENDIF ENDIF pStr = 0 RETURN "" ENDFOR [此贴子已经被作者于2021-6-5 11:09编辑过] |
|
|
#48
吹水佬2021-06-05 10:32
换个花样玩玩
程序代码：DECLARE LONG _strdup IN msvcrt as api_strdup STRING@ DECLARE LONG free IN msvcrt as api_free LONG DECLARE LONG strstr IN msvcrt as api_strstr LONG,STRING@ DECLARE LONG sscanf IN msvcrt as api_sscanf STRING@,STRING@,STRING@,STRING@,STRING@,STRING@,STRING@,STRING@,STRING@ CREATE CURSOR dlt (开奖日期 C(10), 红1 C(2), 红2 C(2), 红3 C(2),红4 C(2),红5 C(2),兰1 C(2),兰2 C(2),期号 C(5),球具 N(1)) cUrl = "https://webapi./gateway/lottery/getHistoryPageListV1.qry?gameNo=85&provinceId=0&pageSize=0&" + SUBSTR(SYS(2015), 2) oHTTP=NEWOBJECT("MSXML2.XMLHTTP") oHTTP.Open("GET", cUrl, .F.) oHTTP.Send() lcText = oHTTP.ResponseText t1 = SECONDS() STORE " " TO s1,s2,s3,s4,s5,s6,s7 pText = api_strdup(@lcText) ptr = pText DrawNum = _STREXTRACT(@ptr, [lotteryDrawNum":"], ["]) DO WHILE ptr > 0 api_sscanf(_STREXTRACT(@ptr,[lotteryDrawResult":"],["]), "%s %s %s %s %s %s %s", @s1,@s2,@s3,@s4,@s5,@s6,@s7) INSERT INTO dlt VALUES (_STREXTRACT(@ptr, [lotteryDrawTime":"], ["]),; s1,s2,s3,s4,s5,s6,s7, DrawNum,; VAL(_STREXTRACT(@ptr, [lotteryEquipmentCount":], [,]))) DrawNum = _STREXTRACT(@ptr, [lotteryDrawNum":"], ["]) ENDDO ? SECONDS() - t1 api_free(pText) CLEAR DLLS SELECT * FROM dlt RETURN FUNCTION _STREXTRACT(pStr, cStr1, cStr2) pStr = api_strstr(pStr, cStr1) IF pStr > 0 pBegin = pStr + LEN(cStr1) pEnd = api_strstr(pBegin, cStr2) IF pEnd > 0 pStr = pEnd + LEN(cStr2) RETURN SYS(2600, pBegin, pEnd-pBegin) ENDIF ENDIF pStr = 0 RETURN "" ENDFOR [此贴子已经被作者于2021-6-5 11:10编辑过] |
|
|
#49
sdta2021-06-05 11:30
|
|
|
#50
sdta2021-06-05 11:31
|
|
|
#51
吹水佬2021-06-05 11:47
|
12