我想我真的很接近,所以我们将不胜感激。试图从纳斯达克主页上名为“股票市场事件”的表格中抓取指数和值(value)数据:
def get_index_prices(NASDAQ_URL):
html = urlopen(NASDAQ_URL).read()
soup = BeautifulSoup(html, "lxml")
for row in soup('table', {'class': 'genTable thin'})[0].tbody('tr'):
tds = row('td')
print "Index: %s, Value: %s" % (tds[0].text, tds[1].text)
print get_index_prices('http://www.nasdaq.com/')
错误读取:
list index out of range
请您参考如下方法:
此表由 javascript 呈现。如果您查看页面源代码,在 javascript 运行之前,您可以看到如下表格:
<div id="HomeIndexTable" class="genTable thin">
<table id="indexTable" class="floatL marginB5px">
<thead>
<tr>
<th>Index</th>
<th>Value</th>
<th>Change Net / %</th>
</tr>
</thead>
<script type="text/javascript">
//<![CDATA[
nasdaqHomeIndexChart.storeIndexInfo("NASDAQ","5053.75","-20.52","0.40","1,938,573,902","5085.22","5053.75");
nasdaqHomeIndexChart.storeIndexInfo("DJIA","17663.54","-92.26","0.52","","17799.96","17662.87");
nasdaqHomeIndexChart.storeIndexInfo("S&P 500","2079.36","-10.05","0.48","","2094.32","2079.34");
nasdaqHomeIndexChart.storeIndexInfo("NASDAQ-100","4648.83","-21.93","0.47","","4681.23","4648.83");
nasdaqHomeIndexChart.storeIndexInfo("NASDAQ-100 PMI","4675.49","4.73","0.10","","4681.98","4675.49");
nasdaqHomeIndexChart.storeIndexInfo("NASDAQ-100 AHI","4647.33","-1.50","0.03","","4670.76","4647.26");
nasdaqHomeIndexChart.storeIndexInfo("Russell 1000","1153.55","-4.85","0.42","","1161.51","1153.54");
nasdaqHomeIndexChart.storeIndexInfo("Russell 2000","1161.86","-3.76","0.32","","1167.65","1159.66");
nasdaqHomeIndexChart.storeIndexInfo("FTSE All-World ex-US*","271.15","-0.23","0.08","","272.33","271.13");
nasdaqHomeIndexChart.storeIndexInfo("FTSE RAFI 1000*","9045.08","-34.52","0.38","","9109.74","9044.91");
//]]>
nasdaqHomeIndexChart.displayIndexes();
</script>
</table>
</div>
您可以使用 selenium用于抓取。 Selenium 可以执行 javascript。
