Skip to main content
 首页 » 编程设计

python之从提取的 JSON 数据追加和/或写入 CSV

2024年12月31日6kerrycode

下面编写的代码旨在从给定的 url 中提取 JSON 数据。(我已经删除了 key )。然后我将其格式化并将其更改为 CSV。当这个程序运行和打印时,我看到第一行被获取,但是我要追加的后续行只添加到第一行 (df),而不是在下一行编译。有没有一种简单的方法可以做到这一点?这样在每个 time.sleep() 周期完成后,该行将添加到前一个 sleep 周期而不是原始 df。

df = pd.read_json('https://forex.1forge.com/1.0.3/quotes?pairs=EURUSD,EURJPY,GBPUSD,USDCAD,&api_key=KEY') 
df = df.pivot_table('price', 'timestamp', 'symbol') 
df.to_csv('datapull.csv') 
df = pd.read_csv('datapull.csv', index_col='timestamp') 
 
x = range(6) 
for n in x: 
 
  df2 = pd.read_json('https://forex.1forge.com/1.0.3/quotes?pairs=EURUSD,EURJPY,GBPUSD,USDCAD,&api_key=KEY') 
  df2 = df2.pivot_table('price', 'timestamp', 'symbol') 
  df2.to_csv('datapull2.csv') 
  df2 = pd.read_csv('datapull2.csv', index_col='timestamp') 
  df3 = df.append(df2) 
  time.sleep(1) 
  print(df3)   

输入 JSON 输入数据的示例是:

[{"symbol":"EURUSD","bid":1.13913,"ask":1.13913,"price":1.13913,"timestamp":1541703878},{"symbol":"EURJPY","bid":129.75,"ask":129.753,"price":129.7515,"timestamp":1541703878},{"symbol":"GBPUSD","bid":1.30907,"ask":1.30908,"price":1.30907,"timestamp":1541703878},{"symbol":"USDCAD","bid":1.31059,"ask":1.31059,"price":1.31059,"timestamp":1541703878}]

下面是上述代码的输出。

                       EURJPY   EURUSD   GBPUSD   USDCAD 
timestamp                                                
2018-11-08 00:06:06  129.8615  1.14359  1.31276  1.31167 
2018-11-08 00:06:06  129.8610  1.14359  1.31276  1.31167 
                       EURJPY   EURUSD   GBPUSD   USDCAD 
timestamp                                                
2018-11-08 00:06:06  129.8615  1.14359  1.31276  1.31167 
2018-11-08 00:06:08  129.8605  1.14359  1.31277  1.31163 
                       EURJPY   EURUSD   GBPUSD   USDCAD 
timestamp                                                
2018-11-08 00:06:06  129.8615  1.14359  1.31276  1.31167 
2018-11-08 00:06:09  129.8660  1.14362  1.31278  1.31156 
                       EURJPY   EURUSD   GBPUSD   USDCAD 
timestamp                                                
2018-11-08 00:06:06  129.8615  1.14359  1.31276  1.31167 
2018-11-08 00:06:10  129.8725  1.14363  1.31289  1.31155 
                       EURJPY   EURUSD   GBPUSD   USDCAD 
timestamp                                                
2018-11-08 00:06:06  129.8615  1.14359  1.31276  1.31167 
2018-11-08 00:06:12  129.8750  1.14363  1.31289  1.31155 
                       EURJPY   EURUSD   GBPUSD   USDCAD 
timestamp                                                
2018-11-08 00:06:06  129.8615  1.14359  1.31276  1.31167 
2018-11-08 00:06:13  129.8735  1.14363  1.31289  1.31155 

请您参考如下方法:

您以错误的方式累积数据,因为您在每一轮中都将第一行 (df) append 到刚刚获取的行 (df2)。

每一轮 append 的结果 (df3) 在每一轮结束时被覆盖并丢失。

这个怎么样:

df = pd.read_json('https://forex.1forge.com/1.0.3/quotes?pairs=EURUSD,EURJPY,GBPUSD,USDCAD,&api_key=KEY') 
df = df.pivot_table('price', 'timestamp', 'symbol') 
df.to_csv('datapull.csv') 
df = pd.read_csv('datapull.csv', index_col='timestamp') 
 
x = range(6) 
for n in x: 
 
  df2 = pd.read_json('https://forex.1forge.com/1.0.3/quotes?pairs=EURUSD,EURJPY,GBPUSD,USDCAD,&api_key=KEY') 
  df2 = df2.pivot_table('price', 'timestamp', 'symbol') 
  df2.to_csv('datapull2.csv') 
  df2 = pd.read_csv('datapull2.csv', index_col='timestamp') 
  df = df.append(df2) 
  time.sleep(1) 
  print(df)   

即只需将 df 定义为自身的 append 和刚刚获取的新行 (df2)。