ScaDaMaLe Course site and book

Utilities Needed for Financial Data

Johannes Graner (LinkedIn), Albert Nilsson (LinkedIn) and Raazesh Sainudiin (LinkedIn)

2020, Uppsala, Sweden

This project was supported by Combient Mix AB through summer internships at:

Combient Competence Centre for Data Engineering Sciences, Department of Mathematics, Uppsala University, Uppsala, Sweden


Here, certain delta.io tables are loaded. These tables have been prepared already.

You will not be able to load them directly but libraries used in the process are all open-sourced.

object TrendUtils {
  private val fx1mPath = "s3a://XXXXX/findata/com/histdata/free/FX-1-Minute-Data/"
  private val trendCalculusCheckpointPath = "s3a://XXXXX/summerinterns2020/trend-calculus-blog/public/"
  private val streamableTrendCalculusPath = "s3a://XXXXX/summerinterns2020/johannes/streamable-trend-calculus/"
  private val yfinancePath = "s3a://XXXXX/summerinterns2020/yfinance/"
  
  def getFx1mPath = fx1mPath
  def getTrendCalculusCheckpointPath = trendCalculusCheckpointPath
  def getStreamableTrendCalculusPath = streamableTrendCalculusPath
  def getYfinancePath = yfinancePath
}
defined object TrendUtils
class TrendUtils:
  
  def getTrendCalculusCheckpointPath():
    return "s3a://XXXXX/summerinterns2020/trend-calculus-blog/public/"
  
  def getYfinancePath():
    return "s3a://XXXXX/summerinterns2020/yfinance/"