Petra Lamborn
|
0646dffc56
|
Bunch of proper python scripts
|
5 years ago |
Petra Lamborn
|
422e98dc26
|
Fix a very important error; continue aggregation
|
5 years ago |
Petra Lamborn
|
8aac5812ce
|
Start agg py
|
5 years ago |
Petra Lamborn
|
1413b4b0a7
|
Clustering file
|
5 years ago |
Petra Lamborn
|
fce99dac1f
|
Make separate dcorr script
|
5 years ago |
Petra Lamborn
|
95133dd362
|
Update requirements
|
5 years ago |
Petra Lamborn
|
a774ad9949
|
Need to actually save tcorr
|
5 years ago |
Petra Lamborn
|
a2dd00b579
|
Algorithm for calculating correlation matrix for 5k
|
5 years ago |
Petra Lamborn
|
569b047292
|
Collate 5k
|
5 years ago |
Petra Lamborn
|
9d86c8ef8f
|
Download only 5k sample
|
5 years ago |
Petra Lamborn
|
2622bf8fca
|
Ok, so this should make a distance-correlation matrix of everything
Unfortunately, it would take approximately a week on an r5.large, so
I'm going to work with a large sample instead
|
5 years ago |
Petra Lamborn
|
c7dfa867bb
|
Save correlation matrix
|
5 years ago |
Petra Lamborn
|
c4a946c333
|
Diy corr?
|
5 years ago |
Petra Lamborn
|
7debb88ae2
|
Trying to make my own corr
|
5 years ago |
Petra Lamborn
|
f72a0ae7c1
|
Download and collate in wide form, month-by-month
|
5 years ago |
Petra Lamborn
|
55c4b86254
|
Also print the time
|
5 years ago |
Petra Lamborn
|
88989c825a
|
Further optimisations
|
5 years ago |
Petra Lamborn
|
f363369f3f
|
Grab a month at a time (Still need to merge!)
|
5 years ago |
Petra Lamborn
|
1da59694f5
|
Revert "Go back to downloading all"
This reverts commit 88a5daed65.
|
5 years ago |
Petra Lamborn
|
88a5daed65
|
Go back to downloading all
|
5 years ago |
Petra Lamborn
|
12e4bb4956
|
1 month of all data - test
|
5 years ago |
Petra Lamborn
|
9d91cd54e1
|
Add images
|
5 years ago |
Petra Lamborn
|
467f694128
|
Save figure instead of showing; download all data
|
5 years ago |
Petra Lamborn
|
36c26dc390
|
Fix matplotlib errors; download the sample data
|
5 years ago |
Petra Lamborn
|
2ea6c125b2
|
Refactor out filenames for data pickles
|
5 years ago |
Petra Lamborn
|
e0bf20d2bd
|
Graph predictions
|
5 years ago |
Petra Lamborn
|
c82da5a058
|
Workable harmonic/weather model
|
5 years ago |
Petra Lamborn
|
66d259f7e6
|
Early attempt at combining weather and kwh models
|
5 years ago |
Petra Lamborn
|
654fe4c15d
|
A harmonic model for annual patterns in rolling 24-hour minimum temperature
|
5 years ago |
Petra Lamborn
|
8009428408
|
Working with old 1-year dataset
|
5 years ago |
Petra Lamborn
|
3dae6b02ac
|
Harmonic stuff
|
5 years ago |
Petra Lamborn
|
2355086ff5
|
Moving from getting a longer dataset to some more decomposition stuff
|
5 years ago |
Petra Lamborn
|
a5715417bc
|
Data back to April 2016
|
5 years ago |
Petra Lamborn
|
a95ac06382
|
Fourier stuff
|
5 years ago |
Petra Lamborn
|
3e423aea81
|
Working on seasonality; very much a WIP
|
5 years ago |
Petra Lamborn
|
e836325c1c
|
Create virtualenv requirements file
|
5 years ago |
Petra Lamborn
|
1705c988c3
|
Cluster visualisation images
|
5 years ago |
Petra Lamborn
|
709d2f8892
|
Some R plotting
|
5 years ago |
Petra Lamborn
|
07ca9e5130
|
Saving clustered datasets
|
5 years ago |
Petra Lamborn
|
deb90b7551
|
Separated graphs
|
5 years ago |
Petra Lamborn
|
0af67c2b17
|
parameter change
|
5 years ago |
Petra Lamborn
|
036f012d25
|
Futher optimisation
|
5 years ago |
Petra Lamborn
|
a99d1fc52f
|
Optimisations
|
5 years ago |
Petra Lamborn
|
702287cfd0
|
Dendrogram and fast line graph with constant colours
|
5 years ago |
Petra Lamborn
|
4292e8f941
|
July and January stuff
|
5 years ago |
Petra Lamborn
|
e41fea2675
|
Clustering, dendogram etc
|
5 years ago |
Petra Lamborn
|
f02eb5257b
|
Grab only first week of april; icp ids ending in 17
|
5 years ago |
Petra Lamborn
|
08c01a21b0
|
Add and reorganise notes
|
5 years ago |
Petra Lamborn
|
49a3f34448
|
Load pickle; reorganise some files
|
5 years ago |
Petra Lamborn
|
d6a8b782d1
|
Minor edits to data download
|
5 years ago |