Compare commits

Home / Compare 0cded947 .. 0c6b9ce7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.978=19.936
σ0.367-0.051=0.316
min53.785-33.941=19.844
max54.959-34.120=20.840
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.137-0.082=0.056
σ0.004-0.005=-0.000
min0.132-0.076=0.056
max0.146-0.090=0.056
cache=y
dps=1
iters=10
policies=100
mean43.142-23.318=19.824
σ0.006-0.003=0.003
min43.130-23.314=19.817
max43.152-23.326=19.827
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.121-0.065=0.056
σ0.004-0.003=0.002
min0.114-0.063=0.052
max0.128-0.072=0.056

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.811-1757.303=-765.492
σ1.272-0.365=0.907
min991.226-1756.731=-765.505
max997.168-1757.891=-760.722
mean1063.950-1666.600=-602.650
σ322.950-627.958=-305.008
min566.000-672.000=-106.000
max1636.000-2615.000=-979.000
mean1.542-2.369=-0.827
σ0.092-0.072=0.020
min1.417-2.287=-0.870
max1.786-2.566=-0.781

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.389-326.454=-41.065
σ0.009-0.027=-0.017
min285.377-326.406=-41.029
max285.400-326.471=-41.071
mean1636.000-2615.000=-979.000
σ0.000
min1636.000-2615.000=-979.000
max1636.000-2615.000=-979.000
mean0.382-0.422=-0.041
σ0.012-0.001=0.010
min0.374-0.421=-0.047
max0.402-0.424=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1988.616=-703.243
σ0.133-0.012=0.121
min1285.303-1988.598=-703.295
max1285.610-1988.630=-703.021
mean1636.000-2615.000=-979.000
σ0.000
min1636.000-2615.000=-979.000
max1636.000-2615.000=-979.000
mean1.858-2.717=-0.859
σ0.023-0.106=-0.082
min1.842-2.640=-0.798
max1.899-2.889=-0.990
iters=5
new-facts=6402
prior-facts=1
mean1807.743-4813.328=-3005.585
σ6.958-7.758=-0.801
min1804.355-4809.407=-3005.051
max1820.178-4827.198=-3007.021
mean1636.000-2615.000=-979.000
σ0.000
min1636.000-2615.000=-979.000
max1636.000-2615.000=-979.000
mean4.290-8.669=-4.379
σ0.299-0.332=-0.033
min4.085-8.188=-4.104
max4.766-9.123=-4.357
iters=5
new-facts=6402
prior-facts=6402
mean2070.194-5001.010=-2930.816
σ0.015-0.023=-0.008
min2070.176-5000.983=-2930.807
max2070.216-5001.033=-2930.816
mean1850.600-3010.000=-1159.400
σ208.260-293.102=-84.841
min1636.000-2615.000=-979.000
max2088.000-3386.000=-1298.000
mean4.560-9.769=-5.208
σ0.281-0.152=0.128
min4.408-9.584=-5.176
max5.062-10.004=-4.943

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-1.132=0.060
σ0.233-0.292=-0.060
min0.908-0.918=-0.010
max1.523-1.552=-0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-464.442=-27.657
σ572.363-574.784=-2.421
min150.599-177.040=-26.441
max1295.329-1326.618=-31.288
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1636.000-2615.000=-979.000
σ0.000
min1636.000-2615.000=-979.000
max1636.000-2615.000=-979.000
mean0.521-0.548=-0.028
σ0.538-0.546=-0.008
min0.248-0.271=-0.023
max1.328-1.368=-0.040
policies=20
mean1506.269-1770.762=-264.494
σ0.235-0.358=-0.123
min1506.115-1770.522=-264.407
max1506.619-1771.294=-264.675
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1636.000-2615.000=-979.000
σ0.000
min1636.000-2615.000=-979.000
max1636.000-2615.000=-979.000
mean2.516-2.737=-0.220
σ0.003-0.025=-0.022
min2.513-2.711=-0.198
max2.520-2.768=-0.248
policies=200
mean15070.360-17714.912=-2644.551
σ0.047-0.474=-0.427
min15070.304-17714.657=-2644.354
max15070.419-17715.622=-2645.203
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1636.000-2615.000=-979.000
σ0.000
min1636.000-2615.000=-979.000
max1636.000-2615.000=-979.000
mean25.520-27.511=-1.991
σ0.087-0.082=0.004
min25.449-27.424=-1.976
max25.639-27.611=-1.972