Compare commits

Home / Compare dabd0937 .. 7a4c9f6c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.957-30.769=0.188
σ0.048-0.046=0.002
min30.919-30.733=0.186
max31.090-30.896=0.194
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.077-0.076=0.001
σ0.005-0.004=0.001
min0.071-0.070=0.001
max0.086-0.084=0.003
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.001
σ0.002-0.002=-0.000
min21.058-21.058=0.000
max21.065-21.064=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.001
min0.061-0.062=-0.001
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.421=-0.011
σ0.361-0.363=-0.003
min1750.842-1750.848=-0.005
max1751.972-1752.000=-0.028
mean1649.600-1660.550=-10.950
σ625.843-631.808=-5.966
min628.000-681.000=-53.000
max2848.000-2689.000=159.000
mean2.785-2.860=-0.075
σ0.220-0.109=0.111
min2.219-2.646=-0.427
max3.190-3.022=0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.397-275.755=-2.358
σ0.007-0.011=-0.004
min273.389-275.741=-2.351
max273.403-275.767=-2.364
mean2848.000-2689.000=159.000
σ0.000
min2848.000-2689.000=159.000
max2848.000-2689.000=159.000
mean0.392-0.405=-0.013
σ0.009-0.009=0.000
min0.377-0.398=-0.021
max0.402-0.418=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.834-2168.286=-234.452
σ0.006-0.006=0.000
min1933.829-2168.277=-234.448
max1933.844-2168.291=-234.448
mean2848.000-2689.000=159.000
σ0.000
min2848.000-2689.000=159.000
max2848.000-2689.000=159.000
mean3.120-2.975=0.145
σ0.182-0.217=-0.035
min2.961-2.682=0.280
max3.395-3.258=0.137
iters=5
new-facts=6402
prior-facts=1
mean4754.158-5048.149=-293.991
σ0.958-0.916=0.042
min4753.459-5047.544=-294.084
max4755.806-5049.774=-293.968
mean2848.000-2689.000=159.000
σ0.000
min2848.000-2689.000=159.000
max2848.000-2689.000=159.000
mean8.186-8.761=-0.574
σ0.572-0.539=0.033
min7.633-8.061=-0.427
max8.997-9.301=-0.304
iters=5
new-facts=6402
prior-facts=6402
mean4944.809-5179.229=-234.421
σ0.083-0.076=0.007
min4944.732-5179.143=-234.411
max4944.908-5179.310=-234.402
mean3099.400-3227.400=-128.000
σ312.810-389.684=-76.874
min2848.000-2702.000=146.000
max3586.000-3736.000=-150.000
mean8.784-9.771=-0.987
σ0.360-0.657=-0.298
min8.572-8.728=-0.156
max9.412-10.438=-1.026

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.112-1.126=-0.014
σ0.248-0.196=0.053
min0.943-0.948=-0.005
max1.542-1.398=0.145

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.346-463.578=-0.232
σ572.202-572.675=-0.473
min177.239-177.237=0.002
max1321.649-1322.591=-0.942
mean79.750
σ7.500
min76.000
max91.000
mean2848.000-2689.000=159.000
σ0.000
min2848.000-2689.000=159.000
max2848.000-2689.000=159.000
mean0.440-0.546=-0.106
σ0.307-0.540=-0.234
min0.282-0.274=0.008
max0.900-1.357=-0.457
policies=20
mean1772.621-1772.631=-0.010
σ0.334-0.341=-0.007
min1772.375-1772.389=-0.014
max1773.112-1773.136=-0.024
mean760.000
σ0.000
min760.000
max760.000
mean2848.000-2689.000=159.000
σ0.000
min2848.000-2689.000=159.000
max2848.000-2689.000=159.000
mean2.829-2.747=0.082
σ0.004-0.012=-0.007
min2.824-2.736=0.088
max2.833-2.763=0.070
policies=200
mean17732.508-17733.064=-0.556
σ0.354-0.458=-0.104
min17732.216-17732.751=-0.535
max17733.023-17733.742=-0.719
mean7600.000
σ0.000
min7600.000
max7600.000
mean2848.000-2689.000=159.000
σ0.000
min2848.000-2689.000=159.000
max2848.000-2689.000=159.000
mean28.203-27.774=0.429
σ0.490-0.186=0.304
min27.693-27.603=0.090
max28.786-28.038=0.748