Compare commits

Home / Compare ab766b0b .. f0c129b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.647=0.000
σ0.367-0.367=-0.000
min53.518-53.513=0.006
max54.691-54.692=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.140-0.138=0.002
σ0.004-0.004=0.000
min0.137-0.132=0.004
max0.146-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean42.941-42.942=-0.001
σ0.005-0.006=-0.002
min42.936-42.929=0.007
max42.948-42.951=-0.003
mean413.000-414.400=-1.400
σ0.000-0.516=-0.516
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.119-0.121=-0.002
σ0.005-0.003=0.002
min0.114-0.119=-0.005
max0.127-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.864-991.859=0.005
σ1.223-1.206=0.016
min991.263-991.331=-0.067
max996.967-996.918=0.049
mean1064.100-1065.750=-1.650
σ325.031-324.800=0.231
min575.000-599.000=-24.000
max1644.000-1637.000=7.000
mean1.549-1.541=0.008
σ0.128-0.107=0.021
min1.462-1.454=0.008
max2.024-1.802=0.222

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.421-285.440=-0.019
σ0.023-0.008=0.015
min285.388-285.426=-0.039
max285.448-285.445=0.003
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.381-0.379=0.002
σ0.007-0.007=0.000
min0.375-0.374=0.001
max0.393-0.392=0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.519-1285.493=0.026
σ0.075-0.086=-0.012
min1285.390-1285.355=0.036
max1285.574-1285.573=0.001
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean1.857-1.876=-0.019
σ0.095-0.051=0.044
min1.798-1.789=0.009
max2.024-1.925=0.099
iters=5
new-facts=6402
prior-facts=1
mean1705.830-1705.829=0.002
σ6.873-6.864=0.009
min1702.652-1702.650=0.002
max1718.123-1718.104=0.019
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean2.831-3.012=-0.181
σ0.343-0.209=0.134
min2.536-2.835=-0.299
max3.387-3.319=0.068
iters=5
new-facts=6402
prior-facts=6402
mean1968.431-1968.409=0.022
σ0.031-0.051=-0.020
min1968.390-1968.320=0.070
max1968.471-1968.443=0.028
mean1811.000-1793.600=17.400
σ189.186-150.123=39.064
min1644.000-1637.000=7.000
max2088.000-1985.000=103.000
mean3.302-3.246=0.056
σ0.295-0.436=-0.141
min3.058-2.976=0.082
max3.813-4.019=-0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.283=-0.094
σ0.288-0.354=-0.066
min0.915-0.912=0.003
max1.663-1.718=-0.055

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.773-436.778=-0.006
σ572.358-572.363=-0.005
min150.589-150.585=0.004
max1295.310-1295.322=-0.012
mean90.250
σ8.500
min86.000
max103.000
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.519-0.529=-0.010
σ0.528-0.556=-0.027
min0.253-0.249=0.004
max1.311-1.363=-0.052
policies=20
mean1506.186-1506.170=0.016
σ0.245-0.251=-0.006
min1506.025-1506.005=0.020
max1506.551-1506.544=0.007
mean860.000
σ0.000
min860.000
max860.000
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean2.526-2.533=-0.007
σ0.021-0.016=0.005
min2.509-2.515=-0.005
max2.556-2.550=0.006
policies=200
mean15069.559-15069.485=0.074
σ0.055-0.084=-0.029
min15069.484-15069.401=0.084
max15069.615-15069.582=0.034
mean8600.000
σ0.000
min8600.000
max8600.000
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean25.636-25.554=0.082
σ0.154-0.114=0.040
min25.487-25.426=0.060
max25.818-25.657=0.161