Compare commits

Home / Compare 93caca02 .. e7f1c54e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean92.523-92.522=0.001
σ0.055-0.054=0.002
min92.471-92.473=-0.002
max92.667-92.665=0.002
mean412.800-415.000=-2.200
σ0.422-0.000=0.422
min412.000-415.000=-3.000
max413.000-415.000=-2.000
mean0.207-0.216=-0.009
σ0.005-0.004=0.001
min0.200-0.209=-0.009
max0.214-0.222=-0.008
cache=y
dps=1
iters=10
policies=100
mean43.139-43.138=0.001
σ0.007-0.008=-0.001
min43.124-43.126=-0.002
max43.147-43.151=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.116-0.114=0.002
σ0.004-0.001=0.003
min0.111-0.113=-0.002
max0.123-0.116=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1761.434-1761.434=0.000
σ0.364-0.362=0.002
min1760.862
max1762.026-1762.021=0.005
mean1666.750-1663.950=2.800
σ638.327-638.479=-0.152
min629.000-627.000=2.000
max2767.000-2757.000=10.000
mean2.552-2.597=-0.045
σ0.325-0.332=-0.007
min2.193-2.200=-0.008
max3.212-3.111=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean328.796-328.800=-0.004
σ0.068-0.063=0.005
min328.674-328.687=-0.013
max328.834-328.833=0.001
mean2767.000-2757.000=10.000
σ0.000
min2767.000-2757.000=10.000
max2767.000-2757.000=10.000
mean0.433-0.433=-0.000
σ0.001-0.001=-0.001
min0.432-0.433=-0.000
max0.435-0.436=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1989.321-1989.332=-0.011
σ0.013-0.005=0.008
min1989.299-1989.326=-0.027
max1989.333-1989.338=-0.006
mean2767.000-2757.000=10.000
σ0.000
min2767.000-2757.000=10.000
max2767.000-2757.000=10.000
mean3.107-3.131=-0.024
σ0.077-0.099=-0.022
min3.017-3.007=0.011
max3.225-3.254=-0.029
iters=5
new-facts=6402
prior-facts=1
mean4812.933-4812.970=-0.037
σ7.926-7.819=0.107
min4808.918-4809.095=-0.177
max4827.103-4826.949=0.154
mean2767.000-2757.000=10.000
σ0.000
min2767.000-2757.000=10.000
max2767.000-2757.000=10.000
mean8.806-8.484=0.323
σ0.372-0.525=-0.153
min8.395-7.719=0.676
max9.351-9.157=0.194
iters=5
new-facts=6402
prior-facts=6402
mean5000.603-5000.592=0.010
σ0.024-0.017=0.006
min5000.579-5000.573=0.007
max5000.633-5000.617=0.016
mean3056.600-3042.000=14.600
σ248.971-244.342=4.630
min2767.000-2757.000=10.000
max3375.000-3354.000=21.000
mean9.116-8.875=0.242
σ0.709-0.414=0.295
min8.278-8.470=-0.191
max9.828-9.479=0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.038=-0.035
σ0.137-0.269=-0.133
min0.911-0.913=-0.002
max1.226-1.520=-0.294

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean470.847-470.846=0.001
σ574.235-574.236=-0.001
min183.717-183.720=-0.003
max1332.200-1332.200=-0.001
mean90.250
σ8.500
min86.000
max103.000
mean2767.000-2757.000=10.000
σ0.000
min2767.000-2757.000=10.000
max2767.000-2757.000=10.000
mean0.446-0.565=-0.119
σ0.301-0.551=-0.251
min0.294-0.284=0.009
max0.897-1.392=-0.495
policies=20
mean1837.472-1837.478=-0.006
σ0.403-0.403=0.000
min1837.177-1837.217=-0.039
max1838.063-1838.077=-0.015
mean860.000
σ0.000
min860.000
max860.000
mean2767.000-2757.000=10.000
σ0.000
min2767.000-2757.000=10.000
max2767.000-2757.000=10.000
mean2.955-2.855=0.100
σ0.082-0.016=0.066
min2.904-2.835=0.069
max3.077-2.869=0.207
policies=200
mean18381.829-18381.832=-0.003
σ0.533-0.617=-0.084
min18381.382-18381.457=-0.075
max18382.595-18382.750=-0.155
mean8600.000
σ0.000
min8600.000
max8600.000
mean2767.000-2757.000=10.000
σ0.000
min2767.000-2757.000=10.000
max2767.000-2757.000=10.000
mean28.698-28.706=-0.008
σ0.243-0.042=0.201
min28.514-28.655=-0.142
max29.051-28.757=0.293