Compare commits

Home / Compare 4ab64900 .. 7c179e09

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.989-35.983=0.007
σ0.106-0.103=0.003
min35.946-35.941=0.005
max36.291-36.274=0.017
mean415.000-412.800=2.200
σ0.000-0.422=-0.422
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.075-0.076=-0.002
σ0.004-0.004=-0.001
min0.071-0.070=0.001
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.222-26.222=-0.000
σ0.004-0.005=-0.001
min26.218-26.215=0.003
max26.228-26.228=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.062-0.061=0.000
σ0.003-0.002=0.000
min0.060-0.060=0.000
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1756.314=2.049
σ0.373-0.370=0.004
min1757.790-1755.741=2.049
max1758.959-1756.909=2.051
mean1659.550-1654.950=4.600
σ621.343-625.405=-4.061
min689.000-610.000=79.000
max2745.000-2636.000=109.000
mean2.366-2.361=0.005
σ0.108-0.119=-0.011
min2.271-2.245=0.026
max2.652-2.773=-0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.508-278.840=0.668
σ0.008-0.010=-0.002
min279.500-278.824=0.676
max279.516-278.848=0.668
mean2745.000-2636.000=109.000
σ0.000
min2745.000-2636.000=109.000
max2745.000-2636.000=109.000
mean0.408-0.411=-0.002
σ0.007-0.005=0.001
min0.402-0.406=-0.004
max0.420-0.418=0.001
iters=5
new-facts=1
prior-facts=6402
mean2178.438-2268.900=-90.462
σ0.028-0.014=0.014
min2178.409-2268.883=-90.474
max2178.473-2268.913=-90.440
mean2745.000-2636.000=109.000
σ0.000
min2745.000-2636.000=109.000
max2745.000-2636.000=109.000
mean3.264-2.996=0.268
σ0.157-0.139=0.018
min3.057-2.888=0.168
max3.495-3.194=0.301
iters=5
new-facts=6402
prior-facts=1
mean5056.383-4954.121=102.262
σ0.982-0.932=0.049
min5055.874-4953.142=102.732
max5058.136-4955.660=102.476
mean2745.000-2636.000=109.000
σ0.000
min2745.000-2636.000=109.000
max2745.000-2636.000=109.000
mean9.054-8.025=1.029
σ0.617-0.268=0.349
min8.117-7.730=0.387
max9.563-8.403=1.161
iters=5
new-facts=6402
prior-facts=6402
mean5193.746-5168.816=24.930
σ0.095-0.077=0.018
min5193.660-5168.749=24.910
max5193.856-5168.901=24.955
mean3189.800-3392.000=-202.200
σ437.095-461.161=-24.066
min2745.000-2808.000=-63.000
max3800.000-4010.000=-210.000
mean8.710-9.476=-0.765
σ0.136-0.344=-0.208
min8.595-8.968=-0.372
max8.933-9.914=-0.981

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-1.072=-0.120
σ0.013-0.211=-0.198
min0.940-0.931=0.010
max0.974-1.434=-0.460

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.479-460.358=5.121
σ572.660-572.653=0.007
min179.142-174.027=5.114
max1324.470-1319.338=5.132
mean79.500
σ7.000
min76.000
max90.000
mean2745.000-2636.000=109.000
σ0.000
min2745.000-2636.000=109.000
max2745.000-2636.000=109.000
mean0.477-0.554=-0.077
σ0.395-0.559=-0.164
min0.279-0.269=0.011
max1.070-1.393=-0.323
policies=20
mean1791.698-1740.489=51.208
σ0.325-0.312=0.013
min1791.509-1740.296=51.212
max1792.183-1740.955=51.228
mean760.000
σ0.000
min760.000
max760.000
mean2745.000-2636.000=109.000
σ0.000
min2745.000-2636.000=109.000
max2745.000-2636.000=109.000
mean2.804-2.679=0.125
σ0.019-0.010=0.009
min2.787-2.670=0.117
max2.826-2.693=0.133
policies=200
mean17923.420-17411.993=511.426
σ0.477-0.475=0.002
min17922.978-17411.723=511.255
max17924.097-17412.705=511.392
mean7600.000
σ0.000
min7600.000
max7600.000
mean2745.000-2636.000=109.000
σ0.000
min2745.000-2636.000=109.000
max2745.000-2636.000=109.000
mean28.307-26.991=1.316
σ0.271-0.106=0.165
min28.085-26.890=1.195
max28.652-27.122=1.530