Compare commits

Home / Compare d81d64a3 .. c94223b2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.983=-0.010
σ0.107-0.100=0.006
min35.922-35.942=-0.021
max36.276-36.267=0.008
mean413.000-4135.000=-3722.000
σ0.000
min413.000-4135.000=-3722.000
max413.000-4135.000=-3722.000
mean0.078-0.076=0.002
σ0.004-0.001=0.003
min0.075-0.074=0.001
max0.085-0.077=0.008
cache=y
dps=1
iters=10
policies=100
mean26.208-26.211=-0.003
σ0.002-0.004=-0.002
min26.204-26.207=-0.003
max26.211-26.219=-0.008
mean413.000-4135.000=-3722.000
σ0.000
min413.000-4135.000=-3722.000
max413.000-4135.000=-3722.000
mean0.061-0.060=0.001
σ0.003-0.000=0.002
min0.059-0.060=-0.001
max0.069-0.061=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.362-1718.328=40.034
σ0.372-170.162=-169.790
min1757.786-995.393=762.393
max1758.961-1756.973=1.988
mean1655.150-1618.350=36.800
σ620.424-612.250=8.175
min685.000-616.000=69.000
max2746.000-2654.000=92.000
mean2.368-2.224=0.144
σ0.114-0.267=-0.153
min2.178-1.271=0.907
max2.634-2.759=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-278.701=0.811
σ0.007-0.010=-0.003
min279.503-278.690=0.813
max279.517-278.717=0.800
mean2746.000-2654.000=92.000
σ0.000
min2746.000-2654.000=92.000
max2746.000-2654.000=92.000
mean0.409-0.418=-0.009
σ0.002-0.002=-0.000
min0.405-0.415=-0.010
max0.410-0.421=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2178.418-2268.874=-90.456
σ0.034-0.005=0.029
min2178.359-2268.869=-90.509
max2178.443-2268.879=-90.436
mean2746.000-2654.000=92.000
σ0.000
min2746.000-2654.000=92.000
max2746.000-2654.000=92.000
mean3.432-3.106=0.325
σ0.172-0.189=-0.017
min3.271-2.878=0.393
max3.620-3.346=0.274
iters=5
new-facts=6402
prior-facts=1
mean5056.392-4952.198=104.194
σ1.004-0.771=0.233
min5055.790-4951.729=104.061
max5058.177-4953.568=104.609
mean2746.000-2654.000=92.000
σ0.000
min2746.000-2654.000=92.000
max2746.000-2654.000=92.000
mean8.715-7.889=0.826
σ0.657-0.276=0.381
min8.163-7.616=0.547
max9.736-8.348=1.389
iters=5
new-facts=6402
prior-facts=6402
mean5193.689-5166.916=26.772
σ0.212-0.023=0.189
min5193.338-5166.886=26.452
max5193.874-5166.948=26.926
mean3285.800-3376.400=-90.600
σ404.146-526.876=-122.731
min2746.000-2907.000=-161.000
max3673.000-4135.000=-462.000
mean8.832-9.121=-0.288
σ0.095-0.379=-0.284
min8.705-8.540=0.165
max8.970-9.518=-0.548

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-1.058=-0.058
σ0.072-0.124=-0.052
min0.937-0.947=-0.010
max1.080-1.248=-0.169

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.476-460.258=5.218
σ572.661-572.607=0.054
min179.137-173.954=5.184
max1324.468-1319.169=5.299
mean79.500
σ7.000
min76.000
max90.000
mean2746.000-436.000=2310.000
σ0.000
min2746.000-436.000=2310.000
max2746.000-436.000=2310.000
mean0.474-0.548=-0.074
σ0.379-0.542=-0.163
min0.282-0.271=0.011
max1.042-1.361=-0.319
policies=20
mean1791.671-1740.043=51.628
σ0.340-0.335=0.005
min1791.474-1739.797=51.677
max1792.178-1740.534=51.644
mean760.000
σ0.000
min760.000
max760.000
mean2746.000-445.750=2300.250
σ0.000-9.605=-9.605
min2746.000-436.000=2310.000
max2746.000-454.000=2292.000
mean2.818-2.669=0.149
σ0.006-0.014=-0.008
min2.811-2.651=0.160
max2.824-2.680=0.144
policies=200
mean17923.168-17409.808=513.360
σ0.510-0.081=0.429
min17922.880-17409.754=513.126
max17923.933-17409.926=514.007
mean7600.000
σ0.000
min7600.000
max7600.000
mean2746.000-494.000=2252.000
σ0.000-3.559=-3.559
min2746.000-490.000=2256.000
max2746.000-497.000=2249.000
mean28.237-26.905=1.332
σ0.094-0.029=0.065
min28.152-26.873=1.279
max28.368-26.936=1.432