Compare commits

Home / Compare a56dbd2d .. f0b34377

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.378-36.419=-5.042
σ0.040-0.093=-0.054
min31.354-36.372=-5.018
max31.489-36.684=-5.194
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.077-0.077=0.000
σ0.005-0.005=0.001
min0.071-0.073=-0.003
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.299-26.322=-5.023
σ0.001-0.003=-0.002
min21.296-26.316=-5.019
max21.301-26.328=-5.027
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.064-0.061=0.002
σ0.004-0.003=0.001
min0.059-0.058=0.001
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1743.917-1748.621=-4.704
σ0.379-0.384=-0.006
min1743.325-1748.027=-4.702
max1744.532-1749.247=-4.715
mean1665.350-1649.550=15.800
σ622.839-618.711=4.128
min625.000-623.000=2.000
max2650.000-2646.000=4.000
mean2.807-2.400=0.407
σ0.157-0.159=-0.002
min2.301-2.273=0.027
max3.001-2.823=0.178

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.904-279.577=-1.673
σ0.005-0.010=-0.005
min277.898-279.566=-1.668
max277.912-279.587=-1.675
mean2650.000-2646.000=4.000
σ0.000
min2650.000-2646.000=4.000
max2650.000-2646.000=4.000
mean0.408-0.412=-0.004
σ0.006-0.005=0.001
min0.405-0.409=-0.005
max0.419-0.421=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2165.826-2172.207=-6.382
σ0.030-0.018=0.012
min2165.786-2172.176=-6.390
max2165.869-2172.218=-6.349
mean2650.000-2646.000=4.000
σ0.000
min2650.000-2646.000=4.000
max2650.000-2646.000=4.000
mean2.839-3.026=-0.187
σ0.130-0.154=-0.025
min2.753-2.795=-0.042
max3.068-3.208=-0.140
iters=5
new-facts=6402
prior-facts=1
mean5049.272-5054.048=-4.776
σ0.800-1.054=-0.254
min5048.281-5053.212=-4.930
max5050.508-5055.883=-5.375
mean2650.000-2646.000=4.000
σ0.000
min2650.000-2646.000=4.000
max2650.000-2646.000=4.000
mean9.207-9.348=-0.141
σ0.648-0.189=0.459
min8.336-9.068=-0.733
max10.063-9.527=0.535
iters=5
new-facts=6402
prior-facts=6402
mean5191.815-5201.398=-9.582
σ0.267-0.105=0.162
min5191.357-5201.292=-9.935
max5192.052-5201.508=-9.457
mean3162.800-3293.000=-130.200
σ443.321-412.667=30.654
min2650.000-2717.000=-67.000
max3779.000-3671.000=108.000
mean9.886-10.143=-0.256
σ0.230-0.293=-0.063
min9.602-9.677=-0.075
max10.179-10.466=-0.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.329-1.225=0.104
σ0.371-0.275=0.096
min1.012-0.993=0.019
max1.900-1.644=0.256

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean510.059-511.739=-1.680
σ663.624-663.631=-0.007
min178.244-179.920=-1.676
max1505.496-1507.186=-1.690
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2650.000-2646.000=4.000
σ0.000
min2650.000-2646.000=4.000
max2650.000-2646.000=4.000
mean0.589-0.585=0.004
σ0.610-0.584=0.026
min0.276-0.289=-0.013
max1.504-1.461=0.043
policies=20
mean1782.720-1799.447=-16.727
σ0.347-0.351=-0.005
min1782.508-1799.204=-16.696
max1783.238-1799.965=-16.728
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2650.000-2646.000=4.000
σ0.000
min2650.000-2646.000=4.000
max2650.000-2646.000=4.000
mean2.791-2.829=-0.039
σ0.025-0.017=0.008
min2.757-2.806=-0.049
max2.816-2.845=-0.029
policies=200
mean17833.715-18001.135=-167.420
σ0.533-0.507=0.027
min17833.404-18000.841=-167.437
max17834.512-18001.891=-167.379
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2650.000-2646.000=4.000
σ0.000
min2650.000-2646.000=4.000
max2650.000-2646.000=4.000
mean28.036-28.574=-0.538
σ0.159-0.225=-0.066
min27.897-28.333=-0.436
max28.226-28.826=-0.599