Compare commits

Home / Compare 216c21a2 .. dc7c4979

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728
σ0.681
min35.927
max37.526
mean3799.000
σ0.000
min3799.000
max3799.000
mean0.076
σ0.002
min0.073
max0.081
cache=y
dps=1
iters=10
policies=100
mean26.585
σ0.604
min26.204
max27.465
mean3799.000
σ0.000
min3799.000
max3799.000
mean0.060
σ0.001
min0.059
max0.064

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1740.576=15.790
σ0.371-0.368=0.003
min1755.794-1739.990=15.804
max1756.961-1741.180=15.780
mean1659.500-1660.100=-0.600
σ624.386-605.027=19.359
min677.000-616.000=61.000
max2674.000-2468.000=206.000
mean2.260-2.649=-0.389
σ0.143-0.168=-0.025
min2.137-2.115=0.022
max2.786-2.864=-0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.698
σ0.013
min278.690
max278.721
mean2674.000
σ0.000
min2674.000
max2674.000
mean0.416
σ0.001
min0.415
max0.418
iters=5
new-facts=1
prior-facts=6402
mean2268.860
σ0.017
min2268.837
max2268.874
mean2674.000
σ0.000
min2674.000
max2674.000
mean3.141
σ0.166
min2.909
max3.357
iters=5
new-facts=6402
prior-facts=1
mean4952.367
σ0.796
min4951.962
max4953.789
mean2674.000
σ0.000
min2674.000
max2674.000
mean7.808
σ0.138
min7.646
max7.980
iters=5
new-facts=6402
prior-facts=6402
mean5166.929
σ0.311
min5166.372
max5167.074
mean3354.200
σ438.264
min2923.000
max3799.000
mean9.374
σ0.279
min8.999
max9.691

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.578
σ0.338
min1.251
max1.949

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.256-499.159=-38.903
σ572.610-663.562=-90.952
min173.946-167.372=6.574
max1319.171-1494.503=-175.332
mean79.500-77.250=2.250
σ7.000-6.500=0.500
min76.000-74.000=2.000
max90.000-87.000=3.000
mean435.000-436.000=-1.000
σ0.000
min435.000-436.000=-1.000
max435.000-436.000=-1.000
mean0.543-0.560=-0.017
σ0.533-0.589=-0.056
min0.272-0.262=0.011
max1.342-1.444=-0.101
policies=20
mean1740.047-1675.131=64.917
σ0.331-0.844=-0.513
min1739.808-1674.260=65.548
max1740.534-1676.230=64.305
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean446.750-446.000=0.750
σ10.874-10.392=0.482
min435.000-437.000=-2.000
max456.000-461.000=-5.000
mean2.664-2.628=0.036
σ0.016-0.013=0.002
min2.647-2.618=0.029
max2.684-2.647=0.036
policies=200
mean17409.677-16771.777=637.901
σ0.059-0.124=-0.065
min17409.609-16771.602=638.007
max17409.731-16771.883=637.848
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean490.000-496.000=-6.000
σ2.449-3.651=-1.202
min488.000-492.000=-4.000
max493.000-500.000=-7.000
mean26.915-26.561=0.354
σ0.049-0.073=-0.025
min26.872-26.500=0.371
max26.976-26.665=0.311