Compare commits

Home / Compare cd306e42 .. 1c1ee504

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.039=0.002
σ0.051-0.046=0.005
min30.999-31.004=-0.005
max31.181-31.168=0.014
mean415.000-414.700=0.300
σ0.000-0.483=-0.483
min415.000-414.000=1.000
max415.000
mean0.079-0.074=0.004
σ0.003-0.005=-0.002
min0.077-0.070=0.007
max0.087-0.084=0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.003=0.000
min21.136-21.138=-0.002
max21.145-21.146=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.063=0.001
σ0.004-0.003=0.001
min0.059-0.058=0.001
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.410=0.001
σ0.364-0.361=0.003
min1750.843-1750.845=-0.001
max1751.996-1751.973=0.022
mean1654.650-1660.300=-5.650
σ648.622-622.571=26.051
min651.000-638.000=13.000
max2858.000-2506.000=352.000
mean2.811-2.793=0.018
σ0.194-0.169=0.025
min2.318-2.433=-0.115
max3.213-3.017=0.196

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.070-273.400=5.670
σ0.004-0.012=-0.008
min279.064-273.389=5.675
max279.075-273.414=5.661
mean2858.000-2506.000=352.000
σ0.000
min2858.000-2506.000=352.000
max2858.000-2506.000=352.000
mean0.392-0.384=0.008
σ0.006-0.009=-0.003
min0.385-0.377=0.008
max0.399-0.397=0.002
iters=5
new-facts=1
prior-facts=6402
mean1939.520-1933.842=5.678
σ0.009-0.014=-0.005
min1939.508-1933.833=5.675
max1939.529-1933.866=5.663
mean2858.000-2506.000=352.000
σ0.000
min2858.000-2506.000=352.000
max2858.000-2506.000=352.000
mean3.071-2.949=0.122
σ0.089-0.185=-0.095
min2.983-2.648=0.335
max3.186-3.149=0.037
iters=5
new-facts=6402
prior-facts=1
mean4759.833-4754.225=5.608
σ0.972-0.597=0.375
min4759.085-4753.780=5.306
max4761.470-4755.274=6.196
mean2858.000-2506.000=352.000
σ0.000
min2858.000-2506.000=352.000
max2858.000-2506.000=352.000
mean8.139-8.508=-0.369
σ0.334-0.581=-0.247
min7.682-7.699=-0.017
max8.585-9.085=-0.500
iters=5
new-facts=6402
prior-facts=6402
mean4950.399-4944.714=5.685
σ0.209-0.201=0.008
min4950.050-4944.382=5.669
max4950.567-4944.877=5.691
mean3044.200-2963.800=80.400
σ266.387-431.363=-164.975
min2858.000-2506.000=352.000
max3462.000-3551.000=-89.000
mean8.377-8.417=-0.039
σ0.050-0.147=-0.097
min8.318-8.246=0.072
max8.441-8.644=-0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.750=-0.696
σ0.124-0.188=-0.065
min0.941-1.420=-0.479
max1.245-1.891=-0.646

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.340-463.333=0.007
σ572.196-572.198=-0.002
min177.240-177.233=0.007
max1321.634-1321.630=0.004
mean79.750
σ7.500
min76.000
max91.000
mean2858.000-2506.000=352.000
σ0.000
min2858.000-2506.000=352.000
max2858.000-2506.000=352.000
mean0.443-0.555=-0.113
σ0.306-0.551=-0.245
min0.284-0.278=0.005
max0.901-1.382=-0.481
policies=20
mean1772.618-1772.565=0.053
σ0.333-0.323=0.010
min1772.381-1772.368=0.012
max1773.106-1773.047=0.059
mean760.000
σ0.000
min760.000
max760.000
mean2858.000-2506.000=352.000
σ0.000
min2858.000-2506.000=352.000
max2858.000-2506.000=352.000
mean2.844-2.744=0.100
σ0.008-0.012=-0.004
min2.834-2.736=0.098
max2.852-2.762=0.090
policies=200
mean17732.452-17732.412=0.040
σ0.439-0.579=-0.140
min17731.976-17732.042=-0.067
max17733.037-17733.263=-0.226
mean7600.000
σ0.000
min7600.000
max7600.000
mean2858.000-2506.000=352.000
σ0.000
min2858.000-2506.000=352.000
max2858.000-2506.000=352.000
mean28.211-27.661=0.550
σ0.481-0.148=0.333
min27.701-27.527=0.174
max28.726-27.873=0.853