Compare commits

Home / Compare 54bf5b53 .. 2ce9bec3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.781=-0.001
σ0.047-0.044=0.003
min70.747-70.752=-0.005
max70.911-70.904=0.006
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.158-0.159=-0.002
σ0.005-0.004=0.001
min0.150-0.156=-0.006
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.000
σ0.003-0.002=0.001
min21.488-21.487=0.001
max21.496-21.495=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.066-0.061=0.005
σ0.003-0.004=-0.000
min0.063-0.059=0.005
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.001
σ0.359-0.361=-0.001
min1753.533-1753.531=0.002
max1754.680-1754.682=-0.002
mean1653.950-1659.800=-5.850
σ627.252-632.396=-5.144
min623.000-630.000=-7.000
max2771.000-2711.000=60.000
mean2.801-2.798=0.003
σ0.172-0.257=-0.086
min2.192-2.180=0.012
max2.973-3.114=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.952-271.956=-0.004
σ0.008-0.006=0.001
min271.942-271.949=-0.007
max271.964-271.966=-0.002
mean2771.000-2711.000=60.000
σ0.000
min2771.000-2711.000=60.000
max2771.000-2711.000=60.000
mean0.381-0.382=-0.001
σ0.007-0.009=-0.002
min0.377-0.377=0.000
max0.394-0.397=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.320-1932.339=-0.019
σ0.005-0.011=-0.006
min1932.314-1932.329=-0.015
max1932.326-1932.354=-0.028
mean2771.000-2711.000=60.000
σ0.000
min2771.000-2711.000=60.000
max2771.000-2711.000=60.000
mean3.094-2.775=0.319
σ0.075-0.248=-0.173
min3.029-2.485=0.544
max3.191-3.013=0.178
iters=5
new-facts=6402
prior-facts=1
mean4752.961-4753.078=-0.117
σ1.013-0.926=0.087
min4752.068-4752.549=-0.481
max4754.698-4754.707=-0.008
mean2771.000-2711.000=60.000
σ0.000
min2771.000-2711.000=60.000
max2771.000-2711.000=60.000
mean8.648-8.660=-0.012
σ0.621-0.644=-0.023
min7.611-7.946=-0.335
max9.147-9.317=-0.170
iters=5
new-facts=6402
prior-facts=6402
mean4943.493-4943.556=-0.063
σ0.168-0.019=0.150
min4943.193-4943.530=-0.338
max4943.576-4943.571=0.005
mean2998.000-3018.000=-20.000
σ224.980-247.547=-22.567
min2771.000-2711.000=60.000
max3325.000-3324.000=1.000
mean8.518-8.588=-0.070
σ0.112-0.179=-0.067
min8.409-8.443=-0.033
max8.646-8.811=-0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-0.996=0.026
σ0.135-0.141=-0.006
min0.933-0.930=0.002
max1.244-1.249=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.657-468.659=-0.002
σ574.927-574.928=-0.001
min181.186-181.187=-0.000
max1331.048-1331.051=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2711.000=60.000
σ0.000
min2771.000-2711.000=60.000
max2771.000-2711.000=60.000
mean0.447-0.573=-0.126
σ0.308-0.568=-0.260
min0.292-0.284=0.008
max0.909-1.425=-0.516
policies=20
mean1812.216-1812.202=0.014
σ0.391-0.393=-0.003
min1811.953-1811.924=0.029
max1812.789-1812.781=0.008
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2711.000=60.000
σ0.000
min2771.000-2711.000=60.000
max2771.000-2711.000=60.000
mean2.902-2.838=0.064
σ0.123-0.009=0.114
min2.828-2.830=-0.002
max3.085-2.850=0.235
policies=200
mean18129.188-18129.200=-0.012
σ0.509-0.462=0.047
min18128.833-18128.890=-0.057
max18129.944-18129.888=0.056
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2711.000=60.000
σ0.000
min2771.000-2711.000=60.000
max2771.000-2711.000=60.000
mean28.605-28.534=0.071
σ0.058-0.068=-0.010
min28.559-28.462=0.097
max28.689-28.625=0.064