Compare commits

Home / Compare b4cf4124 .. 5ea14a0c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.000
σ0.050-0.051=-0.001
min31.003-30.999=0.004
max31.179-31.180=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.080-0.077=0.003
σ0.003-0.005=-0.002
min0.077-0.070=0.007
max0.086-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.002=-0.000
min21.141-21.139=0.001
max21.146-21.146=0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.002
min0.063-0.058=0.005
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.412=-0.001
σ0.360-0.360=-0.000
min1750.847-1750.846=0.001
max1751.997-1751.989=0.008
mean1660.150-1629.150=31.000
σ621.833-599.524=22.309
min640.000-648.000=-8.000
max2506.000-2410.000=96.000
mean2.790-2.846=-0.056
σ0.190-0.148=0.042
min2.322-2.594=-0.272
max3.073-3.199=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.377-273.405=-0.027
σ0.007-0.010=-0.003
min273.369-273.392=-0.023
max273.387-273.416=-0.030
mean2506.000-2410.000=96.000
σ0.000
min2506.000-2410.000=96.000
max2506.000-2410.000=96.000
mean0.390-0.388=0.002
σ0.007-0.009=-0.001
min0.379-0.378=0.000
max0.397-0.395=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.839-1933.839=0.000
σ0.007-0.016=-0.009
min1933.832-1933.820=0.012
max1933.850-1933.859=-0.008
mean2506.000-2410.000=96.000
σ0.000
min2506.000-2410.000=96.000
max2506.000-2410.000=96.000
mean3.022-3.131=-0.109
σ0.228-0.313=-0.084
min2.689-2.924=-0.235
max3.319-3.681=-0.362
iters=5
new-facts=6402
prior-facts=1
mean4754.106-4754.286=-0.180
σ1.124-0.607=0.517
min4753.175-4753.889=-0.714
max4756.036-4755.355=0.681
mean2506.000-2410.000=96.000
σ0.000
min2506.000-2410.000=96.000
max2506.000-2410.000=96.000
mean8.763-8.136=0.626
σ0.714-0.565=0.149
min7.755-7.760=-0.006
max9.678-9.131=0.547
iters=5
new-facts=6402
prior-facts=6402
mean4944.797-4944.789=0.008
σ0.089-0.078=0.011
min4944.722-4944.729=-0.007
max4944.899-4944.878=0.021
mean3013.800-2938.200=75.600
σ311.552-411.722=-100.170
min2585.000-2468.000=117.000
max3302.000-3501.000=-199.000
mean9.020-8.416=0.604
σ0.335-0.102=0.233
min8.609-8.302=0.308
max9.369-8.559=0.810

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.761-1.846=-0.085
σ0.142-0.044=0.098
min1.612-1.792=-0.179
max1.913-1.905=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.334=-0.001
σ572.193-572.199=-0.006
min177.233-177.231=0.002
max1321.622-1321.633=-0.011
mean79.750
σ7.500
min76.000
max91.000
mean2506.000-2410.000=96.000
σ0.000
min2506.000-2410.000=96.000
max2506.000-2410.000=96.000
mean0.557-0.569=-0.012
σ0.550-0.578=-0.028
min0.277-0.275=0.002
max1.382-1.436=-0.055
policies=20
mean1772.584-1772.591=-0.007
σ0.332-0.332=0.001
min1772.356-1772.372=-0.016
max1773.076-1773.083=-0.007
mean760.000
σ0.000
min760.000
max760.000
mean2506.000-2410.000=96.000
σ0.000
min2506.000-2410.000=96.000
max2506.000-2410.000=96.000
mean2.739-2.743=-0.005
σ0.014-0.012=0.001
min2.725-2.735=-0.010
max2.757-2.762=-0.004
policies=200
mean17732.410-17732.401=0.010
σ0.395-0.594=-0.199
min17732.125-17732.030=0.096
max17732.995-17733.287=-0.292
mean7600.000
σ0.000
min7600.000
max7600.000
mean2506.000-2410.000=96.000
σ0.000
min2506.000-2410.000=96.000
max2506.000-2410.000=96.000
mean27.714-27.782=-0.069
σ0.092-0.193=-0.101
min27.635-27.645=-0.010
max27.838-28.056=-0.218