Compare commits

Home / Compare 4e57cc68 .. 57407c9c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-33.980=19.935
σ0.369-0.048=0.321
min53.786-33.951=19.835
max54.966-34.113=20.852
mean416.800-413.000=3.800
σ0.422-0.000=0.422
min416.000-413.000=3.000
max417.000-413.000=4.000
mean0.139-0.087=0.052
σ0.004-0.004=0.000
min0.135-0.084=0.051
max0.145-0.093=0.053
cache=y
dps=1
iters=10
policies=100
mean43.140-23.319=19.822
σ0.006-0.003=0.003
min43.132-23.314=19.818
max43.150-23.322=19.828
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.120-0.066=0.054
σ0.004-0.002=0.001
min0.115-0.064=0.051
max0.126-0.072=0.054

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.075-1757.493=-765.418
σ1.235-0.364=0.871
min991.503-1756.920=-765.417
max997.269-1758.083=-760.814
mean1060.450-1669.000=-608.550
σ314.726-624.730=-310.004
min604.000-663.000=-59.000
max1564.000-2692.000=-1128.000
mean1.563-2.363=-0.800
σ0.094-0.117=-0.022
min1.453-2.139=-0.687
max1.762-2.735=-0.972

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.676-326.716=-41.040
σ0.012-0.028=-0.016
min285.665-326.670=-41.005
max285.691-326.740=-41.049
mean1564.000-2692.000=-1128.000
σ0.000
min1564.000-2692.000=-1128.000
max1564.000-2692.000=-1128.000
mean0.385-0.427=-0.042
σ0.010-0.004=0.006
min0.376-0.423=-0.048
max0.397-0.433=-0.036
iters=5
new-facts=1
prior-facts=6402
mean1285.643-1988.877=-703.235
σ0.136-0.010=0.126
min1285.580-1988.865=-703.285
max1285.886-1988.890=-703.004
mean1564.000-2692.000=-1128.000
σ0.000
min1564.000-2692.000=-1128.000
max1564.000-2692.000=-1128.000
mean1.883-2.705=-0.822
σ0.081-0.090=-0.009
min1.813-2.638=-0.825
max2.016-2.863=-0.848
iters=5
new-facts=6402
prior-facts=1
mean1807.972-4813.601=-3005.630
σ7.042-7.784=-0.741
min1804.608-4809.700=-3005.091
max1820.554-4827.519=-3006.964
mean1564.000-2692.000=-1128.000
σ0.000
min1564.000-2692.000=-1128.000
max1564.000-2692.000=-1128.000
mean4.174-8.757=-4.584
σ0.216-0.163=0.054
min3.981-8.594=-4.613
max4.541-8.980=-4.439
iters=5
new-facts=6402
prior-facts=6402
mean2070.460-5001.202=-2930.741
σ0.010-0.151=-0.141
min2070.450-5000.933=-2930.483
max2070.473-5001.293=-2930.820
mean1835.400-3011.400=-1176.000
σ201.866-233.021=-31.155
min1597.000-2692.000=-1095.000
max2086.000-3310.000=-1224.000
mean4.585-9.813=-5.228
σ0.159-0.083=0.076
min4.479-9.702=-5.223
max4.863-9.910=-5.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.447-1.078=0.369
σ0.325-0.222=0.102
min1.029-0.911=0.118
max1.775-1.332=0.443

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.374-464.632=-27.258
σ572.351-574.781=-2.431
min151.195-177.240=-26.044
max1295.900-1326.803=-30.904
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1564.000-2692.000=-1128.000
σ0.000
min1564.000-2692.000=-1128.000
max1564.000-2692.000=-1128.000
mean0.534-0.557=-0.023
σ0.545-0.569=-0.024
min0.258-0.270=-0.012
max1.352-1.411=-0.059
policies=20
mean1512.217-1772.661=-260.444
σ0.265-0.353=-0.088
min1512.047-1772.417=-260.370
max1512.611-1773.184=-260.573
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1564.000-2692.000=-1128.000
σ0.000
min1564.000-2692.000=-1128.000
max1564.000-2692.000=-1128.000
mean2.551-2.709=-0.158
σ0.013-0.016=-0.003
min2.541-2.691=-0.150
max2.570-2.729=-0.160
policies=200
mean15129.551-17733.909=-2604.358
σ0.090-0.400=-0.310
min15129.494-17733.503=-2604.008
max15129.685-17734.455=-2604.770
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1564.000-2692.000=-1128.000
σ0.000
min1564.000-2692.000=-1128.000
max1564.000-2692.000=-1128.000
mean25.647-27.500=-1.852
σ0.089-0.170=-0.082
min25.553-27.352=-1.799
max25.766-27.684=-1.917