Compare commits

Home / Compare f5b3882a .. 2ad5ab89

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.780=0.002
σ0.053-0.051=0.002
min70.751-70.756=-0.006
max70.932-70.924=0.008
mean413.000-412.400=0.600
σ0.000-0.516=-0.516
min413.000-412.000=1.000
max413.000
mean0.161-0.158=0.003
σ0.003-0.004=-0.001
min0.158-0.151=0.007
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.494-21.492=0.001
σ0.003-0.003=-0.001
min21.490-21.485=0.005
max21.497-21.496=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.066-0.063=0.003
σ0.003-0.004=-0.001
min0.064-0.060=0.003
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.883-1751.882=0.001
σ0.361-0.361=0.000
min1751.309-1751.317=-0.008
max1752.466-1752.461=0.005
mean1664.000-1631.000=33.000
σ631.643-601.377=30.266
min682.000-639.000=43.000
max2771.000-2423.000=348.000
mean2.864-2.801=0.063
σ0.097-0.147=-0.050
min2.688-2.451=0.237
max3.073-3.074=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.383-269.381=0.002
σ0.006-0.007=-0.001
min269.373-269.372=0.002
max269.389-269.390=-0.001
mean2771.000-2423.000=348.000
σ0.000
min2771.000-2423.000=348.000
max2771.000-2423.000=348.000
mean0.378-0.378=0.000
σ0.003-0.003=0.000
min0.376-0.376=0.000
max0.383-0.383=0.000
iters=5
new-facts=1
prior-facts=6402
mean1929.743-1929.745=-0.002
σ0.020-0.011=0.009
min1929.718-1929.730=-0.012
max1929.762-1929.758=0.004
mean2771.000-2423.000=348.000
σ0.000
min2771.000-2423.000=348.000
max2771.000-2423.000=348.000
mean2.986-2.943=0.043
σ0.127-0.130=-0.002
min2.779-2.798=-0.019
max3.129-3.072=0.057
iters=5
new-facts=6402
prior-facts=1
mean4750.155-4750.490=-0.335
σ1.085-0.859=0.226
min4749.466-4750.056=-0.590
max4752.046-4752.026=0.020
mean2771.000-2423.000=348.000
σ0.000
min2771.000-2423.000=348.000
max2771.000-2423.000=348.000
mean8.500-8.535=-0.035
σ0.473-0.424=0.049
min7.744-7.854=-0.110
max8.991-8.898=0.093
iters=5
new-facts=6402
prior-facts=6402
mean4940.928-4940.913=0.015
σ0.135-0.152=-0.016
min4940.687-4940.643=0.044
max4941.005-4940.994=0.011
mean2983.600-2920.600=63.000
σ271.312-330.766=-59.454
min2771.000-2423.000=348.000
max3398.000-3303.000=95.000
mean8.433-8.523=-0.089
σ0.121-0.135=-0.014
min8.354-8.397=-0.044
max8.646-8.735=-0.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.110-1.798=-0.689
σ0.252-0.162=0.091
min0.935-1.546=-0.611
max1.499-1.938=-0.439

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.704-462.685=0.018
σ574.940-574.927=0.013
min175.227-175.219=0.007
max1325.113-1325.076=0.037
mean86.250
σ8.500
min82.000
max99.000
mean2771.000-2423.000=348.000
σ0.000
min2771.000-2423.000=348.000
max2771.000-2423.000=348.000
mean0.440-0.556=-0.116
σ0.307-0.548=-0.241
min0.281-0.277=0.005
max0.901-1.378=-0.478
policies=20
mean1752.545-1752.479=0.066
σ0.360-0.380=-0.020
min1752.295-1752.234=0.061
max1753.073-1753.045=0.028
mean820.000
σ0.000
min820.000
max820.000
mean2771.000-2423.000=348.000
σ0.000
min2771.000-2423.000=348.000
max2771.000-2423.000=348.000
mean2.789-2.733=0.056
σ0.109-0.041=0.068
min2.721-2.689=0.033
max2.952-2.772=0.180
policies=200
mean17532.417-17532.202=0.215
σ0.500-0.553=-0.053
min17532.139-17531.826=0.312
max17533.166-17533.008=0.158
mean8200.000
σ0.000
min8200.000
max8200.000
mean2771.000-2423.000=348.000
σ0.000
min2771.000-2423.000=348.000
max2771.000-2423.000=348.000
mean27.650-27.590=0.059
σ0.098-0.242=-0.144
min27.557-27.388=0.169
max27.787-27.930=-0.143