Compare commits

Home / Compare bdcea6c7 .. 80bb2a73

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=0.000
σ0.049-0.046=0.003
min31.003-31.002=0.000
max31.178-31.169=0.009
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.079-0.079=0.000
σ0.003-0.003=0.001
min0.076-0.076=0.000
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.002
σ0.002-0.003=-0.002
min21.140-21.138=0.002
max21.145-21.149=-0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.062-0.063=-0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.410=0.001
σ0.360-0.360=-0.000
min1750.843-1750.843=0.000
max1751.994-1751.985=0.009
mean1649.200-1665.950=-16.750
σ620.484-620.099=0.385
min682.000-634.000=48.000
max2643.000-2512.000=131.000
mean2.779-2.707=0.072
σ0.189-0.251=-0.063
min2.393-2.144=0.248
max3.194-3.048=0.146

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.781-266.782=-0.000
σ0.010-0.004=0.005
min266.772-266.777=-0.005
max266.796-266.788=0.008
mean2643.000-2512.000=131.000
σ0.000
min2643.000-2512.000=131.000
max2643.000-2512.000=131.000
mean0.373-0.365=0.008
σ0.010-0.001=0.009
min0.364-0.364=-0.001
max0.385-0.367=0.018
iters=5
new-facts=1
prior-facts=6402
mean1927.214-1787.049=140.165
σ0.007-313.416=-313.409
min1927.204-1226.393=700.810
max1927.220-1927.253=-0.033
mean2643.000-2512.000=131.000
σ0.000
min2643.000-2512.000=131.000
max2643.000-2512.000=131.000
mean3.023-2.852=0.171
σ0.206-0.571=-0.365
min2.738-1.848=0.891
max3.305-3.257=0.048
iters=5
new-facts=6402
prior-facts=1
mean4747.773-4747.616=0.157
σ0.775-0.875=-0.099
min4747.365-4746.826=0.539
max4749.152-4749.121=0.031
mean2643.000-2512.000=131.000
σ0.000
min2643.000-2512.000=131.000
max2643.000-2512.000=131.000
mean8.129-8.195=-0.066
σ0.428-0.519=-0.090
min7.845-7.621=0.225
max8.888-8.755=0.133
iters=5
new-facts=6402
prior-facts=6402
mean4938.171-4938.097=0.074
σ0.086-0.120=-0.035
min4938.106-4937.914=0.192
max4938.274-4938.252=0.022
mean2980.800-2951.600=29.200
σ371.307-367.588=3.719
min2643.000-2512.000=131.000
max3498.000-3436.000=62.000
mean8.376-8.672=-0.295
σ0.154-0.168=-0.014
min8.262-8.552=-0.289
max8.645-8.968=-0.323

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.714=-0.505
σ0.386-0.174=0.212
min0.922-1.419=-0.496
max1.855-1.867=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.126-465.115=0.010
σ575.778-575.756=0.023
min177.232-177.234=-0.002
max1328.793-1328.748=0.045
mean79.750
σ7.500
min76.000
max91.000
mean2643.000-2512.000=131.000
σ0.000
min2643.000-2512.000=131.000
max2643.000-2512.000=131.000
mean0.555-0.556=-0.001
σ0.549-0.549=-0.001
min0.278-0.277=0.001
max1.378-1.380=-0.002
policies=20
mean1772.591-1772.587=0.004
σ0.328-0.334=-0.005
min1772.370-1772.364=0.007
max1773.078-1773.083=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean2643.000-2512.000=131.000
σ0.000
min2643.000-2512.000=131.000
max2643.000-2512.000=131.000
mean2.745-2.765=-0.020
σ0.003-0.025=-0.022
min2.741-2.737=0.004
max2.747-2.790=-0.042
policies=200
mean17732.364-17732.530=-0.166
σ0.459-0.499=-0.040
min17732.054-17732.245=-0.191
max17733.045-17733.277=-0.232
mean7600.000
σ0.000
min7600.000
max7600.000
mean2643.000-2512.000=131.000
σ0.000
min2643.000-2512.000=131.000
max2643.000-2512.000=131.000
mean27.713-27.722=-0.009
σ0.287-0.145=0.142
min27.488-27.589=-0.100
max28.135-27.928=0.207