Compare commits

Home / Compare 289c187b .. b1a60855

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.001
σ0.049-0.049=-0.000
min31.004-31.004=0.000
max31.177-31.178=-0.001
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.080-0.078=0.002
σ0.003-0.005=-0.002
min0.077-0.072=0.005
max0.086-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.000
σ0.003-0.002=0.000
min21.138-21.140=-0.002
max21.146-21.146=-0.000
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.065-0.065=0.001
σ0.003-0.003=0.000
min0.063-0.063=-0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.414-1751.410=0.004
σ0.361-0.365=-0.005
min1750.849-1750.849=-0.001
max1751.999-1751.995=0.004
mean1658.400-1659.500=-1.100
σ638.411-626.261=12.151
min621.000-679.000=-58.000
max2785.000-2665.000=120.000
mean2.877-2.900=-0.023
σ0.188-0.150=0.038
min2.255-2.656=-0.401
max3.152-3.214=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.641-271.649=-0.008
σ0.008-0.011=-0.002
min271.629-271.637=-0.008
max271.652-271.663=-0.012
mean2785.000-2665.000=120.000
σ0.000
min2785.000-2665.000=120.000
max2785.000-2665.000=120.000
mean0.391-0.387=0.004
σ0.011-0.008=0.003
min0.378-0.377=0.001
max0.408-0.400=0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.113-1932.120=-0.007
σ0.008-0.017=-0.010
min1932.105-1932.100=0.005
max1932.123-1932.147=-0.024
mean2785.000-2665.000=120.000
σ0.000
min2785.000-2665.000=120.000
max2785.000-2665.000=120.000
mean2.545-2.627=-0.082
σ0.111-0.122=-0.011
min2.471-2.494=-0.023
max2.741-2.790=-0.049
iters=5
new-facts=6402
prior-facts=1
mean4752.599-4752.587=0.012
σ0.853-0.891=-0.038
min4752.089-4752.065=0.024
max4754.118-4754.173=-0.055
mean2785.000-2665.000=120.000
σ0.000
min2785.000-2665.000=120.000
max2785.000-2665.000=120.000
mean8.511-8.582=-0.071
σ0.428-0.548=-0.120
min7.780-7.683=0.097
max8.896-9.167=-0.271
iters=5
new-facts=6402
prior-facts=6402
mean4943.042-4942.982=0.060
σ0.083-0.201=-0.118
min4942.968-4942.646=0.322
max4943.133-4943.150=-0.017
mean3037.800-3013.200=24.600
σ201.635-313.756=-112.121
min2785.000-2665.000=120.000
max3313.000-3326.000=-13.000
mean8.613-8.891=-0.278
σ0.245-0.308=-0.062
min8.388-8.517=-0.129
max8.985-9.259=-0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.162=-0.150
σ0.141-0.284=-0.143
min0.943-0.931=0.012
max1.265-1.606=-0.341

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.122-465.121=0.001
σ575.755-575.781=-0.026
min177.236-177.228=0.008
max1328.755-1328.793=-0.038
mean79.750
σ7.500
min76.000
max91.000
mean2785.000-2665.000=120.000
σ0.000
min2785.000-2665.000=120.000
max2785.000-2665.000=120.000
mean0.444-0.554=-0.110
σ0.315-0.546=-0.230
min0.282-0.279=0.003
max0.917-1.372=-0.455
policies=20
mean1772.646-1772.586=0.060
σ0.346-0.320=0.025
min1772.397-1772.373=0.024
max1773.149-1773.062=0.087
mean760.000
σ0.000
min760.000
max760.000
mean2785.000-2665.000=120.000
σ0.000
min2785.000-2665.000=120.000
max2785.000-2665.000=120.000
mean2.842-2.749=0.093
σ0.095-0.029=0.066
min2.776-2.710=0.066
max2.978-2.775=0.204
policies=200
mean17732.358-17732.382=-0.024
σ0.422-0.448=-0.027
min17732.049-17732.076=-0.027
max17732.973-17733.037=-0.064
mean7600.000
σ0.000
min7600.000
max7600.000
mean2785.000-2665.000=120.000
σ0.000
min2785.000-2665.000=120.000
max2785.000-2665.000=120.000
mean27.850-27.795=0.055
σ0.085-0.165=-0.080
min27.796-27.707=0.089
max27.977-28.042=-0.066