Compare commits

Home / Compare 072bf348 .. 2e6f16bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.041=-0.000
σ0.050-0.049=0.000
min31.000-30.999=0.000
max31.178-31.176=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.079-0.079=0.000
σ0.003-0.003=0.000
min0.077-0.077=-0.000
max0.085-0.087=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.003-0.003=-0.000
min21.139-21.137=0.003
max21.147-21.145=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.061=0.005
σ0.002-0.004=-0.002
min0.064-0.058=0.006
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.412=-0.001
σ0.361-0.361=-0.001
min1750.848-1750.844=0.003
max1751.999-1751.993=0.006
mean1654.300-1653.600=0.700
σ646.558-616.949=29.609
min651.000-638.000=13.000
max2848.000-2492.000=356.000
mean2.810-2.828=-0.018
σ0.181-0.157=0.024
min2.277-2.466=-0.189
max3.049-3.121=-0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.070-279.069=0.000
σ0.006-0.012=-0.006
min279.060-279.053=0.007
max279.076-279.083=-0.007
mean2848.000-2492.000=356.000
σ0.000
min2848.000-2492.000=356.000
max2848.000-2492.000=356.000
mean0.391-0.389=0.002
σ0.005-0.005=0.000
min0.386-0.384=0.002
max0.397-0.396=0.000
iters=5
new-facts=1
prior-facts=6402
mean1939.513-1939.524=-0.011
σ0.007-0.016=-0.009
min1939.506-1939.507=-0.001
max1939.525-1939.544=-0.019
mean2848.000-2492.000=356.000
σ0.000
min2848.000-2492.000=356.000
max2848.000-2492.000=356.000
mean2.986-2.830=0.156
σ0.278-0.270=0.008
min2.508-2.468=0.040
max3.207-3.057=0.150
iters=5
new-facts=6402
prior-facts=1
mean4760.063-4760.060=0.003
σ0.789-0.860=-0.070
min4759.600-4759.565=0.036
max4761.465-4761.586=-0.121
mean2848.000-2492.000=356.000
σ0.000
min2848.000-2492.000=356.000
max2848.000-2492.000=356.000
mean8.140-8.095=0.045
σ0.330-0.627=-0.298
min7.742-7.640=0.102
max8.493-9.168=-0.675
iters=5
new-facts=6402
prior-facts=6402
mean4950.399-4950.399=-0.001
σ0.129-0.120=0.008
min4950.201-4950.212=-0.011
max4950.560-4950.549=0.012
mean3060.800-2959.000=101.800
σ288.266-411.934=-123.668
min2848.000-2492.000=356.000
max3510.000-3519.000=-9.000
mean8.479-8.491=-0.012
σ0.148-0.168=-0.020
min8.305-8.392=-0.087
max8.653-8.788=-0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.711=-0.678
σ0.141-0.069=0.072
min0.940-1.603=-0.663
max1.264-1.765=-0.501

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.343-463.333=0.010
σ572.194-572.196=-0.002
min177.237-177.230=0.007
max1321.634-1321.627=0.007
mean79.750
σ7.500
min76.000
max91.000
mean2848.000-2492.000=356.000
σ0.000
min2848.000-2492.000=356.000
max2848.000-2492.000=356.000
mean0.442-0.558=-0.116
σ0.308-0.548=-0.239
min0.285-0.277=0.008
max0.904-1.379=-0.475
policies=20
mean1772.628-1772.556=0.072
σ0.328-0.326=0.002
min1772.389-1772.333=0.056
max1773.108-1773.039=0.069
mean760.000
σ0.000
min760.000
max760.000
mean2848.000-2492.000=356.000
σ0.000
min2848.000-2492.000=356.000
max2848.000-2492.000=356.000
mean2.846-2.733=0.113
σ0.011-0.008=0.003
min2.835-2.723=0.112
max2.855-2.740=0.116
policies=200
mean17732.565-17732.392=0.173
σ0.462-0.418=0.044
min17732.246-17732.026=0.220
max17733.251-17732.986=0.265
mean7600.000
σ0.000
min7600.000
max7600.000
mean2848.000-2492.000=356.000
σ0.000
min2848.000-2492.000=356.000
max2848.000-2492.000=356.000
mean28.236-27.734=0.501
σ0.435-0.145=0.290
min27.755-27.544=0.212
max28.651-27.880=0.771