Compare commits

Home / Compare 6d5146cf .. de50a386

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.049=-0.034
σ0.369-0.370=-0.001
min53.865-53.905=-0.040
max55.065-55.102=-0.037
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.139-0.139=0.000
σ0.004-0.005=-0.001
min0.135-0.131=0.004
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.321-43.342=-0.021
σ0.005-0.008=-0.002
min43.314-43.332=-0.019
max43.331-43.354=-0.023
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.122-0.121=0.001
σ0.005-0.004=0.001
min0.117-0.115=0.002
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1017.198=-10.890
σ1.177-1.169=0.008
min1005.765-1016.630=-10.865
max1011.238-1022.099=-10.860
mean1040.950-1052.650=-11.700
σ312.072-303.635=8.437
min593.000
max1630.000-1639.000=-9.000
mean1.555-1.552=0.004
σ0.065-0.102=-0.038
min1.481-1.375=0.106
max1.740-1.808=-0.068

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.404
σ0.129
min0.330
max0.633
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.888
σ0.091
min0.828
max1.049
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.540
σ0.049
min0.500
max0.620
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.838
σ0.034
min0.814
max0.896

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.022
min964.093
max964.146
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.803
σ0.074
min0.692
max0.862
name=cdr_enhanced_4k_loc.art
mean884.713
σ0.006
min884.705
max884.722
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.715
σ0.027
min0.687
max0.748

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.720
mean1630.000
σ0.000
min1630.000
max1630.000
mean4.243
σ0.097
min4.083
max4.611
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1630.000
σ0.000
min1630.000
max1630.000
mean4.221
σ0.088
min4.083
max4.666
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.737
σ0.020
min0.703
max0.867
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1630.000
σ0.000
min1630.000
max1630.000
mean0.699
σ0.013
min0.671
max0.754

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.290-302.272=-5.982
σ0.255-0.180=0.075
min296.090-302.149=-6.059
max296.959-302.761=-5.801
mean1902.000-2025.000=-123.000
σ0.000
min1902.000-2025.000=-123.000
max1902.000-2025.000=-123.000
mean0.576-0.567=0.009
σ0.049-0.041=0.007
min0.504-0.503=0.000
max0.693-0.605=0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-303.776=-19.079
σ0.029-0.069=-0.039
min284.671-303.666=-18.995
max284.733-303.840=-19.107
mean1630.000-1639.000=-9.000
σ0.000
min1630.000-1639.000=-9.000
max1630.000-1639.000=-9.000
mean0.395-0.395=0.001
σ0.010-0.007=0.002
min0.384-0.390=-0.006
max0.404-0.408=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.049-1326.326=-31.278
σ0.100-0.102=-0.002
min1294.953-1326.195=-31.242
max1295.201-1326.452=-31.251
mean1630.000-1639.000=-9.000
σ0.000
min1630.000-1639.000=-9.000
max1630.000-1639.000=-9.000
mean1.919-1.942=-0.023
σ0.171-0.092=0.079
min1.820-1.839=-0.020
max2.220-2.044=0.176
iters=5
new-facts=6402
prior-facts=1
mean1539.281-1564.395=-25.114
σ6.785-6.903=-0.118
min1536.103-1561.111=-25.008
max1551.415-1576.739=-25.324
mean1630.000-1639.000=-9.000
σ0.000
min1630.000-1639.000=-9.000
max1630.000-1639.000=-9.000
mean2.360-2.356=0.004
σ0.261-0.304=-0.042
min2.098-2.074=0.024
max2.787-2.728=0.060
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1894.264=-37.275
σ0.053-0.061=-0.008
min1856.939-1894.162=-37.224
max1857.065-1894.312=-37.247
mean1768.000-1772.400=-4.400
σ131.773-163.792=-32.019
min1630.000-1639.000=-9.000
max1902.000-2025.000=-123.000
mean3.045-2.920=0.125
σ0.301-0.153=0.148
min2.819-2.729=0.090
max3.562-3.149=0.413

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.180-1.304=-0.123
σ0.325-0.375=-0.050
min0.924-0.942=-0.018
max1.709-1.818=-0.110

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-448.343=-0.557
σ581.212-581.800=-0.589
min157.179-157.439=-0.260
max1319.604-1321.044=-1.440
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1639.000=-9.000
σ0.000
min1630.000-1639.000=-9.000
max1630.000-1639.000=-9.000
mean0.543-0.562=-0.020
σ0.564-0.592=-0.028
min0.259-0.262=-0.003
max1.388-1.451=-0.062
policies=20
mean1572.106-1574.613=-2.508
σ0.358-0.323=0.035
min1571.864-1574.413=-2.549
max1572.637-1575.096=-2.458
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1639.000=-9.000
σ0.000
min1630.000-1639.000=-9.000
max1630.000-1639.000=-9.000
mean2.631-2.603=0.028
σ0.006-0.019=-0.013
min2.624-2.579=0.045
max2.637-2.626=0.011
policies=200
mean15729.093-15754.292=-25.200
σ0.104-0.061=0.043
min15729.011-15754.223=-25.211
max15729.245-15754.356=-25.111
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1639.000=-9.000
σ0.000
min1630.000-1639.000=-9.000
max1630.000-1639.000=-9.000
mean26.554-26.563=-0.009
σ0.153-0.195=-0.042
min26.457-26.394=0.063
max26.783-26.782=0.001