Compare commits

Home / Compare 009c15fa .. 6b4f24e9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.370=0.000
min53.868-53.872=-0.003
max55.069-55.067=0.002
mean415.700-416.700=-1.000
σ0.483
min415.000-416.000=-1.000
max416.000-417.000=-1.000
mean0.137-0.138=-0.000
σ0.006-0.004=0.001
min0.129-0.132=-0.002
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.005-0.007=-0.002
min43.315-43.307=0.007
max43.330-43.334=-0.004
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.122-0.123=-0.001
σ0.004-0.006=-0.002
min0.118-0.118=-0.000
max0.129-0.136=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.312-1006.315=-0.003
σ1.164-1.155=0.010
min1005.744-1005.738=0.006
max1011.181-1011.143=0.038
mean1049.350-1048.900=0.450
σ303.784-313.452=-9.667
min597.000-599.000=-2.000
max1640.000-1646.000=-6.000
mean1.556-1.478=0.078
σ0.091-0.061=0.029
min1.454-1.373=0.081
max1.837-1.624=0.213

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.414
σ0.166
min0.311
max0.706
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.924
σ0.164
min0.831
max1.217
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.534
σ0.049
min0.489
max0.613
name=nested_use.art
mean2.361
σ0.003
min2.359
max2.365
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.844
σ0.033
min0.816
max0.897

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.112
σ0.022
min964.090
max964.145
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.810
σ0.043
min0.739
max0.850
name=cdr_enhanced_4k_loc.art
mean884.713
σ0.001
min884.712
max884.714
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.708
σ0.036
min0.666
max0.739

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1640.000
σ0.000
min1640.000
max1640.000
mean4.277
σ0.090
min4.134
max4.695
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1640.000
σ0.000
min1640.000
max1640.000
mean4.246
σ0.071
min4.133
max4.539
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.732
σ0.017
min0.705
max0.834
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.691
σ0.017
min0.649
max0.780

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.193-296.158=0.035
σ0.190-0.238=-0.049
min296.010-295.892=0.118
max296.705-296.773=-0.068
mean1906.000-1950.000=-44.000
σ0.000
min1906.000-1950.000=-44.000
max1906.000-1950.000=-44.000
mean0.594-0.529=0.065
σ0.035-0.028=0.006
min0.550-0.500=0.050
max0.680-0.571=0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.695=-0.002
σ0.038-0.035=0.003
min284.642-284.653=-0.011
max284.736-284.737=-0.002
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.395-0.394=0.002
σ0.011-0.007=0.004
min0.383-0.388=-0.005
max0.407-0.402=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.074-1295.055=0.019
σ0.109-0.082=0.028
min1294.963-1294.964=-0.001
max1295.207-1295.165=0.042
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean1.915-1.915=-0.000
σ0.100-0.102=-0.001
min1.798-1.782=0.016
max2.020-2.049=-0.030
iters=5
new-facts=6402
prior-facts=1
mean1539.186-1539.201=-0.014
σ6.840-6.876=-0.036
min1535.924-1535.900=0.024
max1551.419-1551.495=-0.076
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean2.240-2.346=-0.105
σ0.263-0.307=-0.044
min2.040-2.015=0.025
max2.666-2.714=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.974=0.006
σ0.063-0.071=-0.007
min1856.907-1856.911=-0.004
max1857.069-1857.073=-0.004
mean1773.200-1765.600=7.600
σ130.433-126.603=3.830
min1640.000-1646.000=-6.000
max1906.000-1950.000=-44.000
mean3.061-2.892=0.168
σ0.289-0.109=0.179
min2.851-2.787=0.063
max3.566-3.046=0.520

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.220=-0.083
σ0.254-0.286=-0.032
min0.936-0.928=0.008
max1.526-1.555=-0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.808=-0.023
σ581.212-581.231=-0.019
min157.177-157.184=-0.006
max1319.603-1319.655=-0.052
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.535-0.528=0.007
σ0.549-0.536=0.013
min0.258-0.258=-0.000
max1.359-1.332=0.027
policies=20
mean1572.103-1572.132=-0.029
σ0.355-0.325=0.029
min1571.867-1571.944=-0.077
max1572.631-1572.619=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean2.629-2.618=0.011
σ0.024-0.013=0.011
min2.607-2.607=-0.000
max2.655-2.637=0.018
policies=200
mean15728.972-15728.958=0.013
σ0.076-0.153=-0.077
min15728.902-15728.807=0.095
max15729.050-15729.160=-0.110
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean26.535-26.496=0.039
σ0.082-0.134=-0.052
min26.470-26.373=0.097
max26.654-26.625=0.030