Compare commits

Home / Compare 70365fbb .. c798b7ea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.371-0.369=0.001
min53.868-53.870=-0.002
max55.069-55.065=0.004
mean415.700-416.700=-1.000
σ0.483
min415.000-416.000=-1.000
max416.000-417.000=-1.000
mean0.137-0.136=0.001
σ0.006-0.003=0.002
min0.129-0.132=-0.002
max0.148-0.143=0.005
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.005-0.005=0.000
min43.315-43.316=-0.002
max43.330-43.329=0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.122-0.119=0.003
σ0.004-0.002=0.002
min0.118-0.116=0.002
max0.129-0.121=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.312-1006.316=-0.004
σ1.164-1.155=0.009
min1005.744-1005.743=0.001
max1011.181-1011.140=0.041
mean1049.350-1055.350=-6.000
σ303.784-316.296=-12.512
min597.000-568.000=29.000
max1640.000-1620.000=20.000
mean1.556-1.526=0.030
σ0.091-0.071=0.019
min1.454-1.417=0.037
max1.837-1.742=0.095

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.414-0.420=-0.007
σ0.166-0.130=0.036
min0.311-0.329=-0.018
max0.706-0.638=0.068
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.924-0.871=0.053
σ0.164-0.092=0.072
min0.831-0.813=0.018
max1.217-1.032=0.184
name=heavy_item.art
mean1.523-1.523=0.000
σ0.002-0.002=-0.000
min1.522
max1.526
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.534-0.534=-0.001
σ0.049-0.055=-0.006
min0.489-0.486=0.004
max0.613-0.626=-0.012
name=nested_use.art
mean2.361-2.360=0.001
σ0.003-0.002=0.001
min2.359
max2.365-2.363=0.002
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.844-0.843=0.001
σ0.033-0.034=-0.001
min0.816-0.805=0.011
max0.897-0.897=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.112-964.115=-0.002
σ0.022-0.033=-0.010
min964.090-964.086=0.004
max964.145-964.169=-0.023
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.810-0.842=-0.032
σ0.043-0.017=0.027
min0.739-0.814=-0.075
max0.850-0.854=-0.004
name=cdr_enhanced_4k_loc.art
mean884.713-884.711=0.002
σ0.001-0.007=-0.007
min884.712-884.703=0.009
max884.714-884.721=-0.007
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.708-0.723=-0.015
σ0.036-0.017=0.019
min0.666-0.706=-0.040
max0.739-0.742=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.720=-0.002
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean4.277-4.228=0.049
σ0.090-0.111=-0.021
min4.134-4.065=0.069
max4.695-4.649=0.046
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean4.246-4.239=0.007
σ0.071-0.081=-0.010
min4.133-4.035=0.098
max4.539-4.539=0.000
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.732-0.737=-0.005
σ0.017-0.021=-0.004
min0.705-0.706=-0.002
max0.834-0.872=-0.038
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.691-0.700=-0.009
σ0.017-0.014=0.003
min0.649-0.676=-0.026
max0.780-0.755=0.025

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.193-296.360=-0.167
σ0.190-0.216=-0.026
min296.010-296.176=-0.166
max296.705-296.918=-0.214
mean1906.000-1919.000=-13.000
σ0.000
min1906.000-1919.000=-13.000
max1906.000-1919.000=-13.000
mean0.594-0.586=0.008
σ0.035-0.049=-0.014
min0.550-0.495=0.055
max0.680-0.696=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.693=-0.001
σ0.038-0.032=0.006
min284.642-284.653=-0.011
max284.736-284.731=0.005
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.395-0.395=0.001
σ0.011-0.010=0.001
min0.383-0.386=-0.003
max0.407-0.406=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.074-1295.078=-0.004
σ0.109-0.114=-0.005
min1294.963-1294.959=0.004
max1295.207-1295.217=-0.010
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean1.915-1.917=-0.002
σ0.100-0.094=0.006
min1.798-1.807=-0.009
max2.020-2.001=0.019
iters=5
new-facts=6402
prior-facts=1
mean1539.186-1539.189=-0.002
σ6.840-6.869=-0.029
min1535.924-1535.901=0.023
max1551.419-1551.470=-0.052
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean2.240-2.284=-0.044
σ0.263-0.240=0.023
min2.040-2.032=0.008
max2.666-2.565=0.101
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.983=-0.003
σ0.063-0.063=0.000
min1856.907-1856.901=0.006
max1857.069-1857.069=0.001
mean1773.200-1772.800=0.400
σ130.433-142.705=-12.272
min1640.000-1620.000=20.000
max1906.000-1919.000=-13.000
mean3.061-3.003=0.058
σ0.289-0.227=0.062
min2.851-2.794=0.057
max3.566-3.367=0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.217=-0.080
σ0.254-0.319=-0.065
min0.936-0.920=0.016
max1.526-1.746=-0.220

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.784=0.001
σ581.212-581.213=-0.001
min157.177-157.174=0.003
max1319.603-1319.603=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean0.535-0.513=0.023
σ0.549-0.505=0.044
min0.258-0.255=0.003
max1.359-1.271=0.088
policies=20
mean1572.103-1572.086=0.017
σ0.355-0.356=-0.001
min1571.867-1571.845=0.022
max1572.631-1572.615=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean2.629-2.623=0.005
σ0.024-0.019=0.005
min2.607-2.604=0.002
max2.655-2.649=0.006
policies=200
mean15728.972-15729.013=-0.042
σ0.076-0.038=0.038
min15728.902-15728.968=-0.066
max15729.050-15729.061=-0.011
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1620.000=20.000
σ0.000
min1640.000-1620.000=20.000
max1640.000-1620.000=20.000
mean26.535-26.484=0.051
σ0.082-0.130=-0.048
min26.470-26.363=0.107
max26.654-26.660=-0.006