Compare commits

Home / Compare 70365fbb .. 04b73e3a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.371-0.369=0.001
min53.872-53.870=0.002
max55.070-55.065=0.005
mean415.000-416.700=-1.700
σ0.000-0.483=-0.483
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.138-0.136=0.002
σ0.004-0.003=0.001
min0.131-0.132=-0.000
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.324-43.322=0.002
σ0.007-0.005=0.002
min43.309-43.316=-0.007
max43.333-43.329=0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.123-0.119=0.004
σ0.010-0.002=0.008
min0.114-0.116=-0.001
max0.141-0.121=0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.316=-0.008
σ1.185-1.155=0.030
min1005.768-1005.743=0.025
max1011.269-1011.140=0.129
mean1045.000-1055.350=-10.350
σ311.721-316.296=-4.575
min597.000-568.000=29.000
max1634.000-1620.000=14.000
mean1.549-1.526=0.024
σ0.086-0.071=0.015
min1.469-1.417=0.052
max1.762-1.742=0.020

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.429-0.420=0.009
σ0.150-0.130=0.020
min0.329-0.329=-0.000
max0.688-0.638=0.050
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.910-0.871=0.039
σ0.166-0.092=0.073
min0.822-0.813=0.009
max1.204-1.032=0.171
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.544-0.534=0.010
σ0.060-0.055=0.005
min0.496-0.486=0.010
max0.648-0.626=0.022
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.844-0.843=0.001
σ0.039-0.034=0.005
min0.815-0.805=0.010
max0.909-0.897=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.111-964.115=-0.004
σ0.023-0.033=-0.010
min964.090-964.086=0.004
max964.146-964.169=-0.023
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.817-0.842=-0.025
σ0.041-0.017=0.025
min0.750-0.814=-0.064
max0.859-0.854=0.006
name=cdr_enhanced_4k_loc.art
mean884.714-884.711=0.003
σ0.002-0.007=-0.006
min884.712-884.703=0.009
max884.717-884.721=-0.004
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.725-0.723=0.002
σ0.029-0.017=0.012
min0.680-0.706=-0.025
max0.745-0.742=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.720=-0.002
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean4.301-4.228=0.073
σ0.096-0.111=-0.015
min4.160-4.065=0.096
max4.937-4.649=0.288
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.666=0.003
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean4.280-4.239=0.042
σ0.119-0.081=0.037
min3.586-4.035=-0.449
max4.531-4.539=-0.008
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.735-0.737=-0.002
σ0.017-0.021=-0.004
min0.705-0.706=-0.001
max0.840-0.872=-0.032
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.699-0.700=-0.001
σ0.014-0.014=0.001
min0.669-0.676=-0.006
max0.781-0.755=0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.382-296.360=0.022
σ0.224-0.216=0.008
min296.228-296.176=0.052
max297.006-296.918=0.087
mean1902.000-1919.000=-17.000
σ0.000
min1902.000-1919.000=-17.000
max1902.000-1919.000=-17.000
mean0.576-0.586=-0.010
σ0.044-0.049=-0.005
min0.513-0.495=0.018
max0.657-0.696=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.693=0.002
σ0.040-0.032=0.008
min284.644-284.653=-0.010
max284.742-284.731=0.011
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.407-0.395=0.012
σ0.003-0.010=-0.007
min0.404-0.386=0.019
max0.411-0.406=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.078=0.000
σ0.111-0.114=-0.003
min1294.958-1294.959=-0.001
max1295.220-1295.217=0.003
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean1.918-1.917=0.001
σ0.108-0.094=0.014
min1.799-1.807=-0.008
max2.015-2.001=0.014
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.189=0.001
σ6.859-6.869=-0.010
min1535.926-1535.901=0.025
max1551.456-1551.470=-0.014
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean2.257-2.284=-0.027
σ0.275-0.240=0.036
min2.034-2.032=0.002
max2.686-2.565=0.120
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.983=0.001
σ0.056-0.063=-0.007
min1856.928-1856.901=0.027
max1857.065-1857.069=-0.004
mean1771.000-1772.800=-1.800
σ130.832-142.705=-11.873
min1634.000-1620.000=14.000
max1902.000-1919.000=-17.000
mean3.051-3.003=0.048
σ0.244-0.227=0.017
min2.866-2.794=0.072
max3.469-3.367=0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.123-1.217=-0.094
σ0.214-0.319=-0.105
min0.936-0.920=0.016
max1.421-1.746=-0.325

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.784=0.003
σ581.212-581.213=-0.000
min157.179-157.174=0.004
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean0.547-0.513=0.034
σ0.571-0.505=0.066
min0.259-0.255=0.004
max1.404-1.271=0.133
policies=20
mean1572.103-1572.086=0.017
σ0.354-0.356=-0.002
min1571.863-1571.845=0.018
max1572.629-1572.615=0.013
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean2.630-2.623=0.007
σ0.009-0.019=-0.009
min2.624-2.604=0.019
max2.644-2.649=-0.005
policies=200
mean15729.098-15729.013=0.084
σ0.109-0.038=0.070
min15729.028-15728.968=0.060
max15729.259-15729.061=0.198
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1620.000=14.000
σ0.000
min1634.000-1620.000=14.000
max1634.000-1620.000=14.000
mean26.472-26.484=-0.012
σ0.016-0.130=-0.114
min26.448-26.363=0.085
max26.481-26.660=-0.179