Compare commits

Home / Compare 54a0f9c0 .. 0186e660

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.001
σ0.370-0.370=0.001
min53.873-53.871=0.002
max55.069-55.066=0.003
mean415.800-418.000=-2.200
σ0.422-0.000=0.422
min415.000-418.000=-3.000
max416.000-418.000=-2.000
mean0.139-0.138=0.001
σ0.004-0.004=-0.001
min0.135-0.131=0.004
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.001
σ0.007-0.006=0.001
min43.310-43.315=-0.004
max43.333-43.335=-0.002
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.123-0.123=-0.000
σ0.004-0.003=0.001
min0.118-0.120=-0.002
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.304=0.001
σ1.175-1.190=-0.015
min1005.766-1005.771=-0.005
max1011.234-1011.299=-0.064
mean1054.450-1054.850=-0.400
σ321.905-304.035=17.871
min577.000-590.000=-13.000
max1635.000-1644.000=-9.000
mean1.552-1.563=-0.011
σ0.099-0.089=0.010
min1.471-1.478=-0.007
max1.918-1.793=0.124

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.410-0.410=0.000
σ0.123-0.137=-0.014
min0.331-0.333=-0.002
max0.625-0.653=-0.028
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.900-0.892=0.008
σ0.086-0.092=-0.006
min0.845-0.831=0.014
max1.048-1.054=-0.006
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.554-0.553=0.001
σ0.054-0.061=-0.007
min0.517-0.505=0.012
max0.642-0.658=-0.016
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.846-0.852=-0.006
σ0.044-0.034=0.009
min0.808-0.831=-0.023
max0.919-0.913=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.110=0.005
σ0.034-0.029=0.005
min964.086-964.086=-0.000
max964.172-964.161=0.010
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.834-0.847=-0.013
σ0.030-0.015=0.015
min0.798-0.823=-0.025
max0.862-0.862=0.000
name=cdr_enhanced_4k_loc.art
mean884.710-884.712=-0.001
σ0.007-0.005=0.002
min884.705-884.703=0.001
max884.721-884.716=0.005
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.669-0.707=-0.038
σ0.043-0.045=-0.002
min0.622-0.655=-0.033
max0.714-0.742=-0.029

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.721=-0.003
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean4.253-4.179=0.074
σ0.086-0.079=0.007
min4.111-4.013=0.098
max4.585-4.548=0.036
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean4.226-4.213=0.013
σ0.102-0.090=0.011
min4.076-4.091=-0.015
max4.953-4.563=0.390
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.744-0.734=0.010
σ0.027-0.018=0.009
min0.701-0.703=-0.002
max0.874-0.855=0.019
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.695-0.697=-0.002
σ0.014-0.015=-0.001
min0.668-0.663=0.005
max0.769-0.782=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.215-296.072=0.143
σ0.204-0.207=-0.003
min296.061-295.894=0.167
max296.736-296.584=0.152
mean1908.000-1898.000=10.000
σ0.000
min1908.000-1898.000=10.000
max1908.000-1898.000=10.000
mean0.601-0.574=0.028
σ0.042-0.048=-0.006
min0.543-0.511=0.032
max0.710-0.675=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.695=-0.003
σ0.036-0.033=0.003
min284.646-284.651=-0.005
max284.730-284.728=0.002
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.395-0.400=-0.005
σ0.009-0.009=0.000
min0.385-0.385=-0.000
max0.403-0.406=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.078=-0.002
σ0.112-0.125=-0.013
min1294.953-1294.945=0.008
max1295.208-1295.269=-0.061
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean1.893-2.006=-0.113
σ0.110-0.129=-0.019
min1.758-1.817=-0.059
max2.028-2.172=-0.144
iters=5
new-facts=6402
prior-facts=1
mean1539.177-1539.207=-0.030
σ6.837-6.834=0.003
min1535.964-1535.967=-0.004
max1551.404-1551.429=-0.026
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean2.200-2.132=0.067
σ0.166-0.146=0.020
min2.040-1.982=0.058
max2.400-2.368=0.032
iters=5
new-facts=6402
prior-facts=6402
mean1856.982-1856.979=0.003
σ0.064-0.055=0.009
min1856.908-1856.934=-0.026
max1857.069-1857.060=0.009
mean1774.400-1781.800=-7.400
σ131.986-121.771=10.215
min1635.000-1644.000=-9.000
max1908.000-1898.000=10.000
mean3.084-2.986=0.097
σ0.307-0.103=0.204
min2.845-2.840=0.005
max3.617-3.113=0.504

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.300=-0.078
σ0.380-0.342=0.038
min0.933-0.931=0.002
max1.857-1.794=0.063

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.784=0.001
σ581.213-581.213=-0.000
min157.174-157.174=0.000
max1319.604-1319.603=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean0.531-0.534=-0.003
σ0.542-0.537=0.005
min0.259-0.259=0.000
max1.345-1.340=0.004
policies=20
mean1572.094-1572.091=0.003
σ0.358-0.362=-0.004
min1571.854-1571.845=0.009
max1572.627-1572.628=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean2.629-2.635=-0.006
σ0.018-0.015=0.003
min2.605-2.620=-0.015
max2.643-2.655=-0.012
policies=200
mean15728.871-15729.088=-0.217
σ0.063-0.117=-0.054
min15728.807-15729.014=-0.207
max15728.950-15729.261=-0.311
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1644.000=-9.000
σ0.000
min1635.000-1644.000=-9.000
max1635.000-1644.000=-9.000
mean26.592-26.637=-0.044
σ0.153-0.118=0.035
min26.472-26.518=-0.046
max26.814-26.799=0.015