Compare commits

Home / Compare 63e63e75 .. 696de4d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.031=0.000
σ0.369-0.368=0.001
min53.891-53.889=0.002
max55.081-55.078=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.140-0.140=-0.000
σ0.004-0.004=0.000
min0.137-0.137=-0.000
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.007-0.006=0.001
min43.377-43.374=0.002
max43.400-43.394=0.006
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.123-0.123=0.000
σ0.003-0.004=-0.000
min0.119-0.119=-0.000
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.327=0.000
σ0.889-0.903=-0.014
min1005.857-1005.859=-0.002
max1010.011-1010.082=-0.071
mean1048.700-1054.400=-5.700
σ308.002-316.632=-8.630
min573.000-563.000=10.000
max1649.000-1620.000=29.000
mean1.538-1.539=-0.001
σ0.078-0.075=0.003
min1.445-1.478=-0.032
max1.755-1.774=-0.019

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.424-0.414=0.011
σ0.146-0.133=0.013
min0.342-0.339=0.003
max0.684-0.650=0.034
name=error_case.art
mean2.334-2.333=0.000
σ0.002-0.003=-0.000
min2.332
max2.337
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.881-0.872=0.010
σ0.087-0.092=-0.005
min0.822-0.803=0.020
max1.034-1.031=0.003
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.547-0.533=0.015
σ0.046-0.044=0.001
min0.505-0.503=0.002
max0.625-0.610=0.015
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.839-0.829=0.010
σ0.044-0.042=0.003
min0.796-0.802=-0.006
max0.913-0.900=0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.553=-0.001
σ0.025-0.023=0.001
min963.523-963.534=-0.011
max963.582-963.587=-0.005
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.811-0.850=-0.039
σ0.023-0.013=0.010
min0.796-0.827=-0.031
max0.851-0.860=-0.009
name=cdr_enhanced_4k_loc.art
mean884.856-884.854=0.002
σ0.004-0.008=-0.004
min884.848-884.848=0.000
max884.860-884.867=-0.007
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.681-0.740=-0.059
σ0.046-0.004=0.042
min0.606-0.733=-0.127
max0.731-0.744=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean3.578-4.329=-0.751
σ0.086-0.084=0.002
min3.413-4.151=-0.739
max3.924-4.652=-0.729
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.659-7.658=0.001
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean3.531-4.299=-0.768
σ0.058-0.084=-0.027
min3.395-4.146=-0.751
max3.653-4.593=-0.940
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.745-0.745=0.001
σ0.016-0.019=-0.002
min0.716-0.710=0.006
max0.855-0.882=-0.027
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.710-0.707=0.002
σ0.014-0.015=-0.001
min0.686-0.678=0.008
max0.801-0.787=0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.740-295.583=0.156
σ0.203-0.204=-0.001
min295.555-295.412=0.143
max296.286-296.138=0.148
mean1906.000-1944.000=-38.000
σ0.000
min1906.000-1944.000=-38.000
max1906.000-1944.000=-38.000
mean0.583-0.589=-0.006
σ0.036-0.047=-0.011
min0.541-0.508=0.033
max0.671-0.673=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.247-285.253=-0.006
σ0.036-0.042=-0.005
min285.195-285.200=-0.005
max285.281-285.301=-0.021
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.390-0.401=-0.011
σ0.014-0.011=0.003
min0.383-0.388=-0.005
max0.414-0.410=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.201-1295.198=0.003
σ0.114-0.111=0.002
min1295.081-1295.078=0.002
max1295.352-1295.344=0.009
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean1.893-1.936=-0.043
σ0.094-0.119=-0.025
min1.784-1.803=-0.019
max2.012-2.058=-0.047
iters=5
new-facts=6402
prior-facts=1
mean1538.078-1538.159=-0.081
σ4.018-4.019=-0.001
min1536.034-1536.176=-0.142
max1545.256-1545.343=-0.087
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean2.288-2.469=-0.181
σ0.224-0.340=-0.116
min2.022-2.012=0.010
max2.528-2.871=-0.342
iters=5
new-facts=6402
prior-facts=6402
mean1857.112-1857.101=0.011
σ0.055-0.059=-0.004
min1857.056-1857.045=0.011
max1857.187-1857.177=0.010
mean1775.800-1778.000=-2.200
σ127.433-162.247=-34.814
min1649.000-1620.000=29.000
max1906.000-1944.000=-38.000
mean3.061-2.958=0.103
σ0.350-0.156=0.194
min2.794-2.855=-0.061
max3.659-3.229=0.429

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.354-1.434=-0.080
σ0.181-0.285=-0.103
min1.114-1.125=-0.011
max1.604-1.877=-0.273

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.607-443.611=-0.004
σ577.066-577.065=0.001
min155.072-155.077=-0.005
max1309.206-1309.208=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean0.524-0.557=-0.033
σ0.515-0.592=-0.077
min0.263-0.259=0.004
max1.297-1.445=-0.148
policies=20
mean1551.016-1551.040=-0.023
σ0.325-0.316=0.009
min1550.794-1550.822=-0.029
max1551.499-1551.508=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean2.585-2.573=0.012
σ0.011-0.008=0.004
min2.578-2.564=0.014
max2.602-2.582=0.021
policies=200
mean15518.412-15518.326=0.086
σ0.129-0.419=-0.291
min15518.242-15517.741=0.501
max15518.512-15518.738=-0.226
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1620.000=29.000
σ0.000
min1649.000-1620.000=29.000
max1649.000-1620.000=29.000
mean26.098-26.151=-0.053
σ0.118-0.068=0.051
min26.017-26.093=-0.077
max26.274-26.249=0.026