Compare commits

Home / Compare 20a990e7 .. 6648ea16

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.706=-0.002
σ0.370-0.367=0.003
min53.556-53.565=-0.009
max54.757-54.751=0.006
mean417.000-416.700=0.300
σ0.000-0.483=-0.483
min417.000-416.000=1.000
max417.000
mean0.138-0.140=-0.002
σ0.006-0.003=0.002
min0.129-0.136=-0.008
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.058-43.059=-0.001
σ0.006-0.006=0.000
min43.047-43.048=-0.001
max43.065-43.067=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.120-0.123=-0.002
σ0.005-0.004=0.001
min0.115-0.118=-0.004
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.101-1005.105=-0.004
σ0.888-0.888=0.000
min1004.635-1004.637=-0.002
max1008.782-1008.782=0.001
mean1044.600-1055.100=-10.500
σ293.905-321.597=-27.691
min575.000-553.000=22.000
max1462.000-1632.000=-170.000
mean1.621-1.628=-0.008
σ0.063-0.090=-0.027
min1.513-1.556=-0.043
max1.745-1.879=-0.134

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.410-0.418=-0.008
σ0.122-0.135=-0.013
min0.330-0.335=-0.004
max0.624-0.658=-0.033
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.872-0.878=-0.005
σ0.088-0.086=0.001
min0.819-0.830=-0.010
max1.026-1.031=-0.005
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.538-0.542=-0.004
σ0.055-0.057=-0.001
min0.495-0.485=0.010
max0.634-0.636=-0.002
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.872-0.840=0.031
σ0.069-0.039=0.029
min0.816-0.808=0.008
max0.973-0.904=0.069

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.541-963.554=-0.013
σ0.028-0.026=0.002
min963.523-963.535=-0.012
max963.590-963.599=-0.009
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.824-0.827=-0.002
σ0.052-0.039=0.012
min0.738-0.773=-0.035
max0.860-0.860=-0.000
name=cdr_enhanced_4k_loc.art
mean884.853-884.853=0.000
σ0.006-0.008=-0.002
min884.847
max884.860-884.866=-0.006
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.729-0.713=0.016
σ0.016-0.065=-0.049
min0.704-0.596=0.108
max0.742-0.746=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.712=-0.003
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean4.274-4.266=0.008
σ0.070-0.067=0.003
min4.143-4.148=-0.004
max4.536-4.538=-0.002
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean4.260-4.265=-0.005
σ0.081-0.069=0.012
min4.129-4.144=-0.015
max4.602-4.636=-0.034
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.744-0.745=-0.001
σ0.019-0.016=0.002
min0.712-0.717=-0.005
max0.859-0.863=-0.004
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.705-0.703=0.002
σ0.015-0.016=-0.000
min0.677-0.678=-0.000
max0.798-0.803=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.415-294.342=0.072
σ0.239-0.279=-0.040
min294.241-294.065=0.176
max295.072-295.075=-0.003
mean1906.000-1974.000=-68.000
σ0.000
min1906.000-1974.000=-68.000
max1906.000-1974.000=-68.000
mean0.574-0.570=0.004
σ0.040-0.067=-0.027
min0.506-0.495=0.011
max0.656-0.717=-0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.493=0.004
σ0.037-0.036=0.001
min281.453-281.453=0.001
max281.537-281.529=0.008
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.393-0.379=0.014
σ0.006-0.001=0.005
min0.387-0.378=0.009
max0.400-0.380=0.020
iters=5
new-facts=1
prior-facts=6402
mean1291.475-1291.479=-0.005
σ0.104-0.117=-0.013
min1291.348-1291.352=-0.004
max1291.591-1291.646=-0.055
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean2.009-1.928=0.081
σ0.275-0.109=0.166
min1.818-1.788=0.030
max2.484-2.046=0.438
iters=5
new-facts=6402
prior-facts=1
mean1534.328-1534.344=-0.016
σ4.005-4.031=-0.026
min1532.278-1532.322=-0.044
max1541.483-1541.543=-0.060
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean2.271-2.349=-0.077
σ0.194-0.263=-0.069
min2.044-2.093=-0.050
max2.486-2.705=-0.219
iters=5
new-facts=6402
prior-facts=6402
mean1853.355-1853.374=-0.019
σ0.051-0.078=-0.027
min1853.305-1853.284=0.022
max1853.426-1853.469=-0.043
mean1759.600-1802.800=-43.200
σ171.024-168.869=2.155
min1505.000-1632.000=-127.000
max1906.000-1974.000=-68.000
mean2.968-3.253=-0.284
σ0.087-0.334=-0.247
min2.882-2.892=-0.010
max3.108-3.656=-0.548

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.812-1.424=0.388
σ0.095-0.305=-0.209
min1.691-1.102=0.590
max1.937-1.873=0.064

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.428-442.429=-0.000
σ577.065-577.063=0.001
min153.894-153.895=-0.000
max1308.025-1308.024=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean0.555-0.521=0.034
σ0.595-0.515=0.080
min0.257-0.261=-0.004
max1.448-1.293=0.155
policies=20
mean1539.217-1539.224=-0.007
σ0.328-0.321=0.007
min1538.992-1538.999=-0.007
max1539.705-1539.700=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean2.583-2.573=0.009
σ0.027-0.016=0.011
min2.567-2.554=0.013
max2.622-2.589=0.034
policies=200
mean15400.382-15400.365=0.017
σ0.113-0.085=0.028
min15400.219-15400.270=-0.051
max15400.482-15400.467=0.015
mean9200.000
σ0.000
min9200.000
max9200.000
mean1462.000-1632.000=-170.000
σ0.000
min1462.000-1632.000=-170.000
max1462.000-1632.000=-170.000
mean26.118-25.961=0.157
σ0.089-0.075=0.014
min26.018-25.862=0.157
max26.213-26.035=0.178