Compare commits

Home / Compare c16f3391 .. dd315ba4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.785=-0.083
σ0.045-0.047=-0.002
min70.667-70.757=-0.091
max70.826-70.917=-0.091
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.158=0.001
σ0.004-0.004=-0.000
min0.152-0.155=-0.002
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=0.000
σ0.002-0.002=-0.000
min21.404-21.405=-0.001
max21.412-21.411=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.063=0.003
σ0.003-0.003=-0.000
min0.064-0.059=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.931=0.001
σ0.360-0.361=-0.001
min1754.365-1754.357=0.008
max1755.516-1755.527=-0.011
mean1647.200-1637.950=9.250
σ623.358-630.801=-7.443
min622.000-627.000=-5.000
max2770.000-2790.000=-20.000
mean2.847-2.842=0.005
σ0.196-0.168=0.028
min2.158-2.454=-0.296
max3.125-3.113=0.012

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean3.819
σ0.000
min3.819
max3.819
mean2770.000
σ0.000
min2770.000
max2770.000
mean0.001
σ0.000
min0.001
max0.001
name=config.yaml
mean0.338
σ0.000
min0.338
max0.338
mean2770.000
σ0.000
min2770.000
max2770.000
mean0.000
σ0.000
min0.000
max0.000
name=error_case.art
mean10.998
σ0.000
min10.998
max10.998
mean2770.000
σ0.000
min2770.000
max2770.000
mean0.005
σ0.000
min0.005
max0.005
name=heavy_item.art
mean7.432
σ0.000
min7.432
max7.432
mean2770.000
σ0.000
min2770.000
max2770.000
mean0.003
σ0.000
min0.003
max0.003
name=nested_use.art
mean11.073
σ0.000
min11.073
max11.073
mean2770.000
σ0.000
min2770.000
max2770.000
mean0.005
σ0.000
min0.005
max0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25.art
mean4668.653
σ0.000
min4668.653
max4668.653
mean2770.000
σ0.000
min2770.000
max2770.000
mean2885.190
σ0.000
min2885.190
max2885.190
name=cdr_enhanced.art
mean4905.133
σ0.000
min4905.133
max4905.133
mean2770.000
σ0.000
min2770.000
max2770.000
mean2831.441
σ0.000
min2831.441
max2831.441
name=config.yaml
mean0.335
σ0.000
min0.335
max0.335
mean2770.000
σ0.000
min2770.000
max2770.000
mean0.292
σ0.000
min0.292
max0.292

Parser: stress tests (0)

FactorComma Sep (ms)Real World (sec)
name=ambiguous_item.art
mean0.001
σ0.000
min0.001
max0.001
name=aon_gpf25.art
mean3137.715
σ0.000
min3137.715
max3137.715
name=cdr_enhanced.art
mean3169.083
σ0.000
min3169.083
max3169.083
name=config.yaml
mean0.071
σ0.000
min0.071
max0.071
name=error_case.art
mean0.007
σ0.000
min0.007
max0.007
name=heavy_item.art
mean0.005
σ0.000
min0.005
max0.005
name=nested_use.art
mean0.008
σ0.000
min0.008
max0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.754-272.754=-0.000
σ0.004-0.004=-0.000
min272.751-272.751=-0.000
max272.760-272.760=0.000
mean2770.000-2790.000=-20.000
σ0.000
min2770.000-2790.000=-20.000
max2770.000-2790.000=-20.000
mean0.379-0.380=-0.001
σ0.003-0.005=-0.002
min0.376-0.377=-0.002
max0.383-0.389=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.145-1933.166=-0.021
σ0.039-0.016=0.023
min1933.079-1933.145=-0.066
max1933.175-1933.189=-0.013
mean2770.000-2790.000=-20.000
σ0.000
min2770.000-2790.000=-20.000
max2770.000-2790.000=-20.000
mean3.091-2.914=0.177
σ0.131-0.140=-0.009
min2.912-2.731=0.181
max3.251-3.095=0.156
iters=5
new-facts=6402
prior-facts=1
mean4756.793-4756.797=-0.004
σ7.400-7.709=-0.309
min4753.406-4753.007=0.400
max4770.031-4770.583=-0.553
mean2770.000-2790.000=-20.000
σ0.000
min2770.000-2790.000=-20.000
max2770.000-2790.000=-20.000
mean8.796-8.667=0.129
σ0.295-0.435=-0.140
min8.489-7.976=0.513
max9.153-9.043=0.111
iters=5
new-facts=6402
prior-facts=6402
mean4944.390-4944.318=0.072
σ0.017-0.162=-0.146
min4944.371-4944.029=0.343
max4944.409-4944.406=0.003
mean3045.400-3052.000=-6.600
σ336.747-331.494=5.253
min2770.000-2790.000=-20.000
max3554.000-3556.000=-2.000
mean8.378-8.435=-0.057
σ0.141-0.125=0.015
min8.253-8.348=-0.095
max8.610-8.655=-0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-0.991=0.011
σ0.135-0.136=-0.001
min0.913-0.929=-0.016
max1.221-1.235=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-479.074=-10.751
σ574.262-595.767=-21.506
min181.186-181.187=-0.001
max1329.715-1372.725=-43.009
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2790.000=-20.000
σ0.000
min2770.000-2790.000=-20.000
max2770.000-2790.000=-20.000
mean0.561-0.566=-0.005
σ0.555-0.568=-0.013
min0.280-0.280=0.000
max1.394-1.419=-0.025
policies=20
mean1812.180-1812.160=0.020
σ0.395-0.396=-0.001
min1811.908-1811.906=0.003
max1812.762-1812.749=0.013
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2790.000=-20.000
σ0.000
min2770.000-2790.000=-20.000
max2770.000-2790.000=-20.000
mean2.838-2.789=0.048
σ0.074-0.003=0.070
min2.795-2.785=0.010
max2.948-2.793=0.155
policies=200
mean18129.043-18129.080=-0.036
σ0.487-0.504=-0.017
min18128.752-18128.768=-0.016
max18129.772-18129.829=-0.057
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2790.000=-20.000
σ0.000
min2770.000-2790.000=-20.000
max2770.000-2790.000=-20.000
mean28.324-28.374=-0.049
σ0.072-0.037=0.035
min28.240-28.344=-0.104
max28.395-28.427=-0.032