HRTK includes a built-in benchmarking system for measuring the performance of your mod’s code paths inside the live server. Benchmarks use Hytale’s TimeRecorder for precise timing and support configurable warmup, iteration counts, and batch sizes.
Looking for server-wide profiling? Use spark alongside HRTK. spark finds the hotspots, HRTK benchmarks let you track them. See Profiling with spark for the recommended workflow. @Benchmark
Annotate a method with @Benchmark to mark it as a performance benchmark. Benchmarks are executed via /hrtk bench and are not included in regular /hrtk run invocations.
import com.frotty27.hrtk.api.annotation.Benchmark;
import com.frotty27.hrtk.api.context.BenchmarkContext;
@Benchmark
void benchStringConcat(BenchmarkContext ctx) {
String result = "hello" + " " + "world" + " " + ctx.getIteration();
}
Configuration Parameters
| Parameter | Default | Description |
|---|
warmup | 5 | Number of warmup iterations (not measured) |
iterations | 100 | Number of measured iterations |
batchSize | 1 | Operations per iteration (for throughput calculation) |
@Benchmark(warmup = 20, iterations = 1000)
void benchMathOperations(BenchmarkContext ctx) {
double value = 0.0;
for (int i = 0; i < 100; i++) {
value += Math.sin(i) * Math.cos(i);
}
}
@Benchmark(warmup = 5, iterations = 100, batchSize = 10)
void benchBatchedOperations(BenchmarkContext ctx) {
StringBuilder sb = new StringBuilder();
for (int i = 0; i < 10; i++) {
sb.append("iteration-").append(ctx.getIteration()).append('-').append(i);
}
}
BenchmarkContext
Injected into benchmark methods when you declare a BenchmarkContext parameter.
| Method | Description |
|---|
getIteration() | Current iteration number (0-based) |
getTotalIterations() | Total measured iterations |
isWarmup() | True during warmup phase |
startTimer() | Manually start timing |
stopTimer() | Manually stop timing |
Automatic vs. Manual Timing
By default, the entire method body is timed automatically. If you need to exclude setup or teardown code from measurement, use manual timing:
Automatic (default)
Manual
@Benchmark(iterations = 1000)
void benchAutoTimed(BenchmarkContext ctx) {
// The entire body is timed
expensiveOperation();
}
@Benchmark(iterations = 1000)
void benchManualTimed(BenchmarkContext ctx) {
// Setup -- not timed
Object input = prepareInput();
ctx.startTimer();
// Only this section is measured
processInput(input);
ctx.stopTimer();
// Teardown -- not timed
cleanup(input);
}
If you call startTimer() but forget to call stopTimer(), HRTK stops the timer automatically at the end of the iteration. The timing will still be accurate for the measured portion.
Execution Phases
Warmup
The method runs warmup times. These iterations are not measured. JIT compilation and caching happen during this phase.
Measurement
The method runs iterations times. Each execution is timed and recorded in a TimeRecorder.
Reporting
Statistics (avg, min, max, ops/sec) are calculated and logged.
HRTK [BENCH] Benchmark Examples.Math operations throughput:
avg=1.23us, min=0.98us, max=4.56us (1000 iterations, 20 warmup)
HRTK [BENCH] Benchmark Examples.StringBuilder batched operations:
avg=2.34us, min=1.89us, max=7.12us (100 iterations, 5 warmup, 10 ops/iter, 4273504 ops/sec)
Running Benchmarks
/hrtk bench # Run all benchmarks across all plugins
/hrtk bench MyMod # Run benchmarks from a specific plugin
/hrtk bench --tag serialization # Run benchmarks with a specific tag
Benchmarks run inside the live server, so results are affected by concurrent server activity. For the most consistent results, run benchmarks on a quiet server with no players connected.
Complete Example
@HytaleSuite("Benchmark Examples")
public class BenchmarkExamples {
@Benchmark
@DisplayName("String concatenation baseline")
void benchStringConcat(BenchmarkContext ctx) {
String result = "hello" + " " + "world" + " " + ctx.getIteration();
if (result.isEmpty()) {
throw new AssertionError("Unexpected empty string");
}
}
@Benchmark(warmup = 20, iterations = 1000)
@DisplayName("Math operations throughput")
void benchMathOperations(BenchmarkContext ctx) {
double value = 0.0;
for (int i = 0; i < 100; i++) {
value += Math.sin(i) * Math.cos(i);
}
}
@Benchmark(warmup = 5, iterations = 100, batchSize = 10)
@DisplayName("StringBuilder batched operations")
void benchStringBuilder(BenchmarkContext ctx) {
StringBuilder sb = new StringBuilder();
for (int i = 0; i < 10; i++) {
sb.append("iteration-").append(ctx.getIteration())
.append('-').append(i).append(';');
}
}
}
Next Steps
