neo vs Polars · library 2.0.0

neo vs Polars.

The same input and the same kernels, in neo's C++ and in Polars 2.0.0. Across 28 measurements neo finished 2.78× faster in the middle and 77.3× at most; Polars was quicker on 1: filter, count: one run from rest.

01 · The race

One kernel at a time

Each piece of work below has its own race, what it measures, what neo is held to, how Polars does it and every number taken for it. In a race both ships run for the same stretch: Polars completes the work once, and neo completes it as many times as the measured ratio says, turning around at each end.

  1. 01.1 · load the CSV, parse and type5.49×
  2. 01.2 · filter amount > 500, count9.94×
  3. 01.3 · filter into a new table2.34×
  4. 01.4 · sort, as a permutation6.47×
  5. 01.5 · sort into a new table4.47×
  6. 01.6 · sum by region77.3×
  7. 01.7 · load worldcitiespop3.51×
  8. 01.8 · load NYC taxi · 1M1.80×
  9. 01.9 · load NYC taxi · 10M2.63×
  10. 01.10 · load ClickBench · 1M1.97×
  11. 01.11 · load ClickBench · 10M2.55×

01.1 · kernel · 1,000,000 rows

load the CSV, parse and type

neo 2.77 ms · Polars 15.2 ms · 5.49× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Read a 46 MB CSV of a million rows and six columns into a table: split the bytes into fields, parse the amount column into numbers, and dictionary-encode the region column. Each engine's typed read, best of two, with the first read of a fresh process kept separately.

What neo is held to

The same table the app loads, with the amount column typed and the region column encoded at load, so that no kernel after it touches text. Before a time is taken every engine prints its table as one number and its checks, and the line under the table says whether they agreed.

How Polars does it

Polars's read_csv, which infers a type for each column.

Polars, this kernel · neon-cpp/bench/lang/python/yardstick.py
res["load_first_ms"], res["load_ms"] = load_twice(lambda: pl.read_csv(args.csv))

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
time, runs in a row, msThe typed read, best of two, with the first read of a fresh process kept separately.2.7715.25.49×
energy, runs in a row, mJMillijoules a run, in the same run as the time: the energy over the timed runs and as many more as fill 200 ms, divided by the runs, less the draw at rest. A mean, where the time is a best.1724942.87×

01.2 · kernel · 1,000,000 rows

filter amount > 500, count

neo 0.018 ms · Polars 0.179 ms · 9.94× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Count the rows whose amount is over 500: a million comparisons on a typed column, the answer one integer. Each library's count is written the way its users write it.

What neo is held to

The count every other engine prints, under the JavaScript node's rule that NaN never matches. What comes out is a selection the next kernel reads from, not a copy of the rows.

How Polars does it

Written as a lazy query: filter, select the length, collect. Polars plans the count as one query.

Polars, this kernel · neon-cpp/bench/lang/python/yardstick.py
timed("filter", lambda: df.lazy().filter(pred).select(pl.len()).collect().item())

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
time, runs in a row, msBest of three, runs in a row: every thread awake and the cores at speed.0.0180.1799.94×
energy, runs in a row, mJMillijoules a run, in the same run as the time: the energy over the timed runs and as many more as fill 200 ms, divided by the runs, less the draw at rest. A mean, where the time is a best.1.082.071.92×
time, one run from rest, msThe call made once after 50 ms of nothing, mean of ten: what a click finds.0.7821.431.82×
energy, one run from rest, mJThe same single call from rest, in millijoules. From rest a run costs less than in a row where the work is large, and more where it is tiny, because the threads have to be woken for it.8.722.850.33×

Read it with this

  • Polars is ahead of neo on energy, one run from rest, and is shown ahead.

01.3 · kernel · 1,000,000 rows

filter into a new table

neo 0.380 ms · Polars 0.889 ms · 2.34× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Keep the rows whose amount is over 500 and build a new table of them, about half the file, every column copied.

What neo is held to

The same rows every other engine keeps, every column copied, checked by the same line.

How Polars does it

An eager filter on the DataFrame, returning a new one with the matching rows.

Polars, this kernel · neon-cpp/bench/lang/python/yardstick.py
timed("filter_mat", lambda: df.filter(pred))

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
time, runs in a row, msBest of three, runs in a row: every thread awake and the cores at speed.0.3800.8892.34×
energy, runs in a row, mJMillijoules a run, in the same run as the time: the energy over the timed runs and as many more as fill 200 ms, divided by the runs, less the draw at rest. A mean, where the time is a best.21.622.01.02×

01.4 · kernel · 1,000,000 rows

sort, as a permutation

neo 1.03 ms · Polars 6.68 ms · 6.47× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Produce the stable ascending order of the amount column as a permutation of row indices, without moving any other column. SQL engines have no such form, so DuckDB and Spark sit this one out.

What neo is held to

A stable ascending order under the JavaScript rule that NaN sorts first and ties keep their place. The first sorted values are printed and compared with every other engine's.

How Polars does it

arg_sort on the amount column: the order as row indices, with no other column moved.

Polars, this kernel · neon-cpp/bench/lang/python/yardstick.py
timed("sort_perm", lambda: df["amount"].arg_sort())

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
time, runs in a row, msBest of three, runs in a row: every thread awake and the cores at speed.1.036.686.47×
energy, runs in a row, mJMillijoules a run, in the same run as the time: the energy over the timed runs and as many more as fill 200 ms, divided by the runs, less the draw at rest. A mean, where the time is a best.64.52193.40×
time, one run from rest, msThe call made once after 50 ms of nothing, mean of ten: what a click finds.2.739.593.52×
energy, one run from rest, mJThe same single call from rest, in millijoules. From rest a run costs less than in a row where the work is large, and more where it is tiny, because the threads have to be woken for it.44.81633.63×

01.5 · kernel · 1,000,000 rows

sort into a new table

neo 2.72 ms · Polars 12.2 ms · 4.47× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Sort by amount and build the whole sorted table, every column reordered.

What neo is held to

The whole table in that order, every column, with the same first values as every other engine.

How Polars does it

sort on amount, returning the whole DataFrame reordered.

Polars, this kernel · neon-cpp/bench/lang/python/yardstick.py
timed("sort_mat", lambda: df.sort("amount"))

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
time, runs in a row, msBest of three, runs in a row: every thread awake and the cores at speed.2.7212.24.47×
energy, runs in a row, mJMillijoules a run, in the same run as the time: the energy over the timed runs and as many more as fill 200 ms, divided by the runs, less the draw at rest. A mean, where the time is a best.1443172.20×

01.6 · kernel · 1,000,000 rows

sum by region

neo 0.020 ms · Polars 1.55 ms · 77.3× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Total the amount column for each of five regions: a grouped sum, the kernel every dashboard runs.

What neo is held to

The JavaScript loop's result to the bit. A floating-point sum depends on the order it is taken in, and neo is held to the row order's answer whatever it does to get there.

How Polars does it

group_by on region, with a sum of amount as the aggregation.

Polars, this kernel · neon-cpp/bench/lang/python/yardstick.py
timed("agg", lambda: df.group_by("region").agg(pl.col("amount").sum()))

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
time, runs in a row, msBest of three, runs in a row: every thread awake and the cores at speed.0.0201.5577.3×
energy, runs in a row, mJMillijoules a run, in the same run as the time: the energy over the timed runs and as many more as fill 200 ms, divided by the runs, less the draw at rest. A mean, where the time is a best.1.5550.932.8×
time, one run from rest, msThe call made once after 50 ms of nothing, mean of ten: what a click finds.0.7583.174.18×
energy, one run from rest, mJThe same single call from rest, in millijoules. From rest a run costs less than in a row where the work is large, and more where it is tiny, because the threads have to be woken for it.9.1130.83.38×

01.7 · public data · a file this project did not make

load worldcitiespop

neo 11.4 ms · Polars 39.9 ms · 3.51× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Read worldcitiespop from its path to a table in memory: 3,173,958 rows by 7 columns, 151 MB of place names, the file the CSV tools benchmark on. Every engine in a fresh process each round, the file in the OS cache, each engine's start-up done before the clock; warm is the median of the loads after the first. neo's table is text, with no types, no nulls and no UTF-8 check, so the rows as text are the like-for-like ones.

What neo is held to

The same loader the app uses, on a file this project did not make, checked column by column and row by row against DuckDB's reading of it before any time is taken.

How Polars does it

read_csv with infer_schema off, so every column is read as text. Its thread pool is started on a three-line file before the clock.

Polars reading the public files · neon-cpp/bench/lang/python/standards.py:79
def load_polars(path, mode, loads, opt=None):
    import polars as pl
    kw = {}
    if opt and "infer" in opt: kw = {"infer_schema_length": opt["infer"]}
    if opt and "overrides" in opt: kw = {"schema_overrides": {c: (pl.Float64 if t == "float" else pl.String) for c, t in opt["overrides"].items()}}
    pl.read_csv(io.BytesIO(b"a,b\n1,x\n2,y\n"))  # untimed: the reader's own start-up (its thread pool), on three lines that are not the file
    out, rows, cols = [], 0, 0
    for _ in range(loads):
        t0 = time.perf_counter()
        df = pl.read_csv(path, infer_schema=False) if mode == "text" else pl.read_csv(path, **kw)
        out.append(ms_since(t0))
        rows, cols = df.height, df.width
        del df
    return pl.__version__, out, rows, cols, pl.thread_pool_size()

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
first load, as text, msThe median first load: a fresh process each round, the file in the operating system's cache, the engine's own start-up done before the clock.23.847.52.00×
loads after the first, as text, msThe median of the loads after the first, in the same process.11.439.93.51×

01.8 · public data · a file this project did not make

load NYC taxi · 1M

neo 52.9 ms · Polars 95.3 ms · 1.80× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Read NYC taxi · 1M from its path to a table in memory: 1,000,000 rows by 51 columns, 425 MB of trips. Every engine in a fresh process each round, the file in the OS cache, each engine's start-up done before the clock; warm is the median of the loads after the first. neo's table is text, with no types, no nulls and no UTF-8 check, so the rows as text are the like-for-like ones.

What neo is held to

The same loader the app uses, on a file this project did not make, checked column by column and row by row against DuckDB's reading of it before any time is taken.

How Polars does it

read_csv with infer_schema off, so every column is read as text. Its thread pool is started on a three-line file before the clock. The reader is the one shown under the first public file.

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
first load, as text, msThe median first load: a fresh process each round, the file in the operating system's cache, the engine's own start-up done before the clock.72.91421.95×
loads after the first, as text, msThe median of the loads after the first, in the same process.52.995.31.80×

01.9 · public data · a file this project did not make

load NYC taxi · 10M

neo 418 ms · Polars 1,098 ms · 2.63× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Read NYC taxi · 10M from its path to a table in memory: 10,000,000 rows by 51 columns, 4.3 GB of trips. Every engine in a fresh process each round, the file in the OS cache, each engine's start-up done before the clock; warm is the median of the loads after the first. neo's table is text, with no types, no nulls and no UTF-8 check, so the rows as text are the like-for-like ones.

What neo is held to

The same loader the app uses, on a file this project did not make, checked column by column and row by row against DuckDB's reading of it before any time is taken.

How Polars does it

read_csv with infer_schema off, so every column is read as text. Its thread pool is started on a three-line file before the clock. The reader is the one shown under the first public file.

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
first load, as text, msThe median first load: a fresh process each round, the file in the operating system's cache, the engine's own start-up done before the clock.4481,2452.78×
loads after the first, as text, msThe median of the loads after the first, in the same process.4181,0982.63×

01.10 · public data · a file this project did not make

load ClickBench · 1M

neo 96.0 ms · Polars 189 ms · 1.97× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Read ClickBench · 1M from its path to a table in memory: 1,000,000 rows by 105 columns, 842 MB of web hits. Every engine in a fresh process each round, the file in the OS cache, each engine's start-up done before the clock; warm is the median of the loads after the first. neo's table is text, with no types, no nulls and no UTF-8 check, so the rows as text are the like-for-like ones.

What neo is held to

The same loader the app uses, on a file this project did not make, checked column by column and row by row against DuckDB's reading of it before any time is taken.

How Polars does it

read_csv with infer_schema off, so every column is read as text. Its thread pool is started on a three-line file before the clock. The reader is the one shown under the first public file.

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
first load, as text, msThe median first load: a fresh process each round, the file in the operating system's cache, the engine's own start-up done before the clock.1262742.17×
loads after the first, as text, msThe median of the loads after the first, in the same process.96.01891.97×

01.11 · public data · a file this project did not make

load ClickBench · 10M

neo 1,056 ms · Polars 2,696 ms · 2.55× neo. Against every engine →

neo

Polars

0 runs

0 runs

What this measures

Read ClickBench · 10M from its path to a table in memory: 10,000,000 rows by 105 columns, 8.1 GB of web hits. Every engine in a fresh process each round, the file in the OS cache, each engine's start-up done before the clock; warm is the median of the loads after the first. neo's table is text, with no types, no nulls and no UTF-8 check, so the rows as text are the like-for-like ones.

What neo is held to

The same loader the app uses, on a file this project did not make, checked column by column and row by row against DuckDB's reading of it before any time is taken.

How Polars does it

read_csv with infer_schema off, so every column is read as text. Its thread pool is started on a three-line file before the clock. The reader is the one shown under the first public file.

neo's side is confidential. What it is held to is above; why it is kept is under 03.

Every number taken for it

measurementneoPolars× neo
first load, as text, msThe median first load: a fresh process each round, the file in the operating system's cache, the engine's own start-up done before the clock.1,0532,8142.67×
loads after the first, as text, msThe median of the loads after the first, in the same process.1,0562,6962.55×

02 · Every number

Against the libraries people reach for first

1,000,000 rows · ms, lower is better · 2026-10-11 21:23

kernelneoPolars× neo
load the CSV (parse + type)2.7715.25.49×
filter amount > 500, count0.0180.1799.94×
filter into a new table0.3800.8892.34×
sort, as a permutation1.036.686.47×
sort into a new table2.7212.24.47×
sum(amount) by region0.0201.5577.3×
filter, count: one run from rest0.7821.431.82×
sort, permutation: one run from rest2.739.593.52×
sum by region: one run from rest0.7583.174.18×

The same CSV and the same six kernels in neo's engine and in the libraries people reach for first, each written the way its users write it (Polars 2.0.0, DuckDB 1.5.6, pandas 3.0.6, Spark 4.2.0). Milliseconds, best of three; the chip is how many times neo's time a library took. The last three rows are one run from rest: the call made once after 50 ms of nothing, mean of ten, neo's pool told to rest after it as the editor tells it. That is what a click finds; the rows above are runs in a row, every thread awake and the cores at speed.

The same run, in energy

1,000,000 rows · mJ, lower is better · 2026-10-11 21:23

kernelneoPolars× neo
load the CSV (parse + type)1724942.87×
filter amount > 500, count1.082.071.92×
filter into a new table21.622.01.02×
sort, as a permutation64.52193.40×
sort into a new table1443172.20×
sum(amount) by region1.5550.932.8×
filter, count: one run from rest8.722.850.33×
sort, permutation: one run from rest44.81633.63×
sum by region: one run from rest9.1130.83.38×

The same CSV and the same six kernels as the times, in the same run (Polars 2.0.0, DuckDB 1.5.6, pandas 3.0.6, Spark 4.2.0). Millijoules a run. What macOS billed each engine's process, and for Spark its JVM, for the processor cores it ran on: not the memory, the disk or the screen, and not the machine at rest. A kernel's figure is the energy over its timed runs, and as many more as fill 200 ms, divided by the runs, less what the process draws at rest for as long: a mean, where the time is a best. neo's is of the variant whose time is the number on the Speed side. Each benchmark reads the counter itself; scripts/bench_libraries.sh also reads it from outside the process (neon_energy) and RESULTS.md has both totals. The chip is how many times neo's energy a library used. The last three rows are one run from rest: the call made once after 50 ms of nothing, mean of ten, neo's pool told to rest after it as the editor tells it. That is what a click finds; the rows above are runs in a row, every thread awake and the cores at speed. From rest a run costs less energy than in a row where the work is large (the cores are not at their top voltage) and more where it is tiny (the threads have to be woken for it).

Public data, from a path to a table

loads after the first, as text · ms, lower is better · 2026-10-11 16:43

kernelneoPolars× neo
worldcitiespop · first load, as text23.847.52.00×
worldcitiespop · loads after the first, as text11.439.93.51×
NYC taxi · 1M · first load, as text72.91421.95×
NYC taxi · 1M · loads after the first, as text52.995.31.80×
NYC taxi · 10M · first load, as text4481,2452.78×
NYC taxi · 10M · loads after the first, as text4181,0982.63×
ClickBench · 1M · first load, as text1262742.17×
ClickBench · 1M · loads after the first, as text96.01891.97×
ClickBench · 10M · first load, as text1,0532,8142.67×
ClickBench · 10M · loads after the first, as text1,0562,6962.55×

Public CSVs, not ours, from a path to a table in memory, in neo and in engines this project did not write (Arrow 25.0.1, Polars 2.0.0, DuckDB 1.5.6, pandas 3.0.6). Milliseconds. worldcitiespop.csv is the file as xsv, qsv, xan and zsv benchmark it; the taxi and ClickBench files are the first records of the files those benchmarks publish, byte for byte, under a header line made from the benchmark's own schema (scripts/fetch_standards.sh; every source and SHA-256 is in bench/results/standards/manifest.jsonl). Every engine runs in a fresh process each round, in an order shuffled each round: the first row is the median first load, the second the median of the loads after it. The file is in the operating system's cache throughout, and each engine's own start-up is done before its first load, so these are the readers and nothing else. neo goes through the loader the app uses. Its table is text and only text: no types, no nulls (an empty field is an empty string), no check that the bytes are UTF-8, every field trimmed and a line end inside quotes made \n, as the app it replaces did; the others asked for text check UTF-8 and keep nulls. So the first two rows are the like-for-like ones; in the last two the others also infer types, which neo's loader does not do, and neo's numbers there are its text load again. Before any time is taken neo's table is compared with DuckDB's reading of the file, and each card says what came of it. pandas is run with its pyarrow engine. Threads are each engine's default: 18 here for the others; neo 16, and 18 from 256 MB of input, counts that were chosen on this machine. A dash is an engine that did not read the file.

03 · Both sides

Polars's side, in full

Polars is a DataFrame library written in Rust with a Python front end, built on Apache Arrow memory with a lazy query engine that uses every core. Its kernels are written the way its users write them. Each kernel's lines are beside its race above; this is the whole block they come from, with the checks it prints.

polars, as its users write it: the six kernels · neon-cpp/bench/lang/python/yardstick.py:218
elif args.lib == "polars":
    t0 = now()
    import polars as pl
    res["version"] = pl.__version__
    res["startup_ms"] = (now() - t0) * 1000
    res["load_first_ms"], res["load_ms"] = load_twice(lambda: pl.read_csv(args.csv))
    df = pl.read_csv(args.csv)
    res["rows"] = df.height
    pred = pl.col("amount") > 500
    timed("filter", lambda: df.lazy().filter(pred).select(pl.len()).collect().item())
    timed("filter_mat", lambda: df.filter(pred))
    timed("sort_perm", lambda: df["amount"].arg_sort())
    timed("sort_mat", lambda: df.sort("amount"))
    timed("agg", lambda: df.group_by("region").agg(pl.col("amount").sum()))
    checks["filter_count"] = df.lazy().filter(pred).select(pl.len()).collect().item()
    checks["first_sorted"] = df["amount"].sort().head(3).to_list()
    checks["sums"] = {r[0]: float(r[1]) for r in df.group_by("region").agg(pl.col("amount").sum()).iter_rows()}
    res["threads"] = pl.thread_pool_size()

neo's side: confidential

neo's kernels, the ports written in-house to beat them, and the techniques behind both stay with the engine. Nothing about how the numbers were made is withheld: the method, the checks every engine had to pass, every number and every place neo is behind are on this page. The engine itself we keep confidential, because we don't want it getting into the wrong hands. The binaries run on request and reproduce every number here.

04 · Diligence

What both sides were held to

Scripts: scripts/bench_libraries.sh · scripts/bench_standards.sh · measured 2026-10-11 · the numbers on this page come from the same ledger as the app's own Evals page, written by neon-cpp/scripts/results_md.py.

More comparisons