John Colvin
a0ef2c3348
cleanup: Remove "partial" class modifiers from OrderBook vm classes
...
They simply weren't necessary.
2025-08-24 13:46:54 -04:00
John Colvin
acb420d4cc
check pt: Proof of concept ladder left panel price point collection
2025-08-24 13:46:54 -04:00
John Colvin
ab07697985
ui: Adjust ladder ticks-per-row with ctrl+shift+mousewheel
2025-08-24 13:46:54 -04:00
John Colvin
6ad7418931
build: Change publish_data_stream.py to publish the sln
...
We were publishing individual projects as a workaround for the
dependency issue (bug) that caused some projects to incorrectly target
net8.0. The fact that publishing individual projects "just worked" was
probably dumb luck. Now that the underlying issue has been addressed, we
can resume publishing the sln as a whole.
2025-08-24 13:46:54 -04:00
John Colvin
783764fc1f
build: Add scripts to publish data stream apps
2025-08-24 13:46:54 -04:00
John Colvin
5771b19c18
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2025-08-24 13:46:54 -04:00
John Colvin
ee5b78ed9c
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2025-08-24 13:46:54 -04:00
John Colvin
d609dcd3c2
cleanup: Remove unused code
2025-08-24 13:46:54 -04:00
John Colvin
7b266cd4d0
Reduce log noise in AsyncTCPConnection_AsyncWrapper
2025-08-24 13:46:54 -04:00
John Colvin
de8593af5a
TEMP changes to appsettings.json (at least i should review them before making permanent)
2025-08-24 13:46:54 -04:00
John Colvin
ab6f6e1790
Add ColumnIndex class to resolve column names to indices
...
Improves performance compared to accessing columns by name
2025-08-24 13:46:54 -04:00
John Colvin
51e38ca793
Increase SQLiteEnumerator page size to 65536
...
This performs better, and doesn't seem to be too large in practice
2025-08-24 13:46:53 -04:00
John Colvin
7b2bc4b10c
Serialize TimeSpan w/ microsecond precision in DataPacket json
2025-08-24 13:46:53 -04:00
John Colvin
05cae5c959
Format DateTimes w/ microsecond precision in DataPacketJsonConverter
2025-08-24 13:46:53 -04:00
John Colvin
aaca8f0f3a
Add BlueColumnTable for pandas integration
...
This will make it easier/more natural to support pandas column expressions
2025-08-24 13:46:53 -04:00
John Colvin
59a16677d1
Add c# Variant class, modeled after std::variant in c++
2025-08-24 13:46:53 -04:00
John Colvin
50e7bba3d7
refactor: Rename snake_case fns PascalCase
2025-08-24 13:46:53 -04:00
John Colvin
6026ca0c62
refactor: Use dependency injection in DSQA
2025-08-24 13:46:53 -04:00
John Colvin
253512cef8
refactor: Load IDataStreamFactory(s) with dependency injection
...
So we can create ViewStreams that depend on other services, config, etc.
Previously, the PrimitiveManager relied purely on static construction of
types through reflection.
2025-08-24 13:46:53 -04:00
John Colvin
ae050d9401
chore: Make BlueTableSchemaAdapter implement IBlueTableSchema
2025-08-24 13:46:53 -04:00
John Colvin
eb0f386328
refactor: Rename "BlueTableSchemaAdaptor" with "er"
2025-08-24 13:46:53 -04:00
John Colvin
b5aca5637c
refactor: Replace DataPacket w/ IDataPacket in stream handlers
2025-08-24 13:46:53 -04:00
John Colvin
685507eed4
refactor: Change namespace to Bts.DataStreamCore for a few types
...
Since they're in the DataStreamCore csproj
2025-08-24 13:46:53 -04:00
John Colvin
6567baa7d5
Make 'name' default to CallerArgumentExpression for convenience
2025-08-24 13:46:52 -04:00
John Colvin
39dc6c24ed
refactor: Replace if/else with switch cases
2025-08-24 13:46:52 -04:00
John Colvin
317a8cee60
cleanup: Remove over-engineered subcommands
...
We don't need explicit subcommands to 'run onixs' md (just use config).
2025-08-24 13:46:52 -04:00
John Colvin
9bb7beabc2
fix: Ensure IDGenerator instance is created before deref
2025-08-24 13:46:52 -04:00
John Colvin
2364c82254
fix: Expand undefined vars to empty string
...
Bugs (fixed):
* Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2025-08-24 13:46:52 -04:00
John Colvin
b3114f2a62
fix: Emplace MDConsumerHandle instead of copy assign
2025-08-24 13:46:52 -04:00
John Colvin
b64a8ba214
cleanup: Remove unnecessary code
...
Trim includes as well
2025-08-24 13:46:52 -04:00
John Colvin
b257b673fb
improvement: Set SHARED_MEMORY_PREFIX to an environment variable
...
So we can effectively define it at runtime. We don't want to have to
produce different builds just to change the shared mem prefix.
2025-08-24 13:46:52 -04:00
John Colvin
43df2bbdc5
fix: Always prepend proc name to shared mem prefix
...
Our shared memory model isn't really designed to be shared across
processes. Maybe some day it will.
2025-08-24 13:46:52 -04:00
John Colvin
5f80492c93
cleanup: Remove redundant macro def
2025-08-24 13:46:52 -04:00
John Colvin
5a63b25a8f
Skip md recording thread loop if no recorders configured to run
2025-08-24 13:46:51 -04:00
John Colvin
5647beed40
cleanup: Trivial whitespace cleanup in Protobuf.cmake
2025-08-24 13:46:51 -04:00
John Colvin
d3900e3149
build: Clean up data_files cmake proj (support --target clean)
2025-08-24 13:46:51 -04:00
John Colvin
221505e243
fix build: Add ShmSegmentName.cpp to windows client sources
2025-08-24 13:46:51 -04:00
John Colvin
d16c696ecf
Add api server to docker compose
2025-08-24 13:46:51 -04:00
John Colvin
c371fd8e99
Change api server ports so they don't conflict w/ ds webapp
2025-08-24 13:46:51 -04:00
John Colvin
16fb295a37
build: Resolve app data dir and shared mem prefix at runtime
...
We really can't define them at compile time anymore as we build multiple
exes that depend on libspark in the same dir (e.g., spark api server,
pubsub, ds-publisher, webapp, etc.). That means one libspark.so (or dll)
must serve all exes. We should compile a consistent libspark to mitigate
the risk of running an exe with the wrong version (of libspark). For
example, running pubsub with a libspark configured for spark api server,
leftover from an earlier build.
2025-08-24 13:46:51 -04:00
John Colvin
bb157c768c
Don't log "initializing spark config" if it has already been initialized
2025-08-24 13:46:51 -04:00
John Colvin
8c9ac51bb6
vscode: Add debug cfg for spark api server
2025-08-24 13:46:51 -04:00
John Colvin
39d04285d0
Use dependency injection in spark api server
2025-08-24 13:46:51 -04:00
John Colvin
41db558841
Add SparkLoggerAdapter for Msft ILogger
2025-08-24 13:46:51 -04:00
John Colvin
cdebdd5765
fix: Don't assert on exception in BooleanExpression.evaluate
...
Bugs (fixed):
* DataStream WebApp Server sometimes crashes when the user enters a
bad query.
2025-08-24 13:46:50 -04:00
John Colvin
bb7a000689
Assert that local ip address is successfully obtained
2025-08-24 13:46:50 -04:00
John Colvin
d62816ac0b
improvement: Resolve hostnames when comparing ip addrs
...
So we can to configure pubsub routes by hostname or ipv4 (ipv6 hasn't
been tested yet...so we should assume it doesn't work).
2025-08-24 13:46:50 -04:00
John Colvin
964ec5b565
Assert TcpConnection endpoint matches expected
2025-08-24 13:46:50 -04:00
John Colvin
46247b6439
Catch exceptions on AsyncTCPConnector_AsyncWrapper background thread
...
Since it spawns a new thread on each attempt, uncaught exceptions were previously undetected,
and caused silent failures down the pipe. This should make it easier to track such bugs down.
2025-08-24 13:46:50 -04:00
John Colvin
10e862074c
fix: Format PubSubRoute as json in log msgs
...
It was previously using the default ToString, which simply returns the type name
2025-08-24 13:46:50 -04:00