John Colvin
fa017bd9ff
fix build: Remove old ViewStream.rows references from dsqa
...
The 'rows' prop no longer exists
2026-02-20 02:13:17 -05:00
John Colvin
020ec9c6bf
build: Replace proj refs w/ internal nugets when packing
2026-02-03 16:57:32 +00:00
John Colvin
6985fbb090
refactor: Move CompressionUtilities into separate csproj
...
It was nested in PubSub. The new csproj is named Bts.IO.Compression.
2026-02-03 16:57:32 +00:00
John Colvin
ead35389d5
build: Make PubSub packable
2026-02-03 05:20:29 +00:00
John Colvin
2eb80082d8
refactor: Move Bts.Extensions.Hosting, Bts.Net to cs dir
...
They aren't exclusively used by DataStream csprojs
2026-01-21 14:20:39 -05:00
John Colvin
1432692a26
refactor: Make PriceStats/Ticker record structs
...
Also rename props in PascalCase
2026-01-13 13:57:47 -05:00
John Colvin
88beb0f148
fix: Avoid null ref ex in DiffStream
2026-01-11 15:15:13 -05:00
John Colvin
0f70ae5da2
fix: Fix 'future' -> 'spread' typo in LiveFuturesContractStream
2026-01-11 15:15:13 -05:00
John Colvin
bcd207f89e
cleanup: Fix more build warnings in DataStreamSuite
...
Alot more
2026-01-11 15:15:13 -05:00
John Colvin
989d103eef
fix: Properly store and dispose md subscription in BBOStream
2026-01-11 15:15:12 -05:00
John Colvin
aacd22d496
refactor: Move Exception utils to Spark.Core.Diagnostics ns
2026-01-11 15:15:12 -05:00
John Colvin
d89164c0ff
refactor: Move CollectionExtensions to Spark.Core.Collections namespace
2026-01-11 15:12:33 -05:00
John Colvin
cbddb3ae28
fix: Avoid potential race bug in c# OrderPool
2026-01-11 11:20:40 -05:00
John Colvin
cd34f9b1cb
cleanup: Tidy up SecondStream, move ThrottleStream to own file
...
There actually already was a file called "ThrottleStream", but since it
didn't have the ".cs" extension it wasn't getting built.
2026-01-11 11:20:40 -05:00
John Colvin
5f689dbd8e
cleanup: Tidy whitespace and using statements
2026-01-11 11:20:40 -05:00
John Colvin
03a8f4e9c0
refactor: Replace DataPacket w/ IDataPacket in many places
2026-01-11 11:20:40 -05:00
John Colvin
49a952fb32
refactor: Generate a few row types with new t4 templates
...
* PubSubHeartbeatRow
* PubSubRouteRow
* PubSubServerStateRow
* PubSubServerTagStatsRow
* TableMetadataRow
2026-01-10 12:59:14 -05:00
John Colvin
a1c6e0ccab
build: Add t4 templates to generate c# row types
...
Produces classes/structs that implement IBlueRow with strongly typed
properties for each column.
2026-01-10 12:59:14 -05:00
John Colvin
63a3eb968c
diag: Assert DataStream updates are incremental
...
In debug builds
2026-01-10 12:59:14 -05:00
John Colvin
9de4b27003
refactor: Ensure stream subscriptions only disposed once
...
In the debugger, I noticed a few streams were unhooking their internal
onChange callbacks unnecessarily (when they were already unhooked).
2026-01-10 12:59:14 -05:00
John Colvin
849c6c28e5
fix: Don't fire empty updates in MutableAppendStream
2026-01-10 12:59:14 -05:00
John Colvin
bf3a8f076f
fix: Change DSQA config pubsub port to 22019
...
The port PubSubServer runs on by default
2026-01-10 12:59:14 -05:00
John Colvin
44749739b9
build: Define centralized SparkVersion prop
...
All csprojs should be on the same version. At the very least, it
is a sensible default.
2026-01-10 12:59:14 -05:00
John Colvin
ddf16bcd5c
fix: Add missing LiveMarketDataStream attribute to InstrumentsStream
...
Otherwise PrimitiveManager returns null for that stream type
2026-01-10 12:59:14 -05:00
John Colvin
cfe7d43770
fix: Initialize ViewStreamDatabase.instance in DSQA
2026-01-10 12:59:14 -05:00
John Colvin
bb5ea19f69
refactor: Get rid of ViewStream.rows prop
...
It was causing weird side effects in debugger
2026-01-10 12:59:14 -05:00
John Colvin
327665b4c3
fix: Add null check in ProximityJoinStream
2026-01-08 14:24:27 -05:00
John Colvin
2843638386
fix: Only start Stopwatch when actually doing work
2026-01-08 14:24:27 -05:00
John Colvin
915322927a
fix: Dispose md subscription in InstrumentsStream
2026-01-08 14:23:09 -05:00
John Colvin
9905216131
fix: Format PubSub and DSQA config json in PascalCase
...
Matches what's in appsettings.json files
2026-01-08 14:22:57 -05:00
John Colvin
7719aaa2b3
fix: Add EnvironmentVariables config provider to HostBuilder
2026-01-06 14:02:10 -05:00
John Colvin
ad3a8a7544
fix: Add json config sources before env vars and cmd line sources
...
So environment variables override json files (if there is a conflict),
and command line args override everything else.
2026-01-06 02:34:36 -05:00
John Colvin
75d3ba1d59
fix: Support cross-type numeric comparisons in ArgumentComparer
...
For example, so we can compare ints with doubles. Also adds support for
DateTime and TimeSpan cross-type comparisons.
2026-01-05 13:36:07 -05:00
John Colvin
bb1e7c30c8
build: Add msbuild flag to reference projs or local nugets
...
So we can use project refs for dev builds, and package refs for releases.
2026-01-04 21:19:00 +00:00
John Colvin
6568c29ad4
cleanup: Remove unnecessary ProjectReference
2026-01-04 21:19:00 +00:00
John Colvin
59b1aead62
refactor: Use HostBuilder to launch spark w/ streams
2026-01-04 21:19:00 +00:00
John Colvin
a515468e37
refactor: Rename TableUpdate props to PascalCase
...
Makes the sdk look more polished, professional
2026-01-04 21:19:00 +00:00
John Colvin
c50a006d7d
deploy: Update dotnet7 -> dotnet8 in docker images
2026-01-04 21:19:00 +00:00
John Colvin
69e4ed84c1
build: Generate version info via git cli in build scripts
...
Instead of GitVersion.MsBuild nuget
2026-01-04 21:18:58 +00:00
John Colvin
c4a6b4591d
cleanup: Remove last vestiges of spark proto config from DataStreamCore
2026-01-04 21:08:13 +00:00
John Colvin
8f3fa18bca
refactor: Rename spark_api csproj Bts.Spark.Api
...
This follows the conventional naming practices, where the project shares its
name with the namespace. Doing this in anticipation of the csharp sdk we are
about to release (for Ophir).
2026-01-04 21:08:13 +00:00
John Colvin
f60782915c
refactor: Rename spark_core csproj Bts.Spark.Core
...
This follows the conventional naming practices, where the project shares its
name with the namespace. Doing this in anticipation of the csharp sdk we are
about to release (for Ophir).
2026-01-04 21:08:13 +00:00
John Colvin
3565f78be8
cleanup (build): Remove redundant csproj refs
...
For example, projects that reference spark_api don't need an explicit reference
to spark_core, since spark_api already references it. The same goes for projects
that reference DataStream and DataStreamCore.
2026-01-04 21:08:13 +00:00
John Colvin
67f7124ed5
build: Remove DSQA from DataStreamSuite.sln
...
Because it doesn't build on linux
2026-01-04 21:08:12 +00:00
John Colvin
1c579ee063
refactor: Change namespace to Bts.DataStreamCore for a few types
...
Since they're in the DataStreamCore csproj
2026-01-04 21:08:12 +00:00
John Colvin
856cd552eb
refactor: Add Api Server service modules for Dependency Injection
...
* Part of a broader paradigm shift towards Dependency Injection and
Factory Pattern.
* Adds "api-server" service to docker compose
* Replaces MarketDataClient w/ IMarketDataClient in a few streams
* Replaces ViewStreamDatabase w/ IWorkScheduler in a few streams
2026-01-04 21:08:12 +00:00
John Colvin
687a9741db
fix: Don't assert on exception in BooleanExpression.evaluate
...
Bugs (fixed):
* DataStream WebApp Server sometimes crashes when the user enters a
bad query.
2026-01-04 21:08:12 +00:00
John Colvin
7faa0ade24
diag: Assert that local ip address is successfully obtained
2026-01-04 21:08:12 +00:00
John Colvin
4d6d68aff6
improve: Resolve hostnames when comparing ip addrs
...
So we can to configure pubsub routes by hostname or ipv4 (ipv6 hasn't
been tested yet...so we should assume it doesn't work).
2026-01-04 21:08:12 +00:00
John Colvin
dcf291d6b2
diag: Assert TcpConnection endpoint matches expected
2026-01-04 21:08:12 +00:00