John Colvin
8af9d13802
Drop dump-books and dump-securities from spark_api_server cli
...
These were subcommands were out of place. This exe has one purpose: run
the Spark Api Server.
2025-11-15 12:38:48 -05:00
John Colvin
318d8fb275
cleanup: Remove unused MarketDataClient from OrderSample
2025-11-15 12:38:48 -05:00
John Colvin
f33d19c185
build: Launch console for Spark Debug builds, otherwise hide it
2025-11-15 12:36:28 -05:00
John Colvin
fb43d214f3
cleanup: Remove ancient winforms sdk ui example
2025-11-15 12:16:33 -05:00
John Colvin
c4f12be3e4
cleanup: Fix a ton of build warnings (cs)
...
All these warnings have been bothering me for a while. The work isn't done, but
this commit chops them down from ~1000 to ~600.
* AppendCollection.cs
* AppendStreamModified.cs
* BenzingaNewsStream.cs
* BenzingaNewsSymbolStateStream.cs
* BookStream.cs
* CSVSaverStream.cs
* ChartsUtils.cs
* ColumnInfo.cs
* ContractUtils.cs
* ContractUtils.cs
* DiffStream.cs
* FuturesActiveContractStream.cs
* FuzzyJoinOverTimeStream.cs
* HistoricalBarsStream.cs
* HistoricalBarsStream.cs
* InstrumentsStream.cs
* JoinOperandRowIndex.cs
* JoinRow.cs
* JoinStream.cs
* JoinTable.cs
* JoinTableSchema.cs
* LatencyStream.cs
* LeftInternalJoinStream.cs
* LightForeignJoinRow.cs
* LightForeignJoinRowList.cs
* LightLeftForeignJoinRow.cs
* LiteralStream.cs
* NLStream.cs
* NLToDSLStream.cs
* NLToIndexedFewShotPromptStream.cs
* NonIncGroupByStream.cs
* NonIncJoinBookkeeper.cs
* NonIncJoinSpec.cs
* OHLCVStream.cs
* OpenAIPromptStream.cs
* PriceStatsStream.cs
* PriceStatsStream.cs
* ProjectHelper.cs
* ProjectStream.cs
* PubSubServerStateStream.cs
* PubsubHeartbeatStream.cs
* SimpleNode.cs
* SortRow.cs
* SpatialArbStatsStream.cs
* SpatialFuturePairsStream.cs
* SpreadPerformanceEvaluator.cs
* SpreadPerformanceStream.cs
* StreamIOCommon.cs
* SuperJoinStream.cs
* TableMetaDataStream.cs
* TextWriterStream.cs
* TimeAverageStream.cs
2025-11-15 12:16:33 -05:00
John Colvin
54d7279832
style: Normalize indentation in PubsubHeartbeatStream.cs
2025-11-15 12:16:33 -05:00
John Colvin
03df578a81
chore: Add GetValue, TryGetValue ext fns to IBlueRow
2025-11-15 12:16:32 -05:00
John Colvin
7a50ad2cc5
chore: Add 'Empty' fn for BlueTable/Schema (for convenience)
2025-11-15 12:16:32 -05:00
John Colvin
0cc4b83417
cleanup: Remove redundant code block in HistoricalBarsStream.cs
2025-11-15 12:16:32 -05:00
John Colvin
4f1efea066
cleanup: Fix indentation and build warnings in TestStream.cs
2025-11-15 12:16:32 -05:00
John Colvin
ef4bcf4c44
fix (preemptive): Avoid StackOverflow in md client securities fn
...
One of the 'securities_incremental' fns was calling back into itself instead of
the other overload. This is a 'preemptive' fix because the problematic code path
wasn't running in practice (though it was a ticking time bomb).
2025-11-15 12:16:32 -05:00
John Colvin
5a6139f3c5
cleanup: Make MDConsumer.on_security nonnull
...
It's always initialized in the constructor.
2025-11-15 12:16:32 -05:00
John Colvin
e2816aaa33
refactor: Decouple ViewStreamDatabase from TableStream, ISubscriberCore
2025-11-15 12:16:32 -05:00
John Colvin
fc702db7fa
check pt: PingPong algo
...
This is a work-in-progress; putting a pin in it for now to focus on
other priorities.
2025-11-15 12:16:32 -05:00
John Colvin
787cf0becd
Add environment variable override for app data path
...
Historically, ~/sparkdata on linux, and ~/AppData/Roaming/bts on win.
Now that we may run multiple exes at once (api server, pubsub, sparkd, etc.),
we need to support multiple data dirs on the same host.
2025-11-15 12:16:32 -05:00
John Colvin
b4e26d2fbe
Drop ".exe" from log dir name on windows
2025-11-15 12:16:32 -05:00
John Colvin
e2a101eb20
feat: Add SpreadBook stream
2025-11-15 12:16:32 -05:00
John Colvin
6300f8f7c2
fix: Check settings Subject.IsDisposed before using
2025-11-15 12:16:32 -05:00
John Colvin
1c6f4669be
ui (launcher): Move "X" button to left of report menu items
...
This is a more natural location. Also, it looked weird on the right because the
menu labels aren't fixed width, so the buttons weren't vertically aligned.
2025-11-15 12:16:32 -05:00
John Colvin
45fcb2e20b
refactor: Use HostBuilder to launch spark w/ streams
2025-11-15 12:16:32 -05:00
John Colvin
dcb02feb90
build: Update System.Composition pkg refs to 8.0.0
2025-11-15 12:16:31 -05:00
John Colvin
81444c1045
cleanup: Mark a few classes "internal" in Spark
2025-11-15 12:16:31 -05:00
John Colvin
934c0ae70a
cleanup: Use consistent access modifier in TabDocument partial class
...
It should be marked internal in both xaml and xaml.cs (it was previously
only so in the latter).
2025-11-15 12:16:31 -05:00
John Colvin
efdd91935e
refactor: Consolidate ShellBootstrapper and base class into one
2025-11-15 12:16:31 -05:00
John Colvin
da96744f7f
feat: Add Stream Reports shell window
2025-11-15 12:16:31 -05:00
John Colvin
6ed6a36ee1
build: Define custom "main" (entry point) for Spark exe
...
This is a prelude to integrating streams into spark. The plan is to use
an ms HostBuilder to instantiate stream services/dependencies alongside
the spark Application object.
2025-11-15 12:12:55 -05:00
John Colvin
e0fc22121f
cleanup: Get rid of stunnel code
...
This looks like it hasn't been hooked up for years...it would only start
if a stunnel.conf file was detected, which hasn't been around for a very
long time.
2025-11-14 15:02:16 -05:00
John Colvin
3671e4d713
fix: Only create mutex if spark app is NOT running in vs designer
...
I accidentally droped the '!' in a cleanup commit 4 years ago
2025-11-14 15:02:16 -05:00
John Colvin
15883e42b6
fix (dsqa): Resolve name conflicts with new BlueOrb streams
2025-11-14 15:02:16 -05:00
John Colvin
34caf54015
fix: Fix typo in "DateTimeExpansionStream" type name
...
Previously, it was "DateTimeExpanstion" (erroneous "t")
2025-11-14 15:02:16 -05:00
John Colvin
84a4182077
chore: Add CircularBuffer class (c#)
2025-11-14 15:02:16 -05:00
John Colvin
e8197a81cc
refactor: Rename ExceptionAssert.is_valid ExceptionAssert.Index.IsValid
...
Like the ExceptionAssert.Argument class that provides methods that throw
ArgumentException if a condition isn't satisfied, the ExceptionAssert.Index
class provides methods that throw IndexOutOfRange exceptions.
2025-11-14 15:02:15 -05:00
John Colvin
17d2f6d701
chore: Add OffsetList class
...
This supports mutations (unlike the SubRangeWrapper class).
2025-11-14 15:02:15 -05:00
John Colvin
b728a8cb46
cleanup: Remove "partial" class modifiers from OrderBook vm classes
...
They simply weren't necessary.
2025-11-14 15:02:15 -05:00
John Colvin
6766e48706
check pt: Proof of concept ladder left panel price point collection
2025-11-14 15:02:15 -05:00
John Colvin
e7246b22bc
ui: Adjust ladder ticks-per-row with ctrl+shift+mousewheel
2025-11-14 15:02:15 -05:00
John Colvin
05644ed6cf
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2025-11-14 15:00:45 -05:00
John Colvin
d6a88a7ac9
cleanup: Remove unused code
2025-11-14 14:59:33 -05:00
John Colvin
f7e620db3e
Reduce log noise in AsyncTCPConnection_AsyncWrapper
2025-11-14 14:59:33 -05:00
John Colvin
c745407ae7
TEMP changes to appsettings.json (at least i should review them before making permanent)
2025-11-14 14:59:33 -05:00
John Colvin
1bb7d6eca2
Add ColumnIndex class to resolve column names to indices
...
Improves performance compared to accessing columns by name
2025-11-14 14:59:33 -05:00
John Colvin
519ef8b0af
Increase SQLiteEnumerator page size to 65536
...
This performs better, and doesn't seem to be too large in practice
2025-11-14 14:59:33 -05:00
John Colvin
6b93c07271
Serialize TimeSpan w/ microsecond precision in DataPacket json
2025-11-14 14:59:33 -05:00
John Colvin
c3288c721d
Format DateTimes w/ microsecond precision in DataPacketJsonConverter
2025-11-14 14:59:33 -05:00
John Colvin
2622626eed
Add BlueColumnTable for pandas integration
...
This will make it easier/more natural to support pandas column expressions
2025-11-14 14:59:33 -05:00
John Colvin
d9470bdb6e
Add c# Variant class, modeled after std::variant in c++
2025-11-14 14:59:33 -05:00
John Colvin
f32e9bba10
refactor: Rename snake_case fns PascalCase
2025-11-14 14:58:14 -05:00
John Colvin
f119f30b62
fix load IDataStreamFactory(s) with depdendency injection
2025-11-14 14:57:43 -05:00
John Colvin
4877355fee
refactor: Use dependency injection in DSQA
2025-11-14 14:52:07 -05:00
John Colvin
ada7d4bed1
refactor: Load IDataStreamFactory(s) with dependency injection
...
So we can create ViewStreams that depend on other services, config, etc.
Previously, the PrimitiveManager relied purely on static construction of
types through reflection.
2025-11-14 14:52:07 -05:00