Commit Graph
14407 Commits
Author SHA1 Message Date
John Colvin 84351460b5 refactor: Add IDataStreamFactory(s) for spatial arb streams 2025-08-24 13:46:58 -04:00
John Colvin 9a1fee4e83 Support custom stream argument parsers 2025-08-24 13:46:58 -04:00
John Colvin dd55866056 Make stream arg name regex match case insensitive 2025-08-24 13:46:57 -04:00
John Colvin 8f6e2b8512 tool: Run Spark.exe from its own directory
It looks in the working directory for runtime config appsettings.json files.
2025-08-24 13:46:57 -04:00
John Colvin b9a36f5d51 cleanup: Remove unused BooleanExpressionToken Negate 2025-08-24 13:46:57 -04:00
John Colvin 3a3bec5821 doc: Comment why MDConsumer must be kept alive
The language server suggests removing it because it isn't referenced.
However, it contains unmanaged resources that mustn't be prematurely
garbage collected.
2025-08-24 13:46:57 -04:00
John Colvin 05a5e9dcf8 refactor: Rename AddRemoteQueryManager -> AddRemoteQueryStreams 2025-08-24 13:46:57 -04:00
John Colvin b1211ed590 refactor: Hide md client behind interface, create via Dep Injection 2025-08-24 13:46:57 -04:00
John Colvin d9a2ab00f8 Drop dump-books and dump-securities from spark_api_server cli
These were subcommands were out of place. This exe has one purpose: run
the Spark Api Server.
2025-08-24 13:46:57 -04:00
John Colvin 22ea8a7070 cleanup: Remove unused MarketDataClient from OrderSample 2025-08-24 13:46:57 -04:00
John Colvin 1b7543e94b build: Launch console for Spark Debug builds, otherwise hide it 2025-08-24 13:46:57 -04:00
John Colvin c66d8c1f99 cleanup: Remove ancient winforms sdk ui example 2025-08-24 13:46:57 -04:00
John Colvin 87d6a97198 cleanup: Fix a ton of build warnings (cs)
All these warnings have been bothering me for a while. The work isn't done, but
this commit chops them down from ~1000 to ~600.

* AppendCollection.cs
* AppendStreamModified.cs
* BenzingaNewsStream.cs
* BenzingaNewsSymbolStateStream.cs
* BookStream.cs
* CSVSaverStream.cs
* ChartsUtils.cs
* ColumnInfo.cs
* ContractUtils.cs
* ContractUtils.cs
* DiffStream.cs
* FuturesActiveContractStream.cs
* FuzzyJoinOverTimeStream.cs
* HistoricalBarsStream.cs
* HistoricalBarsStream.cs
* InstrumentsStream.cs
* JoinOperandRowIndex.cs
* JoinRow.cs
* JoinStream.cs
* JoinTable.cs
* JoinTableSchema.cs
* LatencyStream.cs
* LeftInternalJoinStream.cs
* LightForeignJoinRow.cs
* LightForeignJoinRowList.cs
* LightLeftForeignJoinRow.cs
* LiteralStream.cs
* NLStream.cs
* NLToDSLStream.cs
* NLToIndexedFewShotPromptStream.cs
* NonIncGroupByStream.cs
* NonIncJoinBookkeeper.cs
* NonIncJoinSpec.cs
* OHLCVStream.cs
* OpenAIPromptStream.cs
* PriceStatsStream.cs
* PriceStatsStream.cs
* ProjectHelper.cs
* ProjectStream.cs
* PubSubServerStateStream.cs
* PubsubHeartbeatStream.cs
* SimpleNode.cs
* SortRow.cs
* SpatialArbStatsStream.cs
* SpatialFuturePairsStream.cs
* SpreadPerformanceEvaluator.cs
* SpreadPerformanceStream.cs
* StreamIOCommon.cs
* SuperJoinStream.cs
* TableMetaDataStream.cs
* TextWriterStream.cs
* TimeAverageStream.cs
2025-08-24 13:46:57 -04:00
John Colvin cf05d07692 style: Normalize indentation in PubsubHeartbeatStream.cs 2025-08-24 13:46:56 -04:00
John Colvin 9ccc4467ba chore: Add GetValue, TryGetValue ext fns to IBlueRow 2025-08-24 13:46:56 -04:00
John Colvin 9c2223b4da chore: Add 'Empty' fn for BlueTable/Schema (for convenience) 2025-08-24 13:46:56 -04:00
John Colvin b09a39ceb6 cleanup: Remove redundant code block in HistoricalBarsStream.cs 2025-08-24 13:46:56 -04:00
John Colvin 8ebf437c9e cleanup: Fix indentation and build warnings in TestStream.cs 2025-08-24 13:46:56 -04:00
John Colvin 160dbb624f fix (preemptive): Avoid StackOverflow in md client securities fn
One of the 'securities_incremental' fns was calling back into itself instead of
the other overload. This is a 'preemptive' fix because the problematic code path
wasn't running in practice (though it was a ticking time bomb).
2025-08-24 13:46:56 -04:00
John Colvin da945b39c7 cleanup: Make MDConsumer.on_security nonnull
It's always initialized in the constructor.
2025-08-24 13:46:56 -04:00
John Colvin bfede66c31 refactor: Decouple ViewStreamDatabase from TableStream, ISubscriberCore 2025-08-24 13:46:56 -04:00
John Colvin bc39b8fda9 chore: Add position index to IDataStreamFactory input args 2025-08-24 13:46:56 -04:00
John Colvin 12fadab839 check pt: PingPong algo (2) 2025-08-24 13:46:56 -04:00
John Colvin bcbfc56e7d check pt: PingPong algo 2025-08-24 13:46:56 -04:00
John Colvin efd389ea46 Add environment variable override for app data path
Historically, ~/sparkdata on linux, and ~/AppData/Roaming/bts on win.
Now that we may run multiple exes at once (api server, pubsub, sparkd, etc.),
we need to support multiple data dirs on the same host.
2025-08-24 13:46:56 -04:00
John Colvin ce236da67b Drop ".exe" from log dir name on windows 2025-08-24 13:46:56 -04:00
John Colvin e91fb32207 feat: Add SpreadBook stream 2025-08-24 13:46:56 -04:00
John Colvin 0cf576a055 fix: Check settings Subject.IsDisposed before using 2025-08-24 13:46:56 -04:00
John Colvin 7213b05c9e ui (launcher): Move "X" button to left of report menu items
This is a more natural location. Also, it looked weird on the right because the
menu labels aren't fixed width, so the buttons weren't vertically aligned.
2025-08-24 13:46:55 -04:00
John Colvin 19a6f53cfa refactor: Use HostBuilder to launch spark w/ streams 2025-08-24 13:46:55 -04:00
John Colvin 7a53bf4b01 build (cleanup): Get rid of global.json
We don't need it anymore
2025-08-24 13:46:55 -04:00
John Colvin 965186874e build: Update System.Composition pkg refs to 8.0.0 2025-08-24 13:46:55 -04:00
John Colvin f8704dd083 cleanup: Mark a few classes "internal" in Spark 2025-08-24 13:46:55 -04:00
John Colvin 93c2770abe cleanup: Use consistent access modifier in TabDocument partial class
It should be marked internal in both xaml and xaml.cs (it was previously
only so in the latter).
2025-08-24 13:46:55 -04:00
John Colvin f422b752a4 refactor: Consolidate ShellBootstrapper and base class into one 2025-08-24 13:46:55 -04:00
John Colvin d6f7031716 feat: Add Stream Reports shell window 2025-08-24 13:46:55 -04:00
John Colvin 5d34bdbecf build: Define custom "main" (entry point) for Spark exe
This is a prelude to integrating streams into spark. The plan is to use
an ms HostBuilder to instantiate stream services/dependencies alongside
the spark Application object.
2025-08-24 13:46:55 -04:00
John Colvin 0c96c3bc06 cleanup: Get rid of stunnel code
This looks like it hasn't been hooked up for years...it would only start
if a stunnel.conf file was detected, which hasn't been around for a very
long time.
2025-08-24 13:46:55 -04:00
John Colvin 1da06732e2 fix: Only create mutex if spark app is NOT running in vs designer
I accidentally droped the '!' in a cleanup commit 4 years ago
2025-08-24 13:46:55 -04:00
John Colvin 641f00b4e0 fix Extend dsl to support explicit param names 2025-08-24 13:46:55 -04:00
John Colvin d860573910 vscode: Add DSQA debug cfg to skip build 2025-08-24 13:46:55 -04:00
John Colvin fa8f623263 fix (dsqa): Resolve name conflicts with new BlueOrb streams 2025-08-24 13:46:55 -04:00
John Colvin 706d9235ca fix: Fix typo in "DateTimeExpansionStream" type name
Previously, it was "DateTimeExpanstion" (erroneous "t")
2025-08-24 13:46:55 -04:00
John Colvin 03c99cc3df chore: Add CircularBuffer class (c#) 2025-08-24 13:46:55 -04:00
John Colvin fc050f4bd3 refactor: Rename ExceptionAssert.is_valid ExceptionAssert.Index.IsValid
Like the ExceptionAssert.Argument class that provides methods that throw
ArgumentException if a condition isn't satisfied, the ExceptionAssert.Index
class provides methods that throw IndexOutOfRange exceptions.
2025-08-24 13:46:55 -04:00
John Colvin 39b3490f5a chore: Add OffsetList class
This supports mutations (unlike the SubRangeWrapper class).
2025-08-24 13:46:54 -04:00
John Colvin a0ef2c3348 cleanup: Remove "partial" class modifiers from OrderBook vm classes
They simply weren't necessary.
2025-08-24 13:46:54 -04:00
John Colvin acb420d4cc check pt: Proof of concept ladder left panel price point collection 2025-08-24 13:46:54 -04:00
John Colvin ab07697985 ui: Adjust ladder ticks-per-row with ctrl+shift+mousewheel 2025-08-24 13:46:54 -04:00
John Colvin 6ad7418931 build: Change publish_data_stream.py to publish the sln
We were publishing individual projects as a workaround for the
dependency issue (bug) that caused some projects to incorrectly target
net8.0. The fact that publishing individual projects "just worked" was
probably dumb luck. Now that the underlying issue has been addressed, we
can resume publishing the sln as a whole.
2025-08-24 13:46:54 -04:00