Commit Graph
14398 Commits
Author SHA1 Message Date
John Colvin 22ea8a7070 cleanup: Remove unused MarketDataClient from OrderSample 2025-08-24 13:46:57 -04:00
John Colvin 1b7543e94b build: Launch console for Spark Debug builds, otherwise hide it 2025-08-24 13:46:57 -04:00
John Colvin c66d8c1f99 cleanup: Remove ancient winforms sdk ui example 2025-08-24 13:46:57 -04:00
John Colvin 87d6a97198 cleanup: Fix a ton of build warnings (cs)
All these warnings have been bothering me for a while. The work isn't done, but
this commit chops them down from ~1000 to ~600.

* AppendCollection.cs
* AppendStreamModified.cs
* BenzingaNewsStream.cs
* BenzingaNewsSymbolStateStream.cs
* BookStream.cs
* CSVSaverStream.cs
* ChartsUtils.cs
* ColumnInfo.cs
* ContractUtils.cs
* ContractUtils.cs
* DiffStream.cs
* FuturesActiveContractStream.cs
* FuzzyJoinOverTimeStream.cs
* HistoricalBarsStream.cs
* HistoricalBarsStream.cs
* InstrumentsStream.cs
* JoinOperandRowIndex.cs
* JoinRow.cs
* JoinStream.cs
* JoinTable.cs
* JoinTableSchema.cs
* LatencyStream.cs
* LeftInternalJoinStream.cs
* LightForeignJoinRow.cs
* LightForeignJoinRowList.cs
* LightLeftForeignJoinRow.cs
* LiteralStream.cs
* NLStream.cs
* NLToDSLStream.cs
* NLToIndexedFewShotPromptStream.cs
* NonIncGroupByStream.cs
* NonIncJoinBookkeeper.cs
* NonIncJoinSpec.cs
* OHLCVStream.cs
* OpenAIPromptStream.cs
* PriceStatsStream.cs
* PriceStatsStream.cs
* ProjectHelper.cs
* ProjectStream.cs
* PubSubServerStateStream.cs
* PubsubHeartbeatStream.cs
* SimpleNode.cs
* SortRow.cs
* SpatialArbStatsStream.cs
* SpatialFuturePairsStream.cs
* SpreadPerformanceEvaluator.cs
* SpreadPerformanceStream.cs
* StreamIOCommon.cs
* SuperJoinStream.cs
* TableMetaDataStream.cs
* TextWriterStream.cs
* TimeAverageStream.cs
2025-08-24 13:46:57 -04:00
John Colvin cf05d07692 style: Normalize indentation in PubsubHeartbeatStream.cs 2025-08-24 13:46:56 -04:00
John Colvin 9ccc4467ba chore: Add GetValue, TryGetValue ext fns to IBlueRow 2025-08-24 13:46:56 -04:00
John Colvin 9c2223b4da chore: Add 'Empty' fn for BlueTable/Schema (for convenience) 2025-08-24 13:46:56 -04:00
John Colvin b09a39ceb6 cleanup: Remove redundant code block in HistoricalBarsStream.cs 2025-08-24 13:46:56 -04:00
John Colvin 8ebf437c9e cleanup: Fix indentation and build warnings in TestStream.cs 2025-08-24 13:46:56 -04:00
John Colvin 160dbb624f fix (preemptive): Avoid StackOverflow in md client securities fn
One of the 'securities_incremental' fns was calling back into itself instead of
the other overload. This is a 'preemptive' fix because the problematic code path
wasn't running in practice (though it was a ticking time bomb).
2025-08-24 13:46:56 -04:00
John Colvin da945b39c7 cleanup: Make MDConsumer.on_security nonnull
It's always initialized in the constructor.
2025-08-24 13:46:56 -04:00
John Colvin bfede66c31 refactor: Decouple ViewStreamDatabase from TableStream, ISubscriberCore 2025-08-24 13:46:56 -04:00
John Colvin bc39b8fda9 chore: Add position index to IDataStreamFactory input args 2025-08-24 13:46:56 -04:00
John Colvin 12fadab839 check pt: PingPong algo (2) 2025-08-24 13:46:56 -04:00
John Colvin bcbfc56e7d check pt: PingPong algo 2025-08-24 13:46:56 -04:00
John Colvin efd389ea46 Add environment variable override for app data path
Historically, ~/sparkdata on linux, and ~/AppData/Roaming/bts on win.
Now that we may run multiple exes at once (api server, pubsub, sparkd, etc.),
we need to support multiple data dirs on the same host.
2025-08-24 13:46:56 -04:00
John Colvin ce236da67b Drop ".exe" from log dir name on windows 2025-08-24 13:46:56 -04:00
John Colvin e91fb32207 feat: Add SpreadBook stream 2025-08-24 13:46:56 -04:00
John Colvin 0cf576a055 fix: Check settings Subject.IsDisposed before using 2025-08-24 13:46:56 -04:00
John Colvin 7213b05c9e ui (launcher): Move "X" button to left of report menu items
This is a more natural location. Also, it looked weird on the right because the
menu labels aren't fixed width, so the buttons weren't vertically aligned.
2025-08-24 13:46:55 -04:00
John Colvin 19a6f53cfa refactor: Use HostBuilder to launch spark w/ streams 2025-08-24 13:46:55 -04:00
John Colvin 7a53bf4b01 build (cleanup): Get rid of global.json
We don't need it anymore
2025-08-24 13:46:55 -04:00
John Colvin 965186874e build: Update System.Composition pkg refs to 8.0.0 2025-08-24 13:46:55 -04:00
John Colvin f8704dd083 cleanup: Mark a few classes "internal" in Spark 2025-08-24 13:46:55 -04:00
John Colvin 93c2770abe cleanup: Use consistent access modifier in TabDocument partial class
It should be marked internal in both xaml and xaml.cs (it was previously
only so in the latter).
2025-08-24 13:46:55 -04:00
John Colvin f422b752a4 refactor: Consolidate ShellBootstrapper and base class into one 2025-08-24 13:46:55 -04:00
John Colvin d6f7031716 feat: Add Stream Reports shell window 2025-08-24 13:46:55 -04:00
John Colvin 5d34bdbecf build: Define custom "main" (entry point) for Spark exe
This is a prelude to integrating streams into spark. The plan is to use
an ms HostBuilder to instantiate stream services/dependencies alongside
the spark Application object.
2025-08-24 13:46:55 -04:00
John Colvin 0c96c3bc06 cleanup: Get rid of stunnel code
This looks like it hasn't been hooked up for years...it would only start
if a stunnel.conf file was detected, which hasn't been around for a very
long time.
2025-08-24 13:46:55 -04:00
John Colvin 1da06732e2 fix: Only create mutex if spark app is NOT running in vs designer
I accidentally droped the '!' in a cleanup commit 4 years ago
2025-08-24 13:46:55 -04:00
John Colvin 641f00b4e0 fix Extend dsl to support explicit param names 2025-08-24 13:46:55 -04:00
John Colvin d860573910 vscode: Add DSQA debug cfg to skip build 2025-08-24 13:46:55 -04:00
John Colvin fa8f623263 fix (dsqa): Resolve name conflicts with new BlueOrb streams 2025-08-24 13:46:55 -04:00
John Colvin 706d9235ca fix: Fix typo in "DateTimeExpansionStream" type name
Previously, it was "DateTimeExpanstion" (erroneous "t")
2025-08-24 13:46:55 -04:00
John Colvin 03c99cc3df chore: Add CircularBuffer class (c#) 2025-08-24 13:46:55 -04:00
John Colvin fc050f4bd3 refactor: Rename ExceptionAssert.is_valid ExceptionAssert.Index.IsValid
Like the ExceptionAssert.Argument class that provides methods that throw
ArgumentException if a condition isn't satisfied, the ExceptionAssert.Index
class provides methods that throw IndexOutOfRange exceptions.
2025-08-24 13:46:55 -04:00
John Colvin 39b3490f5a chore: Add OffsetList class
This supports mutations (unlike the SubRangeWrapper class).
2025-08-24 13:46:54 -04:00
John Colvin a0ef2c3348 cleanup: Remove "partial" class modifiers from OrderBook vm classes
They simply weren't necessary.
2025-08-24 13:46:54 -04:00
John Colvin acb420d4cc check pt: Proof of concept ladder left panel price point collection 2025-08-24 13:46:54 -04:00
John Colvin ab07697985 ui: Adjust ladder ticks-per-row with ctrl+shift+mousewheel 2025-08-24 13:46:54 -04:00
John Colvin 6ad7418931 build: Change publish_data_stream.py to publish the sln
We were publishing individual projects as a workaround for the
dependency issue (bug) that caused some projects to incorrectly target
net8.0. The fact that publishing individual projects "just worked" was
probably dumb luck. Now that the underlying issue has been addressed, we
can resume publishing the sln as a whole.
2025-08-24 13:46:54 -04:00
John Colvin 783764fc1f build: Add scripts to publish data stream apps 2025-08-24 13:46:54 -04:00
John Colvin 5771b19c18 build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2025-08-24 13:46:54 -04:00
John Colvin ee5b78ed9c feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2025-08-24 13:46:54 -04:00
John Colvin d609dcd3c2 cleanup: Remove unused code 2025-08-24 13:46:54 -04:00
John Colvin 7b266cd4d0 Reduce log noise in AsyncTCPConnection_AsyncWrapper 2025-08-24 13:46:54 -04:00
John Colvin de8593af5a TEMP changes to appsettings.json (at least i should review them before making permanent) 2025-08-24 13:46:54 -04:00
John Colvin ab6f6e1790 Add ColumnIndex class to resolve column names to indices
Improves performance compared to accessing columns by name
2025-08-24 13:46:54 -04:00
John Colvin 51e38ca793 Increase SQLiteEnumerator page size to 65536
This performs better, and doesn't seem to be too large in practice
2025-08-24 13:46:53 -04:00
John Colvin 7b2bc4b10c Serialize TimeSpan w/ microsecond precision in DataPacket json 2025-08-24 13:46:53 -04:00