John Colvin
22ea8a7070
cleanup: Remove unused MarketDataClient from OrderSample
2025-08-24 13:46:57 -04:00
John Colvin
1b7543e94b
build: Launch console for Spark Debug builds, otherwise hide it
2025-08-24 13:46:57 -04:00
John Colvin
c66d8c1f99
cleanup: Remove ancient winforms sdk ui example
2025-08-24 13:46:57 -04:00
John Colvin
87d6a97198
cleanup: Fix a ton of build warnings (cs)
...
All these warnings have been bothering me for a while. The work isn't done, but
this commit chops them down from ~1000 to ~600.
* AppendCollection.cs
* AppendStreamModified.cs
* BenzingaNewsStream.cs
* BenzingaNewsSymbolStateStream.cs
* BookStream.cs
* CSVSaverStream.cs
* ChartsUtils.cs
* ColumnInfo.cs
* ContractUtils.cs
* ContractUtils.cs
* DiffStream.cs
* FuturesActiveContractStream.cs
* FuzzyJoinOverTimeStream.cs
* HistoricalBarsStream.cs
* HistoricalBarsStream.cs
* InstrumentsStream.cs
* JoinOperandRowIndex.cs
* JoinRow.cs
* JoinStream.cs
* JoinTable.cs
* JoinTableSchema.cs
* LatencyStream.cs
* LeftInternalJoinStream.cs
* LightForeignJoinRow.cs
* LightForeignJoinRowList.cs
* LightLeftForeignJoinRow.cs
* LiteralStream.cs
* NLStream.cs
* NLToDSLStream.cs
* NLToIndexedFewShotPromptStream.cs
* NonIncGroupByStream.cs
* NonIncJoinBookkeeper.cs
* NonIncJoinSpec.cs
* OHLCVStream.cs
* OpenAIPromptStream.cs
* PriceStatsStream.cs
* PriceStatsStream.cs
* ProjectHelper.cs
* ProjectStream.cs
* PubSubServerStateStream.cs
* PubsubHeartbeatStream.cs
* SimpleNode.cs
* SortRow.cs
* SpatialArbStatsStream.cs
* SpatialFuturePairsStream.cs
* SpreadPerformanceEvaluator.cs
* SpreadPerformanceStream.cs
* StreamIOCommon.cs
* SuperJoinStream.cs
* TableMetaDataStream.cs
* TextWriterStream.cs
* TimeAverageStream.cs
2025-08-24 13:46:57 -04:00
John Colvin
cf05d07692
style: Normalize indentation in PubsubHeartbeatStream.cs
2025-08-24 13:46:56 -04:00
John Colvin
9ccc4467ba
chore: Add GetValue, TryGetValue ext fns to IBlueRow
2025-08-24 13:46:56 -04:00
John Colvin
9c2223b4da
chore: Add 'Empty' fn for BlueTable/Schema (for convenience)
2025-08-24 13:46:56 -04:00
John Colvin
b09a39ceb6
cleanup: Remove redundant code block in HistoricalBarsStream.cs
2025-08-24 13:46:56 -04:00
John Colvin
8ebf437c9e
cleanup: Fix indentation and build warnings in TestStream.cs
2025-08-24 13:46:56 -04:00
John Colvin
160dbb624f
fix (preemptive): Avoid StackOverflow in md client securities fn
...
One of the 'securities_incremental' fns was calling back into itself instead of
the other overload. This is a 'preemptive' fix because the problematic code path
wasn't running in practice (though it was a ticking time bomb).
2025-08-24 13:46:56 -04:00
John Colvin
da945b39c7
cleanup: Make MDConsumer.on_security nonnull
...
It's always initialized in the constructor.
2025-08-24 13:46:56 -04:00
John Colvin
bfede66c31
refactor: Decouple ViewStreamDatabase from TableStream, ISubscriberCore
2025-08-24 13:46:56 -04:00
John Colvin
bc39b8fda9
chore: Add position index to IDataStreamFactory input args
2025-08-24 13:46:56 -04:00
John Colvin
12fadab839
check pt: PingPong algo (2)
2025-08-24 13:46:56 -04:00
John Colvin
bcbfc56e7d
check pt: PingPong algo
2025-08-24 13:46:56 -04:00
John Colvin
efd389ea46
Add environment variable override for app data path
...
Historically, ~/sparkdata on linux, and ~/AppData/Roaming/bts on win.
Now that we may run multiple exes at once (api server, pubsub, sparkd, etc.),
we need to support multiple data dirs on the same host.
2025-08-24 13:46:56 -04:00
John Colvin
ce236da67b
Drop ".exe" from log dir name on windows
2025-08-24 13:46:56 -04:00
John Colvin
e91fb32207
feat: Add SpreadBook stream
2025-08-24 13:46:56 -04:00
John Colvin
0cf576a055
fix: Check settings Subject.IsDisposed before using
2025-08-24 13:46:56 -04:00
John Colvin
7213b05c9e
ui (launcher): Move "X" button to left of report menu items
...
This is a more natural location. Also, it looked weird on the right because the
menu labels aren't fixed width, so the buttons weren't vertically aligned.
2025-08-24 13:46:55 -04:00
John Colvin
19a6f53cfa
refactor: Use HostBuilder to launch spark w/ streams
2025-08-24 13:46:55 -04:00
John Colvin
7a53bf4b01
build (cleanup): Get rid of global.json
...
We don't need it anymore
2025-08-24 13:46:55 -04:00
John Colvin
965186874e
build: Update System.Composition pkg refs to 8.0.0
2025-08-24 13:46:55 -04:00
John Colvin
f8704dd083
cleanup: Mark a few classes "internal" in Spark
2025-08-24 13:46:55 -04:00
John Colvin
93c2770abe
cleanup: Use consistent access modifier in TabDocument partial class
...
It should be marked internal in both xaml and xaml.cs (it was previously
only so in the latter).
2025-08-24 13:46:55 -04:00
John Colvin
f422b752a4
refactor: Consolidate ShellBootstrapper and base class into one
2025-08-24 13:46:55 -04:00
John Colvin
d6f7031716
feat: Add Stream Reports shell window
2025-08-24 13:46:55 -04:00
John Colvin
5d34bdbecf
build: Define custom "main" (entry point) for Spark exe
...
This is a prelude to integrating streams into spark. The plan is to use
an ms HostBuilder to instantiate stream services/dependencies alongside
the spark Application object.
2025-08-24 13:46:55 -04:00
John Colvin
0c96c3bc06
cleanup: Get rid of stunnel code
...
This looks like it hasn't been hooked up for years...it would only start
if a stunnel.conf file was detected, which hasn't been around for a very
long time.
2025-08-24 13:46:55 -04:00
John Colvin
1da06732e2
fix: Only create mutex if spark app is NOT running in vs designer
...
I accidentally droped the '!' in a cleanup commit 4 years ago
2025-08-24 13:46:55 -04:00
John Colvin
641f00b4e0
fix Extend dsl to support explicit param names
2025-08-24 13:46:55 -04:00
John Colvin
d860573910
vscode: Add DSQA debug cfg to skip build
2025-08-24 13:46:55 -04:00
John Colvin
fa8f623263
fix (dsqa): Resolve name conflicts with new BlueOrb streams
2025-08-24 13:46:55 -04:00
John Colvin
706d9235ca
fix: Fix typo in "DateTimeExpansionStream" type name
...
Previously, it was "DateTimeExpanstion" (erroneous "t")
2025-08-24 13:46:55 -04:00
John Colvin
03c99cc3df
chore: Add CircularBuffer class (c#)
2025-08-24 13:46:55 -04:00
John Colvin
fc050f4bd3
refactor: Rename ExceptionAssert.is_valid ExceptionAssert.Index.IsValid
...
Like the ExceptionAssert.Argument class that provides methods that throw
ArgumentException if a condition isn't satisfied, the ExceptionAssert.Index
class provides methods that throw IndexOutOfRange exceptions.
2025-08-24 13:46:55 -04:00
John Colvin
39b3490f5a
chore: Add OffsetList class
...
This supports mutations (unlike the SubRangeWrapper class).
2025-08-24 13:46:54 -04:00
John Colvin
a0ef2c3348
cleanup: Remove "partial" class modifiers from OrderBook vm classes
...
They simply weren't necessary.
2025-08-24 13:46:54 -04:00
John Colvin
acb420d4cc
check pt: Proof of concept ladder left panel price point collection
2025-08-24 13:46:54 -04:00
John Colvin
ab07697985
ui: Adjust ladder ticks-per-row with ctrl+shift+mousewheel
2025-08-24 13:46:54 -04:00
John Colvin
6ad7418931
build: Change publish_data_stream.py to publish the sln
...
We were publishing individual projects as a workaround for the
dependency issue (bug) that caused some projects to incorrectly target
net8.0. The fact that publishing individual projects "just worked" was
probably dumb luck. Now that the underlying issue has been addressed, we
can resume publishing the sln as a whole.
2025-08-24 13:46:54 -04:00
John Colvin
783764fc1f
build: Add scripts to publish data stream apps
2025-08-24 13:46:54 -04:00
John Colvin
5771b19c18
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2025-08-24 13:46:54 -04:00
John Colvin
ee5b78ed9c
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2025-08-24 13:46:54 -04:00
John Colvin
d609dcd3c2
cleanup: Remove unused code
2025-08-24 13:46:54 -04:00
John Colvin
7b266cd4d0
Reduce log noise in AsyncTCPConnection_AsyncWrapper
2025-08-24 13:46:54 -04:00
John Colvin
de8593af5a
TEMP changes to appsettings.json (at least i should review them before making permanent)
2025-08-24 13:46:54 -04:00
John Colvin
ab6f6e1790
Add ColumnIndex class to resolve column names to indices
...
Improves performance compared to accessing columns by name
2025-08-24 13:46:54 -04:00
John Colvin
51e38ca793
Increase SQLiteEnumerator page size to 65536
...
This performs better, and doesn't seem to be too large in practice
2025-08-24 13:46:53 -04:00
John Colvin
7b2bc4b10c
Serialize TimeSpan w/ microsecond precision in DataPacket json
2025-08-24 13:46:53 -04:00