John Colvin
bb29c32059
refactor: Rename AddRemoteQueryManager -> AddRemoteQueryStreams
2025-11-19 14:01:00 -05:00
John Colvin
a358fe6229
refactor: Hide md client behind interface, create via Dep Injection
2025-11-19 14:00:58 -05:00
John Colvin
f7ce346925
Drop dump-books and dump-securities from spark_api_server cli
...
These were subcommands were out of place. This exe has one purpose: run
the Spark Api Server.
2025-11-19 13:57:48 -05:00
John Colvin
e7129b1513
cleanup: Remove unused MarketDataClient from OrderSample
2025-11-19 13:57:48 -05:00
John Colvin
27ee09ade8
build: Launch console for Spark Debug builds, otherwise hide it
2025-11-19 13:57:47 -05:00
John Colvin
63a64af46b
cleanup: Remove ancient winforms sdk ui example
2025-11-19 13:57:47 -05:00
John Colvin
a4efaa0089
cleanup: Fix a ton of build warnings (cs)
...
All these warnings have been bothering me for a while. The work isn't done, but
this commit chops them down from ~1000 to ~600.
* AppendCollection.cs
* AppendStreamModified.cs
* BenzingaNewsStream.cs
* BenzingaNewsSymbolStateStream.cs
* BookStream.cs
* CSVSaverStream.cs
* ChartsUtils.cs
* ColumnInfo.cs
* ContractUtils.cs
* ContractUtils.cs
* DiffStream.cs
* FuturesActiveContractStream.cs
* FuzzyJoinOverTimeStream.cs
* HistoricalBarsStream.cs
* HistoricalBarsStream.cs
* InstrumentsStream.cs
* JoinOperandRowIndex.cs
* JoinRow.cs
* JoinStream.cs
* JoinTable.cs
* JoinTableSchema.cs
* LatencyStream.cs
* LeftInternalJoinStream.cs
* LightForeignJoinRow.cs
* LightForeignJoinRowList.cs
* LightLeftForeignJoinRow.cs
* LiteralStream.cs
* NLStream.cs
* NLToDSLStream.cs
* NLToIndexedFewShotPromptStream.cs
* NonIncGroupByStream.cs
* NonIncJoinBookkeeper.cs
* NonIncJoinSpec.cs
* OHLCVStream.cs
* OpenAIPromptStream.cs
* PriceStatsStream.cs
* PriceStatsStream.cs
* ProjectHelper.cs
* ProjectStream.cs
* PubSubServerStateStream.cs
* PubsubHeartbeatStream.cs
* SimpleNode.cs
* SortRow.cs
* SpatialArbStatsStream.cs
* SpatialFuturePairsStream.cs
* SpreadPerformanceEvaluator.cs
* SpreadPerformanceStream.cs
* StreamIOCommon.cs
* SuperJoinStream.cs
* TableMetaDataStream.cs
* TextWriterStream.cs
* TimeAverageStream.cs
2025-11-19 13:57:47 -05:00
John Colvin
7418f5b5a1
style: Normalize indentation in PubsubHeartbeatStream.cs
2025-11-19 13:57:47 -05:00
John Colvin
b854390c85
chore: Add GetValue, TryGetValue ext fns to IBlueRow
2025-11-19 13:57:47 -05:00
John Colvin
a2f9359077
chore: Add 'Empty' fn for BlueTable/Schema (for convenience)
2025-11-19 13:57:47 -05:00
John Colvin
c2db246ce5
cleanup: Remove redundant code block in HistoricalBarsStream.cs
2025-11-19 13:57:47 -05:00
John Colvin
961f55388a
cleanup: Fix indentation and build warnings in TestStream.cs
2025-11-19 13:57:47 -05:00
John Colvin
360e80b3fe
cleanup: Make MDConsumer.on_security nonnull
...
It's always initialized in the constructor.
2025-11-19 13:57:47 -05:00
John Colvin
5096912fbf
refactor: Decouple ViewStreamDatabase from TableStream, ISubscriberCore
2025-11-19 13:57:44 -05:00
John Colvin
46e853a55f
check pt: PingPong algo
...
This is a work-in-progress; putting a pin in it for now to focus on
other priorities.
2025-11-19 13:55:44 -05:00
John Colvin
72adf58889
Add environment variable override for app data path
...
Historically, ~/sparkdata on linux, and ~/AppData/Roaming/bts on win.
Now that we may run multiple exes at once (api server, pubsub, sparkd, etc.),
we need to support multiple data dirs on the same host.
2025-11-19 13:55:43 -05:00
John Colvin
f334955acf
Drop ".exe" from log dir name on windows
2025-11-19 13:55:43 -05:00
John Colvin
d1ee1e2798
feat: Add SpreadBook stream
2025-11-19 13:55:43 -05:00
John Colvin
152ea18266
fix: Check settings Subject.IsDisposed before using
2025-11-19 13:55:43 -05:00
John Colvin
ed897c4969
ui (launcher): Move "X" button to left of report menu items
...
This is a more natural location. Also, it looked weird on the right because the
menu labels aren't fixed width, so the buttons weren't vertically aligned.
2025-11-19 13:55:43 -05:00
John Colvin
4397df4628
refactor: Use HostBuilder to launch spark w/ streams
2025-11-19 13:55:43 -05:00
John Colvin
92064bfb48
build: Update System.Composition pkg refs to 8.0.0
2025-11-19 13:55:43 -05:00
John Colvin
3c7f56b0c9
cleanup: Mark a few classes "internal" in Spark
2025-11-19 13:55:43 -05:00
John Colvin
cd121defc5
cleanup: Use consistent access modifier in TabDocument partial class
...
It should be marked internal in both xaml and xaml.cs (it was previously
only so in the latter).
2025-11-19 13:55:43 -05:00
John Colvin
ca9a6527ee
refactor: Consolidate ShellBootstrapper and base class into one
2025-11-19 13:55:43 -05:00
John Colvin
6cf1b02a75
feat: Add Stream Reports shell window
2025-11-19 13:55:43 -05:00
John Colvin
e7ee0e29cc
build: Define custom "main" (entry point) for Spark exe
...
This is a prelude to integrating streams into spark. The plan is to use
an ms HostBuilder to instantiate stream services/dependencies alongside
the spark Application object.
2025-11-19 13:55:43 -05:00
John Colvin
3e28003d80
cleanup: Get rid of stunnel code
...
This looks like it hasn't been hooked up for years...it would only start
if a stunnel.conf file was detected, which hasn't been around for a very
long time.
2025-11-19 13:55:42 -05:00
John Colvin
63f74222ad
fix: Only create mutex if spark app is NOT running in vs designer
...
I accidentally droped the '!' in a cleanup commit 4 years ago
2025-11-19 13:55:42 -05:00
John Colvin
2f73a79a6b
fix (dsqa): Resolve name conflicts with new BlueOrb streams
2025-11-19 13:55:42 -05:00
John Colvin
4f00d4a20c
fix: Fix typo in "DateTimeExpansionStream" type name
...
Previously, it was "DateTimeExpanstion" (erroneous "t")
2025-11-19 13:55:42 -05:00
John Colvin
8e4d6f9ae3
chore: Add CircularBuffer class (c#)
2025-11-19 13:55:42 -05:00
John Colvin
a2b3a4e05d
refactor: Rename ExceptionAssert.is_valid ExceptionAssert.Index.IsValid
...
Like the ExceptionAssert.Argument class that provides methods that throw
ArgumentException if a condition isn't satisfied, the ExceptionAssert.Index
class provides methods that throw IndexOutOfRange exceptions.
2025-11-19 13:55:42 -05:00
John Colvin
47dacc5d1a
chore: Add OffsetList class
...
This supports mutations (unlike the SubRangeWrapper class).
2025-11-19 13:55:42 -05:00
John Colvin
9e842fd453
cleanup: Remove "partial" class modifiers from OrderBook vm classes
...
They simply weren't necessary.
2025-11-19 13:55:42 -05:00
John Colvin
fd98be8f03
check pt: Proof of concept ladder left panel price point collection
2025-11-19 13:55:42 -05:00
John Colvin
43388affc3
ui: Adjust ladder ticks-per-row with ctrl+shift+mousewheel
2025-11-19 13:55:42 -05:00
John Colvin
78138eff26
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2025-11-19 13:55:41 -05:00
John Colvin
f7c9ee7f6a
Reduce log noise in AsyncTCPConnection_AsyncWrapper
2025-11-19 13:55:41 -05:00
John Colvin
054b819eb9
TEMP changes to appsettings.json (at least i should review them before making permanent)
2025-11-19 13:55:41 -05:00
John Colvin
8787c6752b
Add ColumnIndex class to resolve column names to indices
...
Improves performance compared to accessing columns by name
2025-11-19 13:55:41 -05:00
John Colvin
5cd390d78a
Increase SQLiteEnumerator page size to 65536
...
This performs better, and doesn't seem to be too large in practice
2025-11-19 13:55:41 -05:00
John Colvin
8804dbe093
Serialize TimeSpan w/ microsecond precision in DataPacket json
2025-11-19 13:55:41 -05:00
John Colvin
fd24abc085
Format DateTimes w/ microsecond precision in DataPacketJsonConverter
2025-11-19 13:55:41 -05:00
John Colvin
dce7e73d84
Add BlueColumnTable for pandas integration
...
This will make it easier/more natural to support pandas column expressions
2025-11-19 13:55:41 -05:00
John Colvin
6bb142f51f
Add c# Variant class, modeled after std::variant in c++
2025-11-19 13:55:41 -05:00
John Colvin
b7df16ffd7
refactor: Rename snake_case fns PascalCase
2025-11-19 13:55:41 -05:00
John Colvin
63aaeae401
refactor: Use dependency injection in DSQA
2025-11-19 13:55:08 -05:00
John Colvin
ea0a1fbcd3
refactor: Load IDataStreamFactory(s) with dependency injection
...
So we can create ViewStreams that depend on other services, config, etc.
Previously, the PrimitiveManager relied purely on static construction of
types through reflection.
2025-11-19 13:53:18 -05:00
John Colvin
7566b2560f
refactor: Change namespace to Bts.DataStreamCore for a few types
...
Since they're in the DataStreamCore csproj
2025-11-19 13:29:16 -05:00