John Colvin
76fa35382e
refactor: Add DataStream service modules for Dependency Injection
...
Namely, in DataStreamPublisher and PubSubServer. This is part of a broader
paradigm shift towards Dependency Injection and Factory Pattern.
https://learn.microsoft.com/en-us/dotnet/core/extensions/dependency-injection-guidelines
* Use interfaces to decouple services:
- Decouple ManagedSubscriber from ISubscriberCore impl
- Decouple PubTableBroker from IPublisherCore impl
- Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
* Model config profiles after dotnet appsettings
- Rename Configurations/<name>.json -> appsettings.<name>.json
- Make json fields match corresponding csharp props verbatim
* The Dependency Injection framework doesn't support JsonPropertyName
attributes. Config class props must match json fields verbatim.
* Move reusable startup code into new Bts.Extensions.Hosting proj
* Add pubsub and md-publisher services to compose.yaml
2026-01-04 21:08:11 +00:00
John Colvin
3a6141f3ae
refactor: Change Configuration.initialize to be async
...
Tweak SparkCoreServices to synchronize Configuration.init globally
2025-12-30 11:42:20 -05:00
Taha
31df1a3827
Added benzinga streamd to MDPub's test config
2024-07-17 14:32:57 -04:00
Taha Afzal
672ad6d237
Cleaning Config 1.0 (not completely done)
2024-06-30 23:17:20 -04:00
Taha
151816bf5e
PubSuMessageReactor empties the message queue (instead oif one elem ata a time) in the main loop
2024-06-24 02:29:28 -04:00
John Colvin
b03fec7f79
Change line endings to crlf in a few cs files
2024-06-06 09:20:59 -05:00
Taha
fac0a9c25b
RemoteQueryStream
2024-06-06 09:20:05 -05:00
John Colvin
c99d5fe24c
Add support for core PubSub config via json
2024-06-06 09:15:16 -05:00
John Colvin
6240d89a08
Map PubSubServerConfig json to historic PubSub3Config
2024-06-03 13:46:51 +00:00
John Colvin
7ee6933789
refactor: Add formal config classes for prepublish streams
...
They can be passed to command line via --config <json_file>
2024-06-03 13:46:51 +00:00
John Colvin
306c572b53
improvement: Polish clis in DataStreamSuite
...
Specifically PubSubServer, DataStreamPublisher and DSQA
* Use CommandLineParser (nuget pkg)
* Clean up csproj files a bit while we're at it
2024-06-03 13:46:51 +00:00
Taha Afzal
4510e120ab
enabling some streams like max, that were dependent on AddCOlumns (thta John fixed in the last commit)
2024-02-12 13:21:28 -05:00
Taha Afzal
8c1342230b
RowDiff added
2024-02-08 14:11:10 -05:00
Taha Afzal
cc3e289345
KeyValueToRelationalStream added
2024-01-16 19:08:40 -05:00
Taha Afzal
8cbbbc6da3
Merging
2024-01-13 23:45:51 -05:00
Taha Afzal
d50e8cda50
Adding AsyncTCPConnectionAcceptor_APM and AsyncTCPConnector_APM to create ITCPConnection
2024-01-11 16:10:51 -05:00
Taha Afzal
694f8b8d11
AsyncTCPConnection_APM works now
2024-01-09 14:34:15 -05:00
Taha Afzal
5b4b41d4eb
Adding MongoDB astream integration
2024-01-02 00:44:52 -05:00
Taha Afzal
1ceea4af5a
Changing TCPUtils to use SocketAsyncEventArgs instead of TAP functions, simple client<->server works with echoing messages
2023-12-20 11:32:53 -05:00
Taha
88bf04e5f1
TimeSeries and TimeBucketStreams, Stream offloading etc
2023-10-23 14:18:31 -04:00
Taha
33030b1212
Market data streams work now
2023-10-16 00:01:29 -04:00
Taha
140c0c4152
MDStream uses MarketDataClient instead of MDConsumer now
2023-10-03 18:35:23 -04:00
Taha
af9dd0c1fe
PubSub Streams to get list of tags etc
2023-10-02 19:38:38 -04:00
Taha
f8c9148609
Adding tests
2023-09-30 12:59:02 -04:00
Taha
fa4da63c24
Streams can be published across PubSub now
2023-09-30 12:59:02 -04:00
Taha
7bb7f1a5e2
PubSub is working now
2023-09-30 12:53:51 -04:00
John Colvin
9fdffdc648
chore: Remove redundant init calls
2023-09-21 23:48:57 -04:00
Taha
797816be7e
Merging changes
2023-09-04 16:25:40 -04:00
John Colvin
431dad7551
fix: Init logging/config in DataStreamPublisher entry pt
2023-09-03 14:16:33 -04:00
John Colvin
ecbae62d07
feat: Add bones for DataStreamSuite
...
TODO (Taha): Migrate source files from edge
2023-08-22 15:04:08 -04:00