John Colvin
51d934de27
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-11-25 15:26:57 +00:00
John Colvin
23e47f1749
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-11-25 15:26:57 +00:00
John Colvin
a5a905e20f
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-11-25 15:26:57 +00:00
John Colvin
1cecbe9276
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-11-25 15:26:57 +00:00
John Colvin
edfc1fc0d7
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-11-25 15:26:57 +00:00
John Colvin
cb43af0dd4
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-11-25 15:26:57 +00:00
John Colvin
70616d4a09
fix: Dispose market data sub in various md streams
2024-11-25 15:26:57 +00:00
John Colvin
6ec15d34a7
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-11-25 15:26:57 +00:00
John Colvin
48b3852e6f
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-11-25 15:26:57 +00:00
John Colvin
595656f298
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-11-25 15:26:57 +00:00
John Colvin
951d68e20c
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-25 15:26:57 +00:00
John Colvin
d937054f6f
Fix typo in log msg
2024-11-25 15:26:57 +00:00
John Colvin
9cc0108a01
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-25 15:26:57 +00:00
John Colvin
6c1d1a43f5
Add spark service modules designed for Dependency Injection
2024-11-25 15:26:57 +00:00
John Colvin
d96b6da139
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-25 15:26:57 +00:00
John Colvin
295300e7fa
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-25 15:26:57 +00:00
John Colvin
b35b9170e4
fix build (api server): Change namespace to bts.websocket_core
2024-11-25 15:26:57 +00:00
John Colvin
68fe50f7e2
fix build (warn): Only use Registry on windows
2024-11-25 15:26:57 +00:00
John Colvin
7ebafd8246
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-11-25 15:26:57 +00:00
John Colvin
8f2e37d644
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-11-25 15:26:57 +00:00
John Colvin
426b0daf61
cleanup: Modernize PubSubRoute code, json parsing
2024-11-25 15:26:56 +00:00
John Colvin
5d71d7f01b
cleanup: Remove unused DateTime grammar from exp parser
2024-11-25 15:26:56 +00:00
John Colvin
1fa1dfa01e
Add JsonRpcRequestObservable, AsyncEnumerable
2024-11-25 15:26:56 +00:00
John Colvin
ec28e12a6f
Add json facilities for DataStream websocket api
2024-11-25 15:26:56 +00:00
John Colvin
84b7e74bb6
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-11-25 15:26:56 +00:00
John Colvin
64ffd3050f
feat: Add JsonRpc types for websocket paradigm
2024-11-25 15:26:56 +00:00
John Colvin
1f2f7dda09
cleanup: Remove empty file (clearly added by accident)
2024-11-25 15:26:56 +00:00
John Colvin
60de12277b
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-11-25 15:26:56 +00:00
John Colvin
00ce3cdf37
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-11-25 15:26:56 +00:00
John Colvin
fbdb4f112d
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-11-25 15:26:56 +00:00
John Colvin
2f9f20de06
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-11-25 15:26:56 +00:00
John Colvin
c7b5b5df54
refactor: Remove nullability constraint in GetValueOrDefault
2024-11-25 15:26:56 +00:00
John Colvin
9342613501
refactor: Use events to avoid circular deps for ws sync/gateway
2024-11-25 15:26:56 +00:00
Mohammad Arham
0e893b9b5d
Fix: Multiple Exchange data sources work without timee
2024-11-20 23:48:50 +00:00
Mohammad Arham
0593ae0320
Fix: Logging path was incorrect
2024-11-20 23:48:24 +00:00
Mohammad Arham
960149b9c5
Fix: Stupid bug on sleep time
2024-11-20 22:49:22 +00:00
Mohammad Arham
b5f5f2f3d5
Merge branch 'development' of bitbucket.org:bluetradesys/spark into development
2024-11-20 17:21:45 -05:00
John Colvin
bd8c97244a
refactor: Return row id in IStore::retrieve_one
...
This is a prerequisite to synchronizing security ids stored via IDGenerator
(the "new" way to store ids, added when we implemented Deribit), and
SecurityDB (the original way from spark days). The problem was that these
2 implementations were using separate databases. We need to unify the
interfaces between these storage services to avoid breaking existing code.
2024-11-20 22:17:08 +00:00
John Colvin
cb187e6997
Interpret db strng param as name or path in SqliteStore ctr
2024-11-20 22:17:08 +00:00
John Colvin
4004ed2267
refactor: Normalize sec key indexing for old md sources
...
Now both old and new (domain) md sources index securities by
the same string format.
2024-11-20 22:17:08 +00:00
John Colvin
a00347ac3f
Add ostream operator for Venue
2024-11-20 22:17:08 +00:00
John Colvin
c4d08840bd
Add ostream operator for SecurityType
2024-11-20 22:17:08 +00:00
John Colvin
84c0684b63
refactor: Normalize sec key indexing for new (domain) md sources
...
This is part of a larger effort to unify the way we index securities in order
to generate unique ids. Older md sources (e.g., MDP3Listener) use
SecurityIDRecorder to generate ids, which uses a different database and
different key-string formatting than the IDGenerator used by the newer md
sources (e.g., GeneralMarketDataListener and various ccapi-based sources).
2024-11-20 22:17:08 +00:00
Mohammad Arham
bca8df6d99
Fix: Release Crash fixed still has timer
2024-11-20 22:14:48 +00:00
Mohammad Arham
98f8e58f3f
Add optional tags to config
2024-11-20 22:12:06 +00:00
Mohammad Arham
76f18f3443
Fix: typo in fixed securities
2024-11-20 20:17:29 +00:00
Mohammad Arham
b67d748ba1
removed: moved onix glbx to main controler thread
2024-11-20 06:58:14 +00:00
Mohammad Arham
0113721355
Add: Config for marex reconnect attemps
2024-11-20 06:29:41 +00:00
Mohammad Arham
715f7f7c70
Fix: Race condition causes crash not sure if fixed
2024-11-20 06:17:28 +00:00
Mohammad Arham
89955597c1
Add: Onix/Marex fix adapter, listener, and state handler
2024-11-20 06:16:58 +00:00