Mohammad Arham
a19e8a7315
change: changes to make taifex work
2024-08-27 07:45:59 -04:00
John Colvin
cf189ecf81
refactor: Start cboe and taifex md 'start_databento'
...
Similar to how we start all ccapi implemented exchanges in "_start_cc"
(in MarketDataGateway)
2024-08-26 19:13:59 +00:00
John Colvin
4405b7adcb
refactor: Rename cc_md_listeners -> venue_listeners
...
They are general purpose, not specific to ccapi.
2024-08-26 19:09:57 +00:00
John Colvin
e51ee7b7b9
refactor: Wrap IDGenerator and IMarketDataListeners in shared_ptrs
...
Our various market data providers (ccapi, emumba, replay, onixs)
dereference pointers to common instances of these types concurrently on
different threads. Although we've correctly managed memory ownership
thus far, we really should be using smart pointers (this is why they
were made).
2024-08-26 19:03:29 +00:00
John Colvin
dfaa74f426
build: Add databento dep via FetchContent
...
Now we actually build libdatabento in the devcontainer along with our
code (as we do with the vcpkg deps, though this is not part of vcpkg)
2024-08-26 17:13:51 +00:00
Mohammad Arham
1d2ce59009
add: added taifex entries
2024-08-22 23:13:05 +00:00
Adeel Khan
3602cc05bb
added: TaifexDataHandler, temp
2024-08-23 02:06:47 +05:00
Adeel Khan
ac88a81ac6
Security Extensions
2024-08-23 01:42:24 +05:00
Adeel Khan
01fa8e0c63
added: files for Taifex, Cboe
2024-08-23 00:57:40 +05:00
John Colvin
59547e0f37
fix build: Lock fmt version to 10.2.1 in vcpkg
...
This fixes the front-end (Windows) libspark build
2024-08-21 13:45:43 -04:00
John Colvin
3ce100a9cf
build: Add databento to sparkd
...
* Install databento deps in docker
- libzstd-dev
* Add databento cmake module to externals
2024-08-21 13:49:53 +00:00
John Colvin
6513fb0cd5
cleanup: Remove unused include 'date.h' from MDSource
...
This was an external header, and may interfere with a dependency in the
databento lib (which we are about to add).
2024-08-21 13:49:24 +00:00
Taha Afzal
fd0fb1f760
Adding incremental book updates to IMarketDataListener
2024-08-12 22:49:27 -04:00
Taha
5cf7eacd82
Fixing the extra .0 in the default pubsub server routeplusfixing acorner cae issue of gettign a fast streaming data cakback after an unsubscribe
2024-06-24 00:28:07 -04:00
John Colvin
087d8ab8c9
Set text=auto in gitattributes
...
Otherwise git can cause files to show as "permanently modified" when you
apply changes from the index (e.g., by running 'git rebase', or 'git
stash pop')
2024-06-11 17:39:12 +00:00
John Colvin
b69b7b3350
vscode: Use '\' dir separator in show_last_run.cmd
...
This script only runs on Windows
2024-06-08 15:08:25 -05:00
John Colvin
5620f33524
vscode: Add task to view logs for last PubSubServer run
2024-06-08 14:42:13 +00:00
John Colvin
f3e33fa390
vscode: Add task to run PubSubServer without building
2024-06-07 16:41:42 +00:00
John Colvin
3b631e0d5f
Fix a couple more typos in logs
2024-06-07 16:35:06 +00:00
John Colvin
f93d28ee76
vscode: Add task to view logs for last DSQA run
2024-06-07 11:34:36 -05:00
John Colvin
23d7d3775d
cleanup: Delete unused files
2024-06-07 10:40:34 -05:00
John Colvin
4940771166
fix: Don't login to sparkd from DSQA
2024-06-07 10:02:42 -05:00
John Colvin
c1967a8f6a
vscode: Add tasks to edit Spark, DataStream config
2024-06-06 11:12:56 -05:00
John Colvin
8c797ee76b
Fix typo in log msg
2024-06-06 09:21:01 -05:00
John Colvin
ce80957d07
DSQA shouldn't connect to sparkd by default
2024-06-06 09:21:01 -05:00
John Colvin
c60018b59e
DataStreamPublisher shouldn't connect to sparkd by default
...
It only needs to connect to sparkd if it's publishing market data
2024-06-06 09:21:01 -05:00
John Colvin
3a27af87d1
PubSubServer shouldn't download config from sparkd by default
...
As far as I know, it only needs spark/protobuf config to initialize the
c++ logging system. Eventually, we should get rid of that dependency and
use builtin Microsoft Logging facilities for c# instead. In the
meantime, PubSubServer will load config from local files by default
(i.e., spark.conf).
2024-06-06 09:21:01 -05:00
John Colvin
068c1c6973
cleanup: Remove erroneous comment
2024-06-06 09:21:01 -05:00
John Colvin
645a58c97d
vscode: Add launch.json
2024-06-06 09:21:01 -05:00
John Colvin
b7f455b29a
vscode: Remove launch/tasks.json from gitignore
2024-06-06 09:21:00 -05:00
John Colvin
4a2735839e
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
d2e9fe8237
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
cfc60766d8
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
b03fec7f79
Change line endings to crlf in a few cs files
2024-06-06 09:20:59 -05:00
John Colvin
fb8e7c5b81
Ensure crlf line endings for cs files
2024-06-06 09:20:05 -05:00
John Colvin
e44601d1b1
fix merge: Bring back few fns that SchemaGuesserStream needs
...
* BlueDataUtility.get_typed_schema
* BlueDataUtility.get_typed_table
2024-06-06 09:20:05 -05:00
Taha
07bade53c0
Fixing AsyncTCPCOnnection_APM's double partial messages for messages > 100 MB
2024-06-06 09:20:05 -05:00
Taha
fac0a9c25b
RemoteQueryStream
2024-06-06 09:20:05 -05:00
John Colvin
1d1de3dd18
Ensure proper line endings for sh, cmd scripts
...
Via new gitattributes file
2024-06-06 09:20:05 -05:00
John Colvin
cfcbf004ba
vscode: Use consistent naming conventions in tasks.json
2024-06-06 09:20:05 -05:00
John Colvin
78c7dadbbe
vscode: Add parameterless task variants
...
This allows us to build as a 'preLaunchTask' when debugging (without
requiring users to redundantly specify 'Debug' as the build type).
2024-06-06 09:20:01 -05:00
John Colvin
7b5a6031af
build: Use consistent naming conventions in CMake presets
...
We'll use similar naming conventions for our (vscode) tasks
2024-06-06 09:15:17 -05:00
John Colvin
c13a7782c8
build: Name sparkd binary dirs after cmake preset
...
All other builds follow this pattern. Given the fact that we have so
many different builds now (spark, sparkd, data-streams, api-server,
etc.), it behooves us to adopt consistent naming conventions.
2024-06-06 09:15:17 -05:00
John Colvin
45f02391d1
cleanup: Remove sparkd login creds from PubSubServerConfig
...
It only needs a Sparkd url to download logging config. TBH, we can probably
get rid of that too, and simply read the local spark.conf.
2024-06-06 09:15:17 -05:00
John Colvin
a3ca06addc
Reduce 'internal_publish' log level to Diag
...
It was a bit noisy for the Info level
2024-06-06 09:15:17 -05:00
John Colvin
32869e54ec
fix: Fix typos in c# Logs
...
Prefix a few msgs with '$' so vars in curly braces are expanded via
interpolation
2024-06-06 09:15:17 -05:00
John Colvin
ca73220a2e
Add new PubSub cfg to DSQA
...
At least the server address (port) needs to be exposed
2024-06-06 09:15:17 -05:00
John Colvin
9fc3c2618e
cleanup: Remove unnecessary reference to SharedStreams
...
From DataStreamPublisher
2024-06-06 09:15:17 -05:00
John Colvin
e72e0c0a30
fix: Make PubSubServer actually use sparkd url in config
2024-06-06 09:15:17 -05:00
John Colvin
a5bfc75278
cleanup: Fix a few nullability warnings in DSQA
2024-06-06 09:15:17 -05:00