2021-04-10 20:13:35 +02:00
|
|
|
# Exec Sum
|
|
|
|
|
|
|
|
# Thanks and acknowledgements
|
|
|
|
|
2021-07-13 20:11:20 +02:00
|
|
|
First off, I would like to thank Jelle Wissink, an engineer from the Global
|
|
|
|
Execution team at IMC. As my mentor, he helped me get acquainted with the
|
|
|
|
technologies used at IMC, guided my explorations of the problems I tackled, and
|
|
|
|
was of great help to solve problems I encountered during my internship. I would
|
|
|
|
also like to thank Erdinc Sevim, the lead of the Global Execution team, for the
|
|
|
|
instructive presentations about trading and IMC's software architecture.
|
|
|
|
|
|
|
|
I would also like to thank:
|
|
|
|
|
|
|
|
* Laurent Xu, engineer at IMC: he was the first to tell me about the company,
|
|
|
|
and referred me for an interview. He also welcomed me to Amsterdam and
|
|
|
|
introduced me to other French colleagues.
|
|
|
|
|
|
|
|
* Étienne Renault, a researcher at EPITA's LRDE: he is in charge of the Tiger
|
|
|
|
Compiler project, and taught the ALGOREP (Distributed Algorithm) class during
|
|
|
|
the course of my major. He is one of the most interesting teachers I have met,
|
|
|
|
his classes have always been a joy to attend. I'm glad to have gotten to know
|
|
|
|
him through the Tiger maintainer team.
|
|
|
|
|
|
|
|
* Élodie Puybareau and Guillaume Tochon, researchers at EPITA's LRDE, and head
|
|
|
|
teachers of the IMAGE major. They are great teachers, very involved, and always
|
|
|
|
listening to student feedbacks. They have handled the COVID crisis admirably,
|
|
|
|
taking into account the safety of their students and the work load imposed upon
|
|
|
|
them.
|
|
|
|
|
|
|
|
* The YAKA & ACU teams, a.k.a. the Teaching Assistant teams for EPITA's first
|
|
|
|
year of the engineering cycle: being a TA was a great source of learning for me.
|
|
|
|
It was one of the most fun and memorable experiences I had at the school.
|
|
|
|
|
|
|
|
Finally, I would like to thank my parents who have always been there for me,
|
|
|
|
and my girlfriend Sarah for her unwavering support.
|
|
|
|
|
2021-04-10 20:13:35 +02:00
|
|
|
# Introduction
|
|
|
|
|
|
|
|
# Subject
|
|
|
|
|
2021-04-10 20:19:55 +02:00
|
|
|
The first description of my internship project was given to me as:
|
|
|
|
|
|
|
|
> The project is about benchmarking a new service we're building related to
|
|
|
|
> exchange connectivity. It would involve writing a program to generate load on
|
|
|
|
> the new service, preparing a test environment and analyzing the performance
|
|
|
|
> results. Time permitting might also involve making performance improvements to
|
|
|
|
> the services.
|
|
|
|
|
|
|
|
To understand this subject, we must start with an explanation of what exchange
|
|
|
|
connectivity means at IMC: it is the layer in IMC's architecture that ensures
|
|
|
|
the connection between internal trading services and external exchanges' own
|
|
|
|
infrastructure and services. It is at this layer that exchange-specific
|
|
|
|
protocols are normalised into IMC's own protocol messages, and vice versa.
|
|
|
|
|
|
|
|
Here is the list of tasks that I am expected to have accomplished during this
|
|
|
|
internship:
|
|
|
|
|
|
|
|
* become familiar with the service,
|
|
|
|
* write a dummy load generator,
|
|
|
|
* benchmark the system under the load,
|
|
|
|
* analyze the measurements.
|
|
|
|
|
|
|
|
This kind of project is exactly the reason that I was interested in working in
|
|
|
|
finance and trading. It is a field that is focused on achieving the highest
|
|
|
|
performance possible, because being faster is directly tied with making more
|
|
|
|
trades and results in more profits.
|
|
|
|
|
|
|
|
Because I expressed this personal interest for working on high performance
|
|
|
|
systems and related subjects, I was given this internship project to work on.
|
|
|
|
|
2021-04-10 20:13:35 +02:00
|
|
|
# Context of the subject
|
|
|
|
|
2021-07-13 20:56:37 +02:00
|
|
|
## Company trade
|
|
|
|
|
|
|
|
IMC, as its name suggests, is a market maker. It is specialised in providing
|
|
|
|
liquidity in the market by quoting both sides of the market, and profit off the
|
|
|
|
trades they make while providing this service.
|
|
|
|
|
|
|
|
One key ingredient to this business is latency: due to the competitive nature of
|
|
|
|
the market, we must process the incoming data and execute orders fast enough not
|
|
|
|
to get *picked off the market* with a bad position.
|
|
|
|
|
|
|
|
## Service
|
|
|
|
|
2021-04-10 20:20:57 +02:00
|
|
|
The exchange connectivity layer must route orders as fast possible, to stay
|
|
|
|
competitive, reduce transaction costs, and lower latencies which could result in
|
|
|
|
lost opportunities, therefore less profits.
|
|
|
|
|
|
|
|
It must also take on other duties, due to it being closer to the exchange than
|
|
|
|
the rest of the infrastructure. For example, a trading strategy can register
|
|
|
|
conditional orders with this service: it must monitor the price of product A and
|
|
|
|
X, if product A's cost rise over X's, then it must start selling product B at
|
|
|
|
price Y.
|
|
|
|
|
2021-07-13 20:56:37 +02:00
|
|
|
## The competition
|
|
|
|
|
|
|
|
FIXME: what can I even say about them?
|
|
|
|
|
|
|
|
## Strategy
|
|
|
|
|
2021-04-10 20:20:57 +02:00
|
|
|
A new exchange connectivity service, called the Execution Gateway, is being
|
|
|
|
built at IMC, the eventual goal being to migrate all trading strategies to using
|
|
|
|
this gateway to send orders to exchanges. This will allow it to be scaled more
|
|
|
|
appropriately. However, care must be taken to maintain the current performance
|
|
|
|
during the entirety of the migration in order to stay competitive, and the only
|
|
|
|
way to ensure this is to measure it.
|
|
|
|
|
2021-07-13 20:56:37 +02:00
|
|
|
## Roadmap
|
|
|
|
|
2021-04-10 20:20:57 +02:00
|
|
|
With that context, let's review my expected tasks once more, and expand on each
|
2021-07-13 20:56:37 +02:00
|
|
|
of them to get the roadmap:
|
|
|
|
|
|
|
|
* Become familiar with the service: before writing the code for the benchmark I
|
|
|
|
must first understand what goes into the process of a trade at IMC, what is
|
|
|
|
needed from the gateway and from the clients in order to run them and execute
|
|
|
|
orders. There is a lot of code at IMC: having different teams working at the
|
|
|
|
same time on different trading service results in a lot of churn. The global
|
|
|
|
execution team was created to centralise the work on core services that must be
|
|
|
|
provided to the rest of the IMC workforce. The global execution gateway is one
|
|
|
|
such project, aiming to consolidate all trading strategies under one singular
|
|
|
|
method to send orders to their exchanges.
|
|
|
|
|
2021-04-10 20:20:57 +02:00
|
|
|
* Write a dummy load generator: we want to send orders under different
|
2021-07-13 20:56:37 +02:00
|
|
|
conditions in order to run multiple scenarios which can model varying cases of
|
|
|
|
execution. Having more data for varying corner cases can make us more confident
|
|
|
|
of the robustness and efficiency of the service. This is especially needed
|
|
|
|
becaue of the various roles that the gateway must fulfill: not only must it act
|
|
|
|
as a bridge for the communication between exchanges and traders, but also as an
|
|
|
|
order executor. All those cases must be accounted for when writing the different
|
|
|
|
scenarios.
|
|
|
|
|
2021-04-10 20:20:57 +02:00
|
|
|
* Benchmark the system under the load: once we can run those scenarios smoothly
|
2021-07-13 20:56:37 +02:00
|
|
|
we can start taking multiple measurements. The main one that IMC is interested
|
|
|
|
in is wall-to-wall latency (abbreviated W2W): the time it takes for a trade to
|
|
|
|
go from a trading strategy to an exchange. The lower this time, the more
|
|
|
|
occasions there are to make good trades. FIXME: probably more context in my
|
|
|
|
notes
|
|
|
|
|
2021-04-10 20:20:57 +02:00
|
|
|
* Analyze the measurements: the global execution team has some initial
|
2021-07-13 20:56:37 +02:00
|
|
|
expectations of the gateway's performance. A divergence on that part could mean
|
|
|
|
that the measurements are flawed in some way, or that the gateway is not
|
|
|
|
performing as expected. Further analysis can be done to look at the difference
|
|
|
|
between mean execution time and the 99th percentile, and analyse the tail of the
|
|
|
|
timing distribution: the smaller it is the better. Consistent timing is more
|
|
|
|
important than a lower average, because we must be absolutely confident that a
|
|
|
|
trade order is going to be executed smoothly, and introducing inconsistent
|
|
|
|
latency can result in bad trades.
|
|
|
|
|
|
|
|
## Internship positioning amongst company works
|
|
|
|
|
|
|
|
My work was focused on providing a framework to instrument gateways under
|
|
|
|
different scenarios.
|
|
|
|
|
|
|
|
Once that framework is built, to be effective it must be integrated in the
|
|
|
|
existing Continuous Integration platform used at IMC. This enables us to track
|
|
|
|
breaking changes and, eventually, be notified of performance regressions.
|
|
|
|
That last part is yet to be done, needing to be integrated with the new change
|
|
|
|
point detection tool currently being developed internally. Once that is done, we
|
|
|
|
can feed the performance results to automatically see when a regression has been
|
|
|
|
introduced into the system.
|
|
|
|
|
|
|
|
With the knowledge I gained working on this project, my next task was to add
|
|
|
|
compatibility testing to ensure backward and forward compatibility of the
|
|
|
|
clients and gateways. This meant having to run the existing tests using the
|
|
|
|
actual production binaries of the gateway, and making sure the tests keep
|
|
|
|
working across versions. This is very similar to the way the benchmarks work,
|
|
|
|
and I could reuse most of the tools developed for the framework to that end.
|
2021-04-10 20:20:57 +02:00
|
|
|
|
2021-04-10 20:13:35 +02:00
|
|
|
# Internship roadmap
|
|
|
|
|
2021-04-10 20:21:08 +02:00
|
|
|
The first month was dedicated to familiarizing myself with the vocabulary at
|
|
|
|
IMC, understanding the context surrounding the team I am working in, and
|
|
|
|
learning about the different services that are currently being used in their
|
|
|
|
infrastructure. I had to write a first proof of concept to investigate what, if
|
|
|
|
any, dependencies would be needed to execute the gateway as a stand-alone system
|
|
|
|
for the benchmark. This has allowed me to get acquainted with their development
|
|
|
|
process.
|
|
|
|
|
|
|
|
After writing that proof of concept, we were now certain that the benchmark was
|
|
|
|
a feasible project, with very few actual dependencies to be run: the only one
|
|
|
|
that we needed to be concerned with it called the RDS server. The RDS server
|
|
|
|
is responsible for holding the information about all trade-able instruments at
|
|
|
|
an exchange. The gateway connects to it to receive a snapshot of the state of
|
|
|
|
those instruments, for example the mapping from IMC IDs to the ones used by the
|
|
|
|
exchange. I wrote a small module that could be used as a fake RDS server by the
|
|
|
|
benchmark framework to provide its inputs to the gateway being instrumented.
|
|
|
|
|
|
|
|
I am now currently beginning to write the benchmark framework, using what
|
|
|
|
I wrote and learned during the previous month.
|
|
|
|
|
2021-04-10 20:13:35 +02:00
|
|
|
# Engineering practices
|
|
|
|
|
2021-07-13 20:56:37 +02:00
|
|
|
Problematic: development of a benchmark framework
|
|
|
|
|
2021-04-10 20:13:35 +02:00
|
|
|
# Illustrated analysis of acquired skills
|
|
|
|
|
|
|
|
# Added value
|
|
|
|
|
|
|
|
# Conclusion
|
|
|
|
|
2021-07-15 19:50:19 +02:00
|
|
|
## Education and career objectives
|
|
|
|
|
|
|
|
I chose to major in Image Processing and Image Synthesis for multiple reasons,
|
|
|
|
most notably I had an interest in high performance programming, and thought that
|
|
|
|
this major would yield well to it. This proved to be true, although more so due
|
|
|
|
to applying it to the projects that we were given rather than the courses we
|
|
|
|
were taught (except for a few which specifically focused on it).
|
|
|
|
|
|
|
|
Through watching conference presentations, I learned about the field of finance
|
|
|
|
and thought it would provide interesting challenges that aligned with my
|
|
|
|
interests. This motivated my choice to intern at IMC, even though their business
|
|
|
|
is far removed from the core teachings of my major. This too, proved to be true,
|
|
|
|
and I'm glad to see my initial hunch panning out the way it did.
|
|
|
|
|
|
|
|
## Improving the major
|
|
|
|
|
|
|
|
Having more focus on measuring results and performances of our projects would be
|
|
|
|
an interesting idea, to put it into context for the major, the need for real
|
|
|
|
time image analysis and other such constraints means that having the skills to
|
|
|
|
measure and improve our code can be a necessary part of working in the industry.
|
|
|
|
|
|
|
|
The one class that stands out to me as having this issue front and center is the
|
|
|
|
GPGPU course, introducing us to massively parallel programming on a graphics
|
|
|
|
card. However, we were mostly left to our own devices to figure out effective
|
|
|
|
ways to measure, and analyse those results. Providing more guidance would be a
|
|
|
|
productive endeavor, ensuring that the students have been provided with the
|
|
|
|
correct tool set to deal with those problems.
|
|
|
|
|
|
|
|
## Introspection
|
|
|
|
|
|
|
|
Working abroad, with the additional COVID restrictions, is a harsh (FIXME: find
|
|
|
|
softer term) transition from the routine of school. However, both the company
|
|
|
|
and the team have made it easy to adjust.
|
|
|
|
|
|
|
|
* The daily stand-up meeting, and weekly retrospective seem more important than
|
|
|
|
ever when you can potentially not talk to your colleagues for days due to
|
|
|
|
working-from-home.
|
|
|
|
|
|
|
|
* IMC is very pro-active in organising regular events for their employees. This
|
|
|
|
is a great way to feel more engaged during such a period. They also organised a
|
|
|
|
week of training once the other interns had joined, which created a broader
|
|
|
|
network of relationships in a foreign city.
|
|
|
|
|
|
|
|
* My mentor encouraged me to ask as many questions as I could when I first
|
|
|
|
started my internship, and I assisted to some presentations which gave
|
|
|
|
additional context about the work being done by the team. This was helpful in
|
|
|
|
getting over the fact of feeling overwhelmed when first getting acquainted with
|
|
|
|
the code and technology being developed and used.
|
|
|
|
|
|
|
|
* The gradual transition to return to office, allowing me to arrange one day a
|
|
|
|
week to work next to my mentor, lead to more one-on-one interaction which feel
|
|
|
|
more productive than the usual textual interactions.
|
|
|
|
|
|
|
|
## Career evolution
|
|
|
|
|
|
|
|
This internship was everything I expected and more. The people are great, the
|
|
|
|
company is thriving, the work environment outstanding.
|
|
|
|
|
|
|
|
The *fintech* sector is full of interesting problems to me. I loved learning
|
|
|
|
about the basic theory of trading, what constitutes the basis for our
|
|
|
|
algorithms' decisions. I had a great deal of enjoyment working on my projects
|
|
|
|
during the internship, despite the few moments of frustration that come from
|
|
|
|
working on a distributed system.
|
|
|
|
|
|
|
|
Working at IMC, you are surrounded by smart and hard-working engineers, and
|
|
|
|
encouraged to interact with everybody to spread knowledge. Their focus on
|
|
|
|
continual improvement means that you are always learning and making yourself
|
|
|
|
better. Furthermore, they take good care of their employees, the mood is that of
|
|
|
|
a focused, casual, and playful atmosphere.
|
|
|
|
All in all, I think that IMC is great place to work at, there are few companies
|
|
|
|
like it. This will have an impact in how I rate potential future employers, as I
|
|
|
|
expect few places to be as well-rounded as IMC.
|
|
|
|
|
2021-04-10 20:13:35 +02:00
|
|
|
# Appendix
|
|
|
|
|
|
|
|
## About IMC
|
|
|
|
|
2021-04-10 20:38:40 +02:00
|
|
|
International Marketmakers Combinations (IMC) was founded in 1989 in Amsterdam,
|
|
|
|
by two traders working on the floor of the Amsterdam Equity Options Exchange. At
|
|
|
|
the time trading was executed on the exchange floor by traders manually
|
|
|
|
calculating the price to buy or sell. IMC was ahead of its time, being among the
|
|
|
|
first to understand the important role that technology and innovation will play
|
|
|
|
in the evolution of market making. This innovative culture still drives IMC 30
|
|
|
|
years later.
|
|
|
|
|
|
|
|
Since then, they've expanded to multiple continents, with offices operating in
|
|
|
|
Chicago, Amsterdam, and Sydney. Its key insight for trading is based on data and
|
|
|
|
algorithms, it makes use of its execution platform to provide liquidity to
|
|
|
|
financial markets globally.
|
|
|
|
|
2021-04-10 20:13:35 +02:00
|
|
|
## Results & Comments
|