Australian (ASX) Stock Market Forum

Has anyone setup Amazon Web Services (AWS) to host their trading environment?

Jump to new
Linus van Pelt

Linus van Pelt

Joined
28 May 2020
Posts
127
Reactions
229
Hi,

Has anyone setup AWS to host their trading environment?


I'm starting to run optimizations that surpass the capability of my (fairly beefy) laptop. So I need to decide whether to buy a really powerful desktop, or preferably use a Cloud provider. As always, it depends on price.

I'm happy to contact AWS sales, but would love to hear your success story first so I know I'm not wasting my time.

I've suggested AWS, but I'm open to Azure, Google, or other cloud providers, so if you want to recommend someone other than AWS feel free.

Thanks!
 
Linus van Pelt said:
Hi,

Has anyone setup AWS to host their trading environment?


I'm starting to run optimizations that surpass the capability of my (fairly beefy) laptop. So I need to decide whether to buy a really powerful desktop, or preferably use a Cloud provider. As always, it depends on price.

I'm happy to contact AWS sales, but would love to hear your success story first so I know I'm not wasting my time.

I've suggested AWS, but I'm open to Azure, Google, or other cloud providers, so if you want to recommend someone other than AWS feel free.

Thanks!
Click to expand...
yes, I have one setup on aws;
as a duplicate for my systems:
I do daily update for northgate data then run my AB systems: all that usually from my phone using RD Client on Android;
From time to time, I have to restart the aws window server as i loose internet..couple of months or so;
running well, a saviour for daily systems when I have to travel or busy away from laptop
 
qldfrog said:
yes, I have one setup on aws;
as a duplicate for my systems:
I do daily update for northgate data then run my AB systems: all that usually from my phone using RD Client on Android;
From time to time, I have to restart the aws window server as i loose internet..couple of months or so;
running well, a saviour for daily systems when I have to travel or busy away from laptop
Click to expand...
Can I ask:
1) Are you running Windows Server, as opposed to Windows Professional or Home? If Windows Server, no issues with AB and Norgate?
2) What size machine are you running (AWS nomenclature, like micro, nano, large, etc.)? Exact specs if you're comfortable to share.
3) Does that size meet your needs, esp for optimizations? I have an optimization going on my laptop that will finish in 2-3 days.
4) May ask how much you're paying per month? If you don't want to say, then can you say if AWS pricing gives significant discounts if you pre-purchase, commit to a year, etc. I'm happy to engage AWS Sales Support, but the more info I can give them the better.

It's either AWS or I buy a super machine, probably custom built, circa $8-$10,000. I don't mind paying for good equipment, but would prefer using AWS due to data backup, access from anywhere, security against laptop theft, fire, crash, etc. Bonus would be ramping up the machine when I'm doing optimizations, then running a lower (cheaper) spec'd machine for day-to-day use.

Thanks!
 
Linus van Pelt said:
Can I ask:
1) Are you running Windows Server, as opposed to Windows Professional or Home? If Windows Server, no issues with AB and Norgate?
2) What size machine are you running (AWS nomenclature, like micro, nano, large, etc.)? Exact specs if you're comfortable to share.
3) Does that size meet your needs, esp for optimizations? I have an optimization going on my laptop that will finish in 2-3 days.
4) May ask how much you're paying per month? If you don't want to say, then can you say if AWS pricing gives significant discounts if you pre-purchase, commit to a year, etc. I'm happy to engage AWS Sales Support, but the more info I can give them the better.

It's either AWS or I buy a super machine, probably custom built, circa $8-$10,000. I don't mind paying for good equipment, but would prefer using AWS due to data backup, access from anywhere, security against laptop theft, fire, crash, etc. Bonus would be ramping up the machine when I'm doing optimizations, then running a lower (cheaper) spec'd machine for day-to-day use.

Thanks!
Click to expand...
Sure i have the smallest free option available.
t2.micro 1g memorywindows server.
That's the smallest virtual server available.
Overall i pay $1 to 2$ a month because i sometime use more disk space as i download northgate data
Perf wise, that cheapest option is still faster than my own laptop i7 with decent speed.faster by a 2 factor or so easily when i run my explore.
This is your solution i think more than buying own hardware
 
qldfrog said:
Sure i have the smallest free option available.
t2.micro 1g memorywindows server.
That's the smallest virtual server available.
Overall i pay $1 to 2$ a month because i sometime use more disk space as i download northgate data
Perf wise, that cheapest option is still faster than my own laptop i7 with decent speed.faster by a 2 factor or so easily when i run my explore.
This is your solution i think more than buying own hardware
Click to expand...
Thanks heaps Qldfrog!!! I'll get working on this asap.
 
Goes without saying but keep a couple of backups of your strategies somewhere else aswell. Dataloss does occur with the hyperscalers and backups are your responsibility.
 
stasisbr said:
Goes without saying but keep a couple of backups of your strategies somewhere else aswell. Dataloss does occur with the hyperscalers and backups are your responsibility.
Click to expand...

Thanks great idea.

Right now I've got AB configured via settings to write to OneDrive, so all my strategies, custom code, etc. goes there. I assume I could configure AWS to do the same thing assuming it doesn't block outbound network traffic to OneDrive.

Of course, that AB configuration may not cover everything. I guess a good rule of thumb is assume data on AWS could become unavailable one day. But that's the same as your laptop or desktop - theft, fire, hard disk failure, etc. Perhaps the mantra "Do Your Own Research" should be paired with "Do Your Own Backups" (and store them somewhere safe).

Still, I would think if AWS was in the habit of losing customer's data (esp. paying business customers) without their own proper backups they wouldn't stay in business long.
 
DYOB is a must have and the hyperscalers lose data more often than you would expect. Hence why their recommended architecture is cross region and backups..

Essentially for something as critical as your custom built trading strategies, don't trust someone else to keep them safe :cautious:
 
@Linus van Pelt and @qldfrog , thanks for the inspiration. I just successfully set up IBKR workstation and chartist API in AWS on the free tier. This will be so handy when I'm not at home but still want to trade overnight. Much cheaper than the "trading servers" too.
 
wasp said:
@Linus van Pelt and @qldfrog , thanks for the inspiration. I just successfully set up IBKR workstation and chartist API in AWS on the free tier. This will be so handy when I'm not at home but still want to trade overnight. Much cheaper than the "trading servers" too.
Click to expand...
Was using smarphone access to my aws systems last Friday.it is liberating for daily systems not to have to be glued to your PC every morning waiting for the US trade session end .
I still experience minor differences between AB explores on own pc/ aws instance, probably worth fixing/ understanding the causes
 
Top