Deprecated: Function create_function() is deprecated in /home/cerezona/public_html/blog/wp-content/plugins/codecolorer/lib/geshi.php on line 4698
{"id":1307,"date":"2013-03-31T16:24:53","date_gmt":"2013-03-31T14:24:53","guid":{"rendered":"http:\/\/cerezo.name\/blog\/?p=1307"},"modified":"2024-10-14T15:06:15","modified_gmt":"2024-10-14T13:06:15","slug":"optimal-elasticity-planning","status":"publish","type":"post","link":"https:\/\/cerezo.name\/blog\/2013\/03\/31\/optimal-elasticity-planning\/","title":{"rendered":"Optimal Elasticity Planning"},"content":{"rendered":"

Elasticity and scalability via dynamic provisioning of servers and other resources is one of the tenets of cloud computing: in practice, being able to automatically grow the resources available to an application based on the level of demand is actually eased with patterns like WASABi<\/a>, the Autoscaling Application Block for Azure.<\/p>\n

But even if an application can automatically grow, a question is still unanswered: what is the minimum number of servers that should be reserved<\/strong>? And that is a complex question that requires trading off the losses of being unable to properly service requests because booting up instances takes some minutes, and the actual costs of those instances that may rest idle with no load.<\/p>\n

Let\u2019s consider a service with low margin (10%) and a really intensive computation (8 requests per second per Azure XL<\/span> server) were the probability that a customer does not enter the service due to congestion is 1% and a much higher probability of 2.5% for those leaving the service after a request: to model the whole system an M\/M\/s queue is considered, that is, s<\/em> servers experiencing a Poisson-like input process and an exponential service time, with an unlimited waiting queue. To solve the proposed queue model, R code and its resulting plot as follows:<\/p>\n

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
<\/div><\/td>
# Minimum number of roles to calculate<\/span>
\nminRoles <-<\/span> 4<\/span>
\n# Maximum number of roles to calculate<\/span>
\nmaxRoles <-<\/span> 12<\/span>
\n# Probability of not entering service due to high-load<\/span>
\nprobNotJoin <-<\/span> 0.01<\/span>
\nlossNotJoin <-<\/span> 0<\/span>
\n# Probability of leaving the service due to high-load<\/span>
\nprobLeaving <-<\/span> 0.025<\/span>
\nlossLeaving <-<\/span> 0<\/span>
\n# Revenue per request<\/span>
\ncustomerRevenue <-<\/span> 1<\/span>
\n# Profit per request<\/span>
\ncustomerProfit <-<\/span> 0.1<\/span>
\n# Azure XL<\/span> web\/worker role ($0.96\/hour)<\/span>
\ncostServer <-<\/span> 0.96<\/span>
\n# New requests\/hour<\/span>
\narrivalRate <-<\/span> 90000<\/span>
\n# Requests\/hour serviced per role<\/span>
\nserviceRate <-<\/span> 30000<\/span>
\nserviceCost <-<\/span> 0<\/span>
\ntotalCost <-<\/span> 0<\/span>
\n
\nlibrary<\/span><\/a>(<\/span>pdq, help<\/span><\/a>)<\/span>
\nfor<\/span><\/a>(<\/span>r in<\/span> minRoles:<\/span>maxRoles)<\/span> {<\/span>
\nInit(<\/span>\u201c\u201d<\/span>)<\/span>
\nCreateMultiNode(<\/span>r, \u201cserver\u201d<\/span>, CEN<\/span>, FCFS<\/span>)<\/span>
\nCreateOpen(<\/span>\u201crequests\u201d<\/span>, arrivalRate)<\/span>
\nSetDemand(<\/span>\u201cserver\u201d<\/span>, \u201crequests\u201d<\/span>, 1<\/span>\/<\/span>serviceRate)<\/span>
\n
\nSolve(<\/span>CANON<\/span>)<\/span>
\nqueueLength <-<\/span> GetQueueLength(<\/span>\u201cserver\u201d<\/span>, \u201crequests\u201d<\/span>, TRANS<\/span>)<\/span> -<\/span> arrivalRate\/<\/span>serviceRate
\n
\nwaitingTime <-<\/span> 60<\/span> *<\/span> queueLength\/<\/span>arrivalRate
\nnumNotJoin <-<\/span> queueLength *<\/span> probNotJoin *<\/span> arrivalRate
\nnumLeaving <-<\/span> waitingTime *<\/span> probLeaving *<\/span> arrivalRate
\nserviceCost[<\/span>r]<\/span> <-<\/span> r *<\/span> costServer
\nlossNotJoin[<\/span>r]<\/span> <-<\/span> numNotJoin *<\/span> customerRevenue *<\/span> customerProfit
\nlossLeaving[<\/span>r]<\/span> <-<\/span> numLeaving *<\/span> customerRevenue *<\/span> customerProfit
\ntotalCost[<\/span>r]<\/span> <-<\/span> serviceCost[<\/span>r]<\/span> +<\/span> lossNotJoin[<\/span>r]<\/span> +<\/span> lossLeaving[<\/span>r]<\/span>
\n}<\/span>
\n
\nplot<\/span><\/a>(<\/span>totalCost, xlim=<\/span>c<\/span><\/a>(<\/span>minRoles,maxRoles)<\/span>, type=<\/span>\u201cb\u201d<\/span>, col<\/span><\/a>=<\/span>\u201cblack\u201d<\/span>, lwd=<\/span>2<\/span>,
\nmain=<\/span>\u201cOptimal Elasticity of Demand\u201d<\/span>, xlab=<\/span>\u201cServers (m)\u201d<\/span>, ylab=<\/span>\u201cCost ($)\u201d<\/span>)<\/span>
\nlines<\/span><\/a>(<\/span>serviceCost, xlim=<\/span>c<\/span><\/a>(<\/span>minRoles,maxRoles)<\/span>, type=<\/span>\u201cb\u201d<\/span>, col<\/span><\/a>=<\/span>\u201cbrown\u201d<\/span>, lty=<\/span>\u201cdashed\u201d<\/span>)<\/span>
\nlines<\/span><\/a>(<\/span>lossNotJoin, xlim=<\/span>c<\/span><\/a>(<\/span>minRoles,maxRoles)<\/span>, type=<\/span>\u201cb\u201d<\/span>, col<\/span><\/a>=<\/span>\u201cgreen\u201d<\/span>, lty=<\/span>\u201cdashed\u201d<\/span>)<\/span>
\nlines<\/span><\/a>(<\/span>lossLeaving, xlim=<\/span>c<\/span><\/a>(<\/span>minRoles,maxRoles)<\/span>, type=<\/span>\u201cb\u201d<\/span>, col<\/span><\/a>=<\/span>\u201corange\u201d<\/span>, lty=<\/span>\u201cdashed\u201d<\/span>)<\/span><\/div><\/td><\/tr><\/tbody><\/table><\/div>\n

<\/a><\/p>\n

The black curve represents the total costs: the sum of the server costs (brown curve) and losses due to not entering the service (green curve) and leaving the service (orange curve). An optimal reservation of servers is found at s=8<\/strong>, the minimum of the total curve costs.<\/p>\n","protected":false},"excerpt":{"rendered":"

Elasticity and scalability via dynamic provisioning of servers and other resources is one of the tenets of cloud computing: in practice, being able to automatically grow the resources available to an application based on the level of demand is actually eased with patterns like WASABi, the Autoscaling Application Block for Azure. But even if an application [\u2026]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"wp_typography_post_enhancements_disabled":false,"ngg_post_thumbnail":0},"categories":[19,25],"tags":[],"_links":{"self":[{"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/posts\/1307"}],"collection":[{"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/comments?post=1307"}],"version-history":[{"count":19,"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/posts\/1307\/revisions"}],"predecessor-version":[{"id":1703,"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/posts\/1307\/revisions\/1703"}],"wp:attachment":[{"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/media?parent=1307"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/categories?post=1307"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cerezo.name\/blog\/wp-json\/wp\/v2\/tags?post=1307"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}